Jul 16 11:49:01.947077 ip-10-0-129-78 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 16 11:49:01.947089 ip-10-0-129-78 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 16 11:49:01.947099 ip-10-0-129-78 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 16 11:49:01.947530 ip-10-0-129-78 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 16 11:49:12.114314 ip-10-0-129-78 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 16 11:49:12.114336 ip-10-0-129-78 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7aa88bd57a374207a47ab82f17f7734d --
Jul 16 11:51:11.258662 ip-10-0-129-78 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 11:51:11.619712 ip-10-0-129-78 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 11:51:11.619712 ip-10-0-129-78 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 11:51:11.619712 ip-10-0-129-78 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 11:51:11.619712 ip-10-0-129-78 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 11:51:11.619712 ip-10-0-129-78 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 11:51:11.622160 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.622074    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 11:51:11.627468 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627441    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:51:11.627468 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627464    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:51:11.627468 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627469    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:51:11.627468 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627474    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627480    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627484    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627489    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627493    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627498    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627502    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627506    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627510    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627514    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627518    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627522    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627526    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627531    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627535    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627538    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627543    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627547    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627551    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627554    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627556    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:51:11.627650 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627559    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627561    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627564    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627566    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627569    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627572    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627577    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627581    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627584    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627587    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627590    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627593    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627597    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627600    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627603    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627605    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627609    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627613    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627616    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:51:11.628152 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627619    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627622    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627625    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627627    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627630    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627632    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627635    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627637    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627641    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627644    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627648    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627651    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627654    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627659    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627662    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627664    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627668    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627670    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627673    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:51:11.628617 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627675    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627678    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627681    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627683    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627686    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627689    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627692    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627695    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627697    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627700    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627703    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627705    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627708    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627710    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627713    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627715    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627718    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627720    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627722    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627725    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:51:11.629074 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627727    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627731    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627734    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627736    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627738    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627741    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627743    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627746    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627748    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627751    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627754    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627757    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627759    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627762    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627765    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627767    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.627770    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628576    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628586    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:51:11.629571 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628592    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628596    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628599    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628602    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628605    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628608    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628611    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628613    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628616    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628619    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628622    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628624    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628627    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628630    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628632    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628636    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628639    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628641    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628644    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628646    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:51:11.630018 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628649    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628652    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628654    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628657    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628660    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628663    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628666    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628668    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628670    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628673    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628676    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628679    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628681    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628684    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628687    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628689    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628692    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628694    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628697    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628699    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:51:11.630552 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628702    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628704    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628707    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628711    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628714    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628717    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628719    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628722    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628725    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628729    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628732    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628735    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628737    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628740    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628742    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628745    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628747    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628750    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628752    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:51:11.631043 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628754    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628758    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628760    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628763    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628766    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628768    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628771    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628773    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628776    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628778    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628781    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628783    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628786    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628788    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628790    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628793    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628795    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628798    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628800    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628802    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:51:11.631619 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628808    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628811    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628814    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628816    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628818    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628821    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628824    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628826    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628829    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628831    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628833    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628836    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628838    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628841    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628843    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628845    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628851    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.628853    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629234    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629240    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:51:11.632118 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629243    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629245    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629248    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629251    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629253    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629256    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629259    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629261    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629264    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629266    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629269    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629272    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629275    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629278    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629281    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629283    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629286    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629288    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629291    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629293    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:51:11.632606 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629296    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629298    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629300    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629303    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629305    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629307    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629310    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629313    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629316    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629319    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629321    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629348    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629352    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629356    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629360    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629362    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629366    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629370    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629374    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:51:11.633086 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629377    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629379    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629382    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629385    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629388    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629391    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629394    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629397    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629401    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629404    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629406    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629409    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629412    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629415    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629417    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629419    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629422    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629424    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629427    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629429    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:51:11.633551 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629433    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629438    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629442    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629445    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629447    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629450    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629453    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629455    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629458    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629460    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629463    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629466    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629468    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629470    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629473    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629476    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629479    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629481    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629484    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629486    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:51:11.634030 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629489    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629492    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629494    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629496    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629499    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629501    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629504    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629506    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629508    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629511    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629513    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629516    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629518    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629521    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629525    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629529    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629532    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.629534    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629606    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629614    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 11:51:11.634548 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629620    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629625    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629634    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629637    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629641    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629646    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629649    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629653    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629656    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629659    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629662    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629665    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629668    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629671    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629674    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629677    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629681    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629684    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629687    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629690    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629693    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629701    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629704    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 11:51:11.635069 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629707    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629710    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629714    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629717    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629719    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629723    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629726    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629730    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629733    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629735    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629738    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629741    2564 flags.go:64] FLAG: --enable-server="true"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629744    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629748    2564 flags.go:64] FLAG: --event-burst="100"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629751    2564 flags.go:64] FLAG: --event-qps="50"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629754    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629758    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629761    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629765    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629768    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629771    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629774    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629776    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629779    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629782    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 11:51:11.635633 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629785    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629788    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629790    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629793    2564 flags.go:64] FLAG: --feature-gates=""
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629797    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629800    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629803    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629805    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629808    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629811    2564 flags.go:64] FLAG: --help="false"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629814    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-129-78.ec2.internal"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629817    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629820    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629823    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629826    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629829    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629832    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629835    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629838    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629840    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629843    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629846    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629849    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629854    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 11:51:11.636239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629856    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629859    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629862    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629864    2564 flags.go:64] FLAG: --lock-file=""
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629867    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629870    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629873    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629878    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629882    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629885    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629887    2564 flags.go:64] FLAG: --logging-format="text"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629890    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629893    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629896    2564 flags.go:64] FLAG: --manifest-url=""
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629899    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629904    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629906    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629910    2564 flags.go:64] FLAG: --max-pods="110"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629913    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629916    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629919    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629921    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629924    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629927    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629930    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 11:51:11.636835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629937    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629940    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629943    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629946    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629949    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629954    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629958    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629961    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629964    2564 flags.go:64] FLAG: --port="10250"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629967    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629969    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a4a22ad38daead76"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629972    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629975    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629978    2564 flags.go:64] FLAG: --register-node="true"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629981    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629984    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629987    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629990    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629992    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629996    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.629999    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630001    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630004    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630006    2564 flags.go:64] FLAG: --runonce="false"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630009    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 11:51:11.637450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630012    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630015    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630018    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630020    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630023    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630027    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630029    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630032    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630035    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630038    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630040    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630043    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630046    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630050    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630055    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630057    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630060    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630064    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630066    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630069    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630072    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630074    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630077    2564 flags.go:64] FLAG: --v="2"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630081    2564 flags.go:64] FLAG: --version="false"
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630085    2564 flags.go:64] FLAG: --vmodule=""
Jul 16 11:51:11.638059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630089    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.630092    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630206    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630211    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630214    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630217    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630221    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630224    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630227    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630230    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630232    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630235    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630238    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630240    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630243    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630245    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630248    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630250    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630253    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630255    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:51:11.638706 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630259    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630262    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630264    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630267    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630269    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630272    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630274    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630277    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630279    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630282    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630284    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630287    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630289    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630292    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630295    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630297    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630300    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630302    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630306    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630308    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:51:11.639183 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630311    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630313    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630316    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630318    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630321    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630339    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630342    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630344    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630347    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630350    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630352    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630355    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630359    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630362    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630364    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630368    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630371    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630374    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630377    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:51:11.639684 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630380    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630383    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630385    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630388    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630390    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630393    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630396    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630399    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630402    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630404    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630407    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630410    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630413    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630415    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630418    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630420    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630423    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630425    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630428    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630431    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:51:11.640159 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630433    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630435    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630438    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630442    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630445    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630449    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630452    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630454    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630457    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630459    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630462    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630464    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630467    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630469    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630472    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630474    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630476    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630479    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630481    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:51:11.640652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630486    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:51:11.641104 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630489    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:51:11.641104 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.630492    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:51:11.641104 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.631132    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 11:51:11.641104 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.638162    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 11:51:11.641104 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.638177    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 11:51:11.641104 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.638198    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 11:51:11.641104 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.638204    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 11:51:11.641104 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638258    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:51:11.641104 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638263    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:51:11.641104 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638267    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:51:11.641104 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638270    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:51:11.641104 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638274    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:51:11.641104 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638277    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:51:11.641104 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638280    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:51:11.641104 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638283    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638286    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638289    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638292    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638294    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638297    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638300    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638302    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638305    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638307    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638309    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638312    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638315    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638318    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638320    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638342    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638346    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638348    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638352    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638355    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:51:11.641497 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638358    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638361    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638365    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638368    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638371    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638373    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638376    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638379    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638381    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638384    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638386    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638390    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638395    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638397    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638400    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638403    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638405    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638408    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638411    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638413    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:51:11.641982 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638416    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638418    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638421    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638424    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638426    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638429    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638431    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638434    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638436    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638439    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638441    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638444    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638446    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638449    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638452    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638464    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638467    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638469    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638472    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638474    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:51:11.642526 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638477    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638479    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638482    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638484    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638487    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638489    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638492    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638494    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638498    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638502    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638505    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638508    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638510    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638513    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638516    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638518    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638521    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638524    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638526    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:51:11.642999 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638529    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:51:11.643493 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638531    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:51:11.643493 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638535    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:51:11.643493 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638538    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:51:11.643493 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638541    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:51:11.643493 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638545    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:51:11.643493 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638548    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:51:11.643493 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638550    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:51:11.643493 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638553    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:51:11.643493 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638556    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:51:11.643493 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638559    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:51:11.643493 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638561    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:51:11.643493 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638563    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:51:11.643493 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.638569    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 11:51:11.643493 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638683    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638689    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638691    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638694    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638697    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638699    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638702    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638704    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638707    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638710    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638712    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638715    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638719    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638723    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638726    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638729    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638733    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638735    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638738    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:51:11.643848 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638741    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638744    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638747    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638749    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638752    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638755    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638757    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638760    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638762    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638765    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638768    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638771    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638773    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638776    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638778    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638781    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638783    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638786    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638788    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638791    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:51:11.644306 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638794    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638798    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638800    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638803    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638806    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638809    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638812    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638814    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638817    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638819    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638822    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638824    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638827    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638829    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638832    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638834    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638837    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638840    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638843    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638846    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:51:11.644805 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638848    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638851    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638855    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638857    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638860    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638862    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638864    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638867    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638869    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638872    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638874    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638877    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638880    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638882    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638884    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638887    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638889    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638892    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638894    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:51:11.645299 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638897    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638900    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638902    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638905    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638907    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638910    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638912    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638915    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638917    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638920    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638922    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638925    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638928    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638930    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638933    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638936    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638939    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638941    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638944    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:51:11.645799 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638947    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:51:11.646267 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:11.638950    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:51:11.646267 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.638955    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 11:51:11.646267 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.639816    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 11:51:11.646267 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.641894    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 11:51:11.646267 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.643198    2564 server.go:1019] "Starting client certificate rotation"
Jul 16 11:51:11.646267 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.643301    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 11:51:11.646267 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.643352    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 11:51:11.646267 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.645682    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 11:51:11.646945 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.646933    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 11:51:11.655776 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.655756    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 16 11:51:11.657619 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.657605    2564 log.go:25] "Validated CRI v1 image API"
Jul 16 11:51:11.658444 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.658419    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 11:51:11.661292 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.661261    2564 fs.go:135] Filesystem UUIDs: map[34f011d3-19e0-4591-9bb2-c800e38e7bf3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7a6afc18-049e-4b4e-b254-9e32da76ac03:/dev/nvme0n1p4]
Jul 16 11:51:11.661400 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.661290    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 11:51:11.666961 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.666849    2564 manager.go:216] Machine: {Timestamp:2026-07-16 11:51:11.665609755 +0000 UTC m=+0.300403818 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098750 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22d239a87cbcfa120e9403d92e72c2 SystemUUID:ec22d239-a87c-bcfa-120e-9403d92e72c2 BootID:7aa88bd5-7a37-4207-a47a-b82f17f7734d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:82:76:a4:b4:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:82:76:a4:b4:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:cc:f4:c9:71:e7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 11:51:11.666961 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.666954    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 11:51:11.667120 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.667061    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 11:51:11.669755 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.669716    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 11:51:11.669918 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.669759    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-78.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 11:51:11.670560 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.670548    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 11:51:11.670624 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.670565    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 11:51:11.670624 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.670582    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 11:51:11.670796 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.670781    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 11:51:11.671282 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.671269    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 11:51:11.672511 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.672499    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 11:51:11.675451 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.675438    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 11:51:11.675597 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.675586    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 11:51:11.675659 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.675624    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 11:51:11.675659 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.675646    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 11:51:11.675752 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.675667    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 11:51:11.675752 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.675686    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 16 11:51:11.675752 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.675709    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 11:51:11.676093 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.676077    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 11:51:11.676161 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.676102    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 11:51:11.678097 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.678081    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 11:51:11.680302 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.680289    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 11:51:11.680379 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.680320    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 11:51:11.680490 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.680481    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 11:51:11.680519 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.680496    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 11:51:11.680519 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.680502    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 11:51:11.680519 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.680507    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 11:51:11.680519 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.680515    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 11:51:11.680519 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.680520    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 11:51:11.681045 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.681037    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 11:51:11.681078 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.681047    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 11:51:11.681078 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.681053    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 11:51:11.681078 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.681059    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 11:51:11.681078 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.681067    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 11:51:11.681078 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.681075    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 11:51:11.681211 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.681097    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 11:51:11.681211 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.681103    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 11:51:11.684536 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.684521    2564 server.go:1268] "Started kubelet"
Jul 16 11:51:11.684698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.684633    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 11:51:11.684821 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.684756    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 11:51:11.684880 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.684846    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 11:51:11.685255 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.685237    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-78.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 11:51:11.685354 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:11.685255    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 11:51:11.685354 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:11.685270    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 11:51:11.685479 ip-10-0-129-78 systemd[1]: Started Kubernetes Kubelet.
Jul 16 11:51:11.688091 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.688064    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 11:51:11.690002 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.689971    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 11:51:11.691315 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:11.691291    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 11:51:11.695411 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:11.694479    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-78.ec2.internal.18c2c2e0750e9f23  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-78.ec2.internal,UID:ip-10-0-129-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-78.ec2.internal,},FirstTimestamp:2026-07-16 11:51:11.684493091 +0000 UTC m=+0.319287153,LastTimestamp:2026-07-16 11:51:11.684493091 +0000 UTC m=+0.319287153,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-78.ec2.internal,}"
Jul 16 11:51:11.697004 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.696989    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 11:51:11.697079 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.697025    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 11:51:11.697209 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:11.697175    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found"
Jul 16 11:51:11.697772 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.697736    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 11:51:11.697889 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.697760    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 11:51:11.697965 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.697950    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 11:51:11.698083 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.698065    2564 factory.go:55] Registering systemd factory
Jul 16 11:51:11.698145 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.698088    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 16 11:51:11.698145 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.698094    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 11:51:11.698145 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.698103    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 11:51:11.698293 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.698282    2564 factory.go:153] Registering CRI-O factory
Jul 16 11:51:11.698293 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.698293    2564 factory.go:223] Registration of the crio container factory successfully
Jul 16 11:51:11.698393 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.698360    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 11:51:11.698393 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.698383    2564 factory.go:103] Registering Raw factory
Jul 16 11:51:11.698485 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.698398    2564 manager.go:1196] Started watching for new ooms in manager
Jul 16 11:51:11.698550 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.698524    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gj6vp"
Jul 16 11:51:11.698999 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.698984    2564 manager.go:349] Starting recovery of all containers
Jul 16 11:51:11.699688 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:11.699664    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 11:51:11.699781 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:11.699761    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 11:51:11.707137 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.706878    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gj6vp"
Jul 16 11:51:11.707847 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.707826    2564 manager.go:354] Recovery completed
Jul 16 11:51:11.711820 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.711805    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:51:11.714605 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.714590    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:51:11.714679 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.714611    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:51:11.714679 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.714621    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:51:11.715081 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.715067    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 11:51:11.715081 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.715080    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 11:51:11.715156 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.715095    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 11:51:11.715187 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.715071    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:51:11.716177 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.716164    2564 policy_none.go:49] "None policy: Start"
Jul 16 11:51:11.716237 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.716183    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 11:51:11.716237 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.716197    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 11:51:11.716306 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.716277    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:51:11.716362 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.716308    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:51:11.716362 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.716321    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:51:11.716555 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:11.716497    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-78.ec2.internal.18c2c2e076da111c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-78.ec2.internal,UID:ip-10-0-129-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-78.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-78.ec2.internal,},FirstTimestamp:2026-07-16 11:51:11.714603292 +0000 UTC m=+0.349397357,LastTimestamp:2026-07-16 11:51:11.714603292 +0000 UTC m=+0.349397357,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-78.ec2.internal,}"
Jul 16 11:51:11.717293 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.717282    2564 policy_none.go:47] "Start"
Jul 16 11:51:11.752881 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.752865    2564 manager.go:337] "Starting Device Plugin manager"
Jul 16 11:51:11.752975 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:11.752897    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 11:51:11.752975 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.752906    2564 server.go:87] "Starting device plugin registration server"
Jul 16 11:51:11.753128 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.753117    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 11:51:11.753166 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.753130    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 11:51:11.753268 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.753217    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 11:51:11.753367 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.753350    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 11:51:11.753367 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.753363    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 11:51:11.753845 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:11.753825    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 11:51:11.753920 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:11.753869    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-78.ec2.internal\" not found"
Jul 16 11:51:11.846757 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.846723    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 11:51:11.848089 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.848071    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 11:51:11.848175 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.848113    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 11:51:11.848175 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.848139    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 11:51:11.848275 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:11.848178    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 11:51:11.850503 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.850486    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 11:51:11.853436 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.853417    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:51:11.854204 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.854187    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:51:11.854284 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.854219    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:51:11.854284 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.854229    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:51:11.854284 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.854254    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-78.ec2.internal"
Jul 16 11:51:11.862101 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.862085    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-78.ec2.internal"
Jul 16 11:51:11.862150 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:11.862108    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-78.ec2.internal\": node \"ip-10-0-129-78.ec2.internal\" not found"
Jul 16 11:51:11.876004 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:11.875958    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found"
Jul 16 11:51:11.949150 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.949113    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal"]
Jul 16 11:51:11.949279 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.949198    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:51:11.950823 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.950804    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:51:11.950929 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.950838    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:51:11.950929 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.950852    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:51:11.952122 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.952107    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:51:11.952253 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.952236    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal"
Jul 16 11:51:11.952298 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.952270    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:51:11.952826 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.952807    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:51:11.952826 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.952818    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:51:11.952953 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.952835    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:51:11.952953 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.952843    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:51:11.952953 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.952849    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:51:11.952953 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.952856    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:51:11.953961 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.953948    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal"
Jul 16 11:51:11.954014 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.953974    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:51:11.954624 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.954607    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:51:11.954708 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.954641    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:51:11.954708 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.954655    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:51:11.976385 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:11.976356    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found"
Jul 16 11:51:11.984977 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:11.984958    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-78.ec2.internal\" not found" node="ip-10-0-129-78.ec2.internal"
Jul 16 11:51:11.989488 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:11.989472    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-78.ec2.internal\" not found" node="ip-10-0-129-78.ec2.internal"
Jul 16 11:51:11.999889 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.999851    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d45dbf681ab5874d9b9ab53dc02f0af6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal\" (UID: \"d45dbf681ab5874d9b9ab53dc02f0af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal"
Jul 16 11:51:11.999977 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.999892    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d45dbf681ab5874d9b9ab53dc02f0af6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal\" (UID: \"d45dbf681ab5874d9b9ab53dc02f0af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal"
Jul 16 11:51:11.999977 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:11.999909    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/69bb1843a08e184331a0a7517508501b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-78.ec2.internal\" (UID: \"69bb1843a08e184331a0a7517508501b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal"
Jul 16 11:51:12.077297 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:12.077265    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found"
Jul 16 11:51:12.100689 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.100668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d45dbf681ab5874d9b9ab53dc02f0af6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal\" (UID: \"d45dbf681ab5874d9b9ab53dc02f0af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal"
Jul 16 11:51:12.100774 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.100695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d45dbf681ab5874d9b9ab53dc02f0af6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal\" (UID: \"d45dbf681ab5874d9b9ab53dc02f0af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal"
Jul 16 11:51:12.100774 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.100711    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/69bb1843a08e184331a0a7517508501b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-78.ec2.internal\" (UID: \"69bb1843a08e184331a0a7517508501b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal"
Jul 16 11:51:12.100774 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.100743    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d45dbf681ab5874d9b9ab53dc02f0af6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal\" (UID: \"d45dbf681ab5874d9b9ab53dc02f0af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal"
Jul 16 11:51:12.100774 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.100765    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/69bb1843a08e184331a0a7517508501b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-78.ec2.internal\" (UID: \"69bb1843a08e184331a0a7517508501b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal"
Jul 16 11:51:12.100774 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.100766    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d45dbf681ab5874d9b9ab53dc02f0af6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal\" (UID: \"d45dbf681ab5874d9b9ab53dc02f0af6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal"
Jul 16 11:51:12.178073 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:12.178004    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found"
Jul 16 11:51:12.278518 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:12.278474    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found"
Jul 16 11:51:12.287665 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.287639    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal"
Jul 16 11:51:12.292629 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.292611    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal"
Jul 16 11:51:12.379490 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:12.379455    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found"
Jul 16 11:51:12.480110 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:12.480020    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found"
Jul 16 11:51:12.580933 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:12.580896    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found"
Jul 16 11:51:12.642786 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.642746    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 11:51:12.643335 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.642909    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 11:51:12.682083 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:12.682045    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found"
Jul 16 11:51:12.710487 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.710452    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 11:46:12 +0000 UTC" deadline="2028-01-19 02:50:32.419276958 +0000 UTC"
Jul 16 11:51:12.710487 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.710485    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13238h59m19.708795457s"
Jul 16 11:51:12.783008 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:12.782925    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found"
Jul 16 11:51:12.800246 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:12.800212    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69bb1843a08e184331a0a7517508501b.slice/crio-095df0520a7c6cbdde4274edf05dc9f925ab830d8a2e8a5c986c2ff8d7ad5d12 WatchSource:0}: Error finding container 095df0520a7c6cbdde4274edf05dc9f925ab830d8a2e8a5c986c2ff8d7ad5d12: Status 404 returned error can't find the container with id 095df0520a7c6cbdde4274edf05dc9f925ab830d8a2e8a5c986c2ff8d7ad5d12
Jul 16 11:51:12.804688 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.804672    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 11:51:12.833320 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:12.833297    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd45dbf681ab5874d9b9ab53dc02f0af6.slice/crio-bdb34c2dd1df617b36df72253ff9b64c53ecc34f348d7d2a2f65891aefdd7eec WatchSource:0}: Error finding container bdb34c2dd1df617b36df72253ff9b64c53ecc34f348d7d2a2f65891aefdd7eec: Status 404 returned error can't find the container with id bdb34c2dd1df617b36df72253ff9b64c53ecc34f348d7d2a2f65891aefdd7eec
Jul 16 11:51:12.852358 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.852296    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal" event={"ID":"d45dbf681ab5874d9b9ab53dc02f0af6","Type":"ContainerStarted","Data":"bdb34c2dd1df617b36df72253ff9b64c53ecc34f348d7d2a2f65891aefdd7eec"}
Jul 16 11:51:12.853526 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.853502    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal" event={"ID":"69bb1843a08e184331a0a7517508501b","Type":"ContainerStarted","Data":"095df0520a7c6cbdde4274edf05dc9f925ab830d8a2e8a5c986c2ff8d7ad5d12"}
Jul 16 11:51:12.864849 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.864826    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 11:51:12.884416 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:12.884390    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-78.ec2.internal\" not found"
Jul 16 11:51:12.925397 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.925370    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 11:51:12.998264 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:12.998232    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal"
Jul 16 11:51:13.014342 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.014299    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 11:51:13.016419 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.016402    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal"
Jul 16 11:51:13.025710 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.025691    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 11:51:13.149017 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.148936    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 11:51:13.678179 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.678143    2564 apiserver.go:52] "Watching apiserver"
Jul 16 11:51:13.688139 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.687685    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 11:51:13.691450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.691423    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-qj68c","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t","openshift-cluster-node-tuning-operator/tuned-cwlcj","openshift-dns/node-resolver-bp2rl","openshift-image-registry/node-ca-8929c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal","openshift-multus/multus-7vtc7","openshift-ovn-kubernetes/ovnkube-node-cd6t8","kube-system/global-pull-secret-syncer-fdd9b","kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal","openshift-multus/multus-additional-cni-plugins-74ll5","openshift-multus/network-metrics-daemon-7hnqd","openshift-network-diagnostics/network-check-target-rpr92","openshift-network-operator/iptables-alerter-vvphn"]
Jul 16 11:51:13.693165 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.693132    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.695165 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.694884    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.696655 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.696509    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 11:51:13.696655 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.696532    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 11:51:13.696655 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.696555    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 11:51:13.696655 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.696509    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 11:51:13.696919 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.696830    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 11:51:13.696919 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.696849    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-phcc5\""
Jul 16 11:51:13.697047 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.697031    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.697301 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.697282    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 11:51:13.698272 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.698249    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 11:51:13.698366 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.698287    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zkfwc\""
Jul 16 11:51:13.698366 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.698317    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 11:51:13.698510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.698332    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 11:51:13.698510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.698501    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qj68c"
Jul 16 11:51:13.699600 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.699553    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 11:51:13.699696 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.699602    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p5j8l\""
Jul 16 11:51:13.699696 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.699561    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 11:51:13.699696 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.699675    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8929c"
Jul 16 11:51:13.701006 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.700985    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gmzbz\""
Jul 16 11:51:13.701225 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.701192    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:13.701307 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:13.701262    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:13.701307 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.701200    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 11:51:13.701637 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.701619    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 11:51:13.703357 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.702732    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.703357 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.702938    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 11:51:13.703357 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.703141    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 11:51:13.703357 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.703215    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rjtcr\""
Jul 16 11:51:13.703357 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.703241    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 11:51:13.704876 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.704854    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.706939 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.706724    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 11:51:13.707560 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.707206    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-478lj\""
Jul 16 11:51:13.707994 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.707970    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vx7sq\""
Jul 16 11:51:13.708240 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.708220    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 11:51:13.708301 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.708259    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 11:51:13.708807 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.708619    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 11:51:13.709087 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.709066    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bp2rl"
Jul 16 11:51:13.709776 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.709727    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69851010-8a64-40df-b2fa-a65d69a78155-cnibin\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.710373 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.709939    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 11:51:13.710373 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.710014    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4b6s\" (UniqueName: \"kubernetes.io/projected/829adca8-53a6-4b65-a115-f08309589329-kube-api-access-f4b6s\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.710373 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.710037    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 11:51:13.710373 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.710056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f01f887f-219a-4248-a266-511c7fa0eea4-agent-certs\") pod \"konnectivity-agent-qj68c\" (UID: \"f01f887f-219a-4248-a266-511c7fa0eea4\") " pod="kube-system/konnectivity-agent-qj68c"
Jul 16 11:51:13.710373 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.710087    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69851010-8a64-40df-b2fa-a65d69a78155-os-release\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.710373 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.710098    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 11:51:13.710373 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.710126    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-device-dir\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.710373 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.710159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-modprobe-d\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.710373 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.710231    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-sysctl-conf\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.710373 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.710286    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-sys\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.710897 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.710377    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-sysconfig\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.710897 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.710379    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 11:51:13.710897 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.710666    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-run\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.710897 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.710710    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/829adca8-53a6-4b65-a115-f08309589329-etc-tuned\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.710897 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.710750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69851010-8a64-40df-b2fa-a65d69a78155-system-cni-dir\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.710897 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.710824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69851010-8a64-40df-b2fa-a65d69a78155-tuning-conf-dir\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.711322 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/69851010-8a64-40df-b2fa-a65d69a78155-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.711395 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-socket-dir\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.711458 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711405    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt97b\" (UniqueName: \"kubernetes.io/projected/ec0d5a60-7817-4c3d-8797-975321a3a094-kube-api-access-jt97b\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.711458 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711434    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-kubernetes\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.711564 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711458    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-systemd\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.711564 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711491    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-var-lib-kubelet\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.711564 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69851010-8a64-40df-b2fa-a65d69a78155-cni-binary-copy\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.711564 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711541    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-registration-dir\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.711760 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711565    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/829adca8-53a6-4b65-a115-f08309589329-tmp\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.711760 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711600    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f01f887f-219a-4248-a266-511c7fa0eea4-konnectivity-ca\") pod \"konnectivity-agent-qj68c\" (UID: \"f01f887f-219a-4248-a266-511c7fa0eea4\") " pod="kube-system/konnectivity-agent-qj68c"
Jul 16 11:51:13.711760 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711623    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/69851010-8a64-40df-b2fa-a65d69a78155-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.711760 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711663    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8zhc\" (UniqueName: \"kubernetes.io/projected/69851010-8a64-40df-b2fa-a65d69a78155-kube-api-access-x8zhc\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.711760 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711700    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-etc-selinux\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.711760 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.711760 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711752    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-sys-fs\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.712168 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711775    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-sysctl-d\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.712168 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-lib-modules\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.712168 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711819    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-host\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.712168 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.711847    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 11:51:13.712369 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.712241    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5pm9d\""
Jul 16 11:51:13.712369 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.712316    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 11:51:13.712980 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.712957    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:13.713057 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:13.713042    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:13.714807 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.714783    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:13.714911 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:13.714869    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:13.718271 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.718249    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vvphn"
Jul 16 11:51:13.722258 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.722225    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 11:51:13.722397 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.722263    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 11:51:13.722397 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.722230    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 11:51:13.722525 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.722471    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8mn8n\""
Jul 16 11:51:13.737597 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.737569    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kxq85"
Jul 16 11:51:13.743709 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.743681    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kxq85"
Jul 16 11:51:13.799449 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.799393    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 11:51:13.812593 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.812559    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/554acfac-aace-48e2-a6e4-54b9a794d6ee-dbus\") pod \"global-pull-secret-syncer-fdd9b\" (UID: \"554acfac-aace-48e2-a6e4-54b9a794d6ee\") " pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:13.812760 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.812606    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-multus-cni-dir\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.812760 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.812637    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67qt2\" (UniqueName: \"kubernetes.io/projected/1b471a05-b0ca-44b6-ae9b-2f2c73863615-kube-api-access-67qt2\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.812760 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.812668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-sys-fs\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.812760 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.812691    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-run-netns\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.812760 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.812714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-run-multus-certs\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.812760 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.812738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.813076 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.812764    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e38731d-db50-48f8-bf39-caac0473dcc6-hosts-file\") pod \"node-resolver-bp2rl\" (UID: \"8e38731d-db50-48f8-bf39-caac0473dcc6\") " pod="openshift-dns/node-resolver-bp2rl"
Jul 16 11:51:13.813076 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.812791    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e38731d-db50-48f8-bf39-caac0473dcc6-tmp-dir\") pod \"node-resolver-bp2rl\" (UID: \"8e38731d-db50-48f8-bf39-caac0473dcc6\") " pod="openshift-dns/node-resolver-bp2rl"
Jul 16 11:51:13.813076 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.812816    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/554acfac-aace-48e2-a6e4-54b9a794d6ee-kubelet-config\") pod \"global-pull-secret-syncer-fdd9b\" (UID: \"554acfac-aace-48e2-a6e4-54b9a794d6ee\") " pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:13.813076 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.812844    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69851010-8a64-40df-b2fa-a65d69a78155-cnibin\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.813076 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.812884    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4b6s\" (UniqueName: \"kubernetes.io/projected/829adca8-53a6-4b65-a115-f08309589329-kube-api-access-f4b6s\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.813076 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.812910    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f01f887f-219a-4248-a266-511c7fa0eea4-agent-certs\") pod \"konnectivity-agent-qj68c\" (UID: \"f01f887f-219a-4248-a266-511c7fa0eea4\") " pod="kube-system/konnectivity-agent-qj68c"
Jul 16 11:51:13.813076 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.812933    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-system-cni-dir\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.813076 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.812964    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-var-lib-kubelet\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.813076 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.812989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-etc-kubernetes\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.813076 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813013    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-run-netns\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.813076 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813051    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-run-ovn\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.813076 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813077    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69851010-8a64-40df-b2fa-a65d69a78155-os-release\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.813771 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813104    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-modprobe-d\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.813771 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-slash\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.813771 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813236    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-var-lib-openvswitch\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.813771 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813261    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-log-socket\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.813771 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813340    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-run-ovn-kubernetes\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.813771 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813380    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48cx9\" (UniqueName: \"kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9\") pod \"network-check-target-rpr92\" (UID: \"a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245\") " pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:13.813771 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813463    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-sysconfig\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.813771 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813497    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-run\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.813771 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813523    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/829adca8-53a6-4b65-a115-f08309589329-etc-tuned\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.813771 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813559    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxtg6\" (UniqueName: \"kubernetes.io/projected/8e38731d-db50-48f8-bf39-caac0473dcc6-kube-api-access-fxtg6\") pod \"node-resolver-bp2rl\" (UID: \"8e38731d-db50-48f8-bf39-caac0473dcc6\") " pod="openshift-dns/node-resolver-bp2rl"
Jul 16 11:51:13.813771 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69851010-8a64-40df-b2fa-a65d69a78155-tuning-conf-dir\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.813771 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813620    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-socket-dir\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.813771 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813657    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt97b\" (UniqueName: \"kubernetes.io/projected/ec0d5a60-7817-4c3d-8797-975321a3a094-kube-api-access-jt97b\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.813771 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-kubernetes\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.813771 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813710    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-var-lib-kubelet\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.813771 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813755    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/829adca8-53a6-4b65-a115-f08309589329-tmp\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.814698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813799    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs\") pod \"network-metrics-daemon-7hnqd\" (UID: \"e86ac627-b483-498d-bd18-e4ff68efe17e\") " pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:13.814698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813841    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-var-lib-cni-bin\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.814698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813867    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-kubelet\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.814698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813890    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81602ec2-6161-4799-a83c-d8b926799fe2-host\") pod \"node-ca-8929c\" (UID: \"81602ec2-6161-4799-a83c-d8b926799fe2\") " pod="openshift-image-registry/node-ca-8929c"
Jul 16 11:51:13.814698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.813976    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bggn\" (UniqueName: \"kubernetes.io/projected/81602ec2-6161-4799-a83c-d8b926799fe2-kube-api-access-5bggn\") pod \"node-ca-8929c\" (UID: \"81602ec2-6161-4799-a83c-d8b926799fe2\") " pod="openshift-image-registry/node-ca-8929c"
Jul 16 11:51:13.814698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814004    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlkjp\" (UniqueName: \"kubernetes.io/projected/1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb-kube-api-access-hlkjp\") pod \"iptables-alerter-vvphn\" (UID: \"1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb\") " pod="openshift-network-operator/iptables-alerter-vvphn"
Jul 16 11:51:13.814698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814030    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a9dd4544-99c9-4565-8f45-b124541bb29e-multus-daemon-config\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.814698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-cni-netd\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.814698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/69851010-8a64-40df-b2fa-a65d69a78155-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.814698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8zhc\" (UniqueName: \"kubernetes.io/projected/69851010-8a64-40df-b2fa-a65d69a78155-kube-api-access-x8zhc\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.814698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814152    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-etc-selinux\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.814698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814178    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-os-release\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.814698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814208    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9dd4544-99c9-4565-8f45-b124541bb29e-cni-binary-copy\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.814698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814234    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret\") pod \"global-pull-secret-syncer-fdd9b\" (UID: \"554acfac-aace-48e2-a6e4-54b9a794d6ee\") " pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:13.814698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814260    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.814698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814325    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-sysctl-d\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.814698 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814355    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-lib-modules\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.815632 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814394    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-host\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.815632 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814467    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-var-lib-cni-multus\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.815632 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814524    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-node-log\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.815632 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b471a05-b0ca-44b6-ae9b-2f2c73863615-ovn-node-metrics-cert\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.815632 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814642    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b471a05-b0ca-44b6-ae9b-2f2c73863615-ovnkube-script-lib\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.815632 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814680    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56td2\" (UniqueName: \"kubernetes.io/projected/e86ac627-b483-498d-bd18-e4ff68efe17e-kube-api-access-56td2\") pod \"network-metrics-daemon-7hnqd\" (UID: \"e86ac627-b483-498d-bd18-e4ff68efe17e\") " pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:13.815632 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814710    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-cni-bin\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.815632 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814765    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b471a05-b0ca-44b6-ae9b-2f2c73863615-env-overrides\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.815632 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814791    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81602ec2-6161-4799-a83c-d8b926799fe2-serviceca\") pod \"node-ca-8929c\" (UID: \"81602ec2-6161-4799-a83c-d8b926799fe2\") " pod="openshift-image-registry/node-ca-8929c"
Jul 16 11:51:13.815632 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.814947    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 11:51:13.815632 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb-iptables-alerter-script\") pod \"iptables-alerter-vvphn\" (UID: \"1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb\") " pod="openshift-network-operator/iptables-alerter-vvphn"
Jul 16 11:51:13.815632 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815386    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-device-dir\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.815632 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815434    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-sysctl-conf\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.815632 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815466    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-sys\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.815632 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815489    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-cnibin\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.815632 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815516    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-multus-socket-dir-parent\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.815632 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-run-k8s-cni-cncf-io\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.816486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815578    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb-host-slash\") pod \"iptables-alerter-vvphn\" (UID: \"1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb\") " pod="openshift-network-operator/iptables-alerter-vvphn"
Jul 16 11:51:13.816486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815604    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-multus-conf-dir\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.816486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815638    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-systemd-units\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.816486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815669    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69851010-8a64-40df-b2fa-a65d69a78155-system-cni-dir\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.816486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/69851010-8a64-40df-b2fa-a65d69a78155-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.816486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815767    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-systemd\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.816486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815800    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69851010-8a64-40df-b2fa-a65d69a78155-cni-binary-copy\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.816486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815829    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-registration-dir\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.816486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f01f887f-219a-4248-a266-511c7fa0eea4-konnectivity-ca\") pod \"konnectivity-agent-qj68c\" (UID: \"f01f887f-219a-4248-a266-511c7fa0eea4\") " pod="kube-system/konnectivity-agent-qj68c"
Jul 16 11:51:13.816486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815884    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69851010-8a64-40df-b2fa-a65d69a78155-tuning-conf-dir\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.816486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5x45\" (UniqueName: \"kubernetes.io/projected/a9dd4544-99c9-4565-8f45-b124541bb29e-kube-api-access-b5x45\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.816486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815946    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-run-systemd\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.816486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815982    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-etc-openvswitch\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.816486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.815999    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-socket-dir\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.816486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.816008    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-hostroot\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.816486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.816049    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-run-openvswitch\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.816486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.816093    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b471a05-b0ca-44b6-ae9b-2f2c73863615-ovnkube-config\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.817282 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.816119    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69851010-8a64-40df-b2fa-a65d69a78155-cnibin\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.817282 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.816673    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-modprobe-d\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.817282 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.816730    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-sysconfig\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.817282 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.816790    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-run\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.817282 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.816806    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-device-dir\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.817282 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.816866    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-registration-dir\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.817282 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.816870    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-systemd\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.817282 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.817250    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-kubernetes\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.817737 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.817319    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-var-lib-kubelet\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.817737 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.817541    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f01f887f-219a-4248-a266-511c7fa0eea4-konnectivity-ca\") pod \"konnectivity-agent-qj68c\" (UID: \"f01f887f-219a-4248-a266-511c7fa0eea4\") " pod="kube-system/konnectivity-agent-qj68c"
Jul 16 11:51:13.817737 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.817638    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69851010-8a64-40df-b2fa-a65d69a78155-cni-binary-copy\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.817921 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.817818    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-sysctl-conf\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.817921 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.817881    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-sys\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.818030 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.817975    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-sys-fs\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.818084 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.818036    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69851010-8a64-40df-b2fa-a65d69a78155-system-cni-dir\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.818140 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.818094    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/69851010-8a64-40df-b2fa-a65d69a78155-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.818787 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.818250    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69851010-8a64-40df-b2fa-a65d69a78155-os-release\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.818787 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.818383    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-etc-sysctl-d\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.818787 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.818478    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.818787 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.818567    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ec0d5a60-7817-4c3d-8797-975321a3a094-etc-selinux\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.818787 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.818602    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-host\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.818787 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.818665    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/829adca8-53a6-4b65-a115-f08309589329-lib-modules\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.818787 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.818736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/69851010-8a64-40df-b2fa-a65d69a78155-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.820144 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.819556    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f01f887f-219a-4248-a266-511c7fa0eea4-agent-certs\") pod \"konnectivity-agent-qj68c\" (UID: \"f01f887f-219a-4248-a266-511c7fa0eea4\") " pod="kube-system/konnectivity-agent-qj68c"
Jul 16 11:51:13.820889 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.820866    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/829adca8-53a6-4b65-a115-f08309589329-etc-tuned\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.821016 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.820995    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/829adca8-53a6-4b65-a115-f08309589329-tmp\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.825284 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.825260    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt97b\" (UniqueName: \"kubernetes.io/projected/ec0d5a60-7817-4c3d-8797-975321a3a094-kube-api-access-jt97b\") pod \"aws-ebs-csi-driver-node-5zr8t\" (UID: \"ec0d5a60-7817-4c3d-8797-975321a3a094\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:13.826775 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.826747    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4b6s\" (UniqueName: \"kubernetes.io/projected/829adca8-53a6-4b65-a115-f08309589329-kube-api-access-f4b6s\") pod \"tuned-cwlcj\" (UID: \"829adca8-53a6-4b65-a115-f08309589329\") " pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:13.827053 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.827021    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8zhc\" (UniqueName: \"kubernetes.io/projected/69851010-8a64-40df-b2fa-a65d69a78155-kube-api-access-x8zhc\") pod \"multus-additional-cni-plugins-74ll5\" (UID: \"69851010-8a64-40df-b2fa-a65d69a78155\") " pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:13.917396 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917332    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-run-ovn-kubernetes\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.917573 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917417    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48cx9\" (UniqueName: \"kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9\") pod \"network-check-target-rpr92\" (UID: \"a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245\") " pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:13.917573 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917450    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxtg6\" (UniqueName: \"kubernetes.io/projected/8e38731d-db50-48f8-bf39-caac0473dcc6-kube-api-access-fxtg6\") pod \"node-resolver-bp2rl\" (UID: \"8e38731d-db50-48f8-bf39-caac0473dcc6\") " pod="openshift-dns/node-resolver-bp2rl"
Jul 16 11:51:13.917573 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-run-ovn-kubernetes\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.917573 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917481    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs\") pod \"network-metrics-daemon-7hnqd\" (UID: \"e86ac627-b483-498d-bd18-e4ff68efe17e\") " pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:13.917573 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917527    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-var-lib-cni-bin\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.917573 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917554    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-kubelet\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.917872 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917578    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81602ec2-6161-4799-a83c-d8b926799fe2-host\") pod \"node-ca-8929c\" (UID: \"81602ec2-6161-4799-a83c-d8b926799fe2\") " pod="openshift-image-registry/node-ca-8929c"
Jul 16 11:51:13.917872 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917601    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-var-lib-cni-bin\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.917872 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bggn\" (UniqueName: \"kubernetes.io/projected/81602ec2-6161-4799-a83c-d8b926799fe2-kube-api-access-5bggn\") pod \"node-ca-8929c\" (UID: \"81602ec2-6161-4799-a83c-d8b926799fe2\") " pod="openshift-image-registry/node-ca-8929c"
Jul 16 11:51:13.917872 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917661    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlkjp\" (UniqueName: \"kubernetes.io/projected/1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb-kube-api-access-hlkjp\") pod \"iptables-alerter-vvphn\" (UID: \"1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb\") " pod="openshift-network-operator/iptables-alerter-vvphn"
Jul 16 11:51:13.917872 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917689    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a9dd4544-99c9-4565-8f45-b124541bb29e-multus-daemon-config\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.917872 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-cni-netd\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.917872 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917754    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-os-release\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.917872 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917780    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9dd4544-99c9-4565-8f45-b124541bb29e-cni-binary-copy\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.917872 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:13.917804    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:51:13.917872 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917813    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-cni-netd\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.917872 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917804    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret\") pod \"global-pull-secret-syncer-fdd9b\" (UID: \"554acfac-aace-48e2-a6e4-54b9a794d6ee\") " pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:13.917872 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:13.917857    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:51:13.917872 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:13.917874    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs podName:e86ac627-b483-498d-bd18-e4ff68efe17e nodeName:}" failed. No retries permitted until 2026-07-16 11:51:14.417850204 +0000 UTC m=+3.052644272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs") pod "network-metrics-daemon-7hnqd" (UID: "e86ac627-b483-498d-bd18-e4ff68efe17e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:51:13.918579 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917915    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-var-lib-cni-multus\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.918579 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917953    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-node-log\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.918579 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917983    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b471a05-b0ca-44b6-ae9b-2f2c73863615-ovn-node-metrics-cert\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.918579 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:13.917988    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret podName:554acfac-aace-48e2-a6e4-54b9a794d6ee nodeName:}" failed. No retries permitted until 2026-07-16 11:51:14.41797514 +0000 UTC m=+3.052769216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret") pod "global-pull-secret-syncer-fdd9b" (UID: "554acfac-aace-48e2-a6e4-54b9a794d6ee") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:51:13.918579 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918014    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b471a05-b0ca-44b6-ae9b-2f2c73863615-ovnkube-script-lib\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.918579 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918028    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-kubelet\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.918579 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.917778    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81602ec2-6161-4799-a83c-d8b926799fe2-host\") pod \"node-ca-8929c\" (UID: \"81602ec2-6161-4799-a83c-d8b926799fe2\") " pod="openshift-image-registry/node-ca-8929c"
Jul 16 11:51:13.918579 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56td2\" (UniqueName: \"kubernetes.io/projected/e86ac627-b483-498d-bd18-e4ff68efe17e-kube-api-access-56td2\") pod \"network-metrics-daemon-7hnqd\" (UID: \"e86ac627-b483-498d-bd18-e4ff68efe17e\") " pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:13.918579 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918286    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-cni-bin\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.918579 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918339    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-cni-bin\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.918579 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918339    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-os-release\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.918579 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918382    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-node-log\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.918579 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918401    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-var-lib-cni-multus\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.918579 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918434    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b471a05-b0ca-44b6-ae9b-2f2c73863615-env-overrides\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.918579 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918466    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81602ec2-6161-4799-a83c-d8b926799fe2-serviceca\") pod \"node-ca-8929c\" (UID: \"81602ec2-6161-4799-a83c-d8b926799fe2\") " pod="openshift-image-registry/node-ca-8929c"
Jul 16 11:51:13.918579 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918486    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a9dd4544-99c9-4565-8f45-b124541bb29e-multus-daemon-config\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.918579 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918495    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb-iptables-alerter-script\") pod \"iptables-alerter-vvphn\" (UID: \"1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb\") " pod="openshift-network-operator/iptables-alerter-vvphn"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918555    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-cnibin\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-multus-socket-dir-parent\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918610    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-run-k8s-cni-cncf-io\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918635    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb-host-slash\") pod \"iptables-alerter-vvphn\" (UID: \"1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb\") " pod="openshift-network-operator/iptables-alerter-vvphn"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918661    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-multus-conf-dir\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-systemd-units\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5x45\" (UniqueName: \"kubernetes.io/projected/a9dd4544-99c9-4565-8f45-b124541bb29e-kube-api-access-b5x45\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918718    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-run-systemd\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918734    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-etc-openvswitch\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918748    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-hostroot\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918762    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-run-openvswitch\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b471a05-b0ca-44b6-ae9b-2f2c73863615-ovnkube-config\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918804    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/554acfac-aace-48e2-a6e4-54b9a794d6ee-dbus\") pod \"global-pull-secret-syncer-fdd9b\" (UID: \"554acfac-aace-48e2-a6e4-54b9a794d6ee\") " pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918822    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-multus-cni-dir\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918845    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67qt2\" (UniqueName: \"kubernetes.io/projected/1b471a05-b0ca-44b6-ae9b-2f2c73863615-kube-api-access-67qt2\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-run-netns\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918879    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-run-multus-certs\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.919510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918895    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918905    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1b471a05-b0ca-44b6-ae9b-2f2c73863615-env-overrides\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918929    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1b471a05-b0ca-44b6-ae9b-2f2c73863615-ovnkube-script-lib\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918953    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-cnibin\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918913    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e38731d-db50-48f8-bf39-caac0473dcc6-hosts-file\") pod \"node-resolver-bp2rl\" (UID: \"8e38731d-db50-48f8-bf39-caac0473dcc6\") " pod="openshift-dns/node-resolver-bp2rl"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918973    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e38731d-db50-48f8-bf39-caac0473dcc6-hosts-file\") pod \"node-resolver-bp2rl\" (UID: \"8e38731d-db50-48f8-bf39-caac0473dcc6\") " pod="openshift-dns/node-resolver-bp2rl"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918981    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e38731d-db50-48f8-bf39-caac0473dcc6-tmp-dir\") pod \"node-resolver-bp2rl\" (UID: \"8e38731d-db50-48f8-bf39-caac0473dcc6\") " pod="openshift-dns/node-resolver-bp2rl"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918986    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81602ec2-6161-4799-a83c-d8b926799fe2-serviceca\") pod \"node-ca-8929c\" (UID: \"81602ec2-6161-4799-a83c-d8b926799fe2\") " pod="openshift-image-registry/node-ca-8929c"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918993    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-hostroot\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.918999    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/554acfac-aace-48e2-a6e4-54b9a794d6ee-kubelet-config\") pod \"global-pull-secret-syncer-fdd9b\" (UID: \"554acfac-aace-48e2-a6e4-54b9a794d6ee\") " pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-system-cni-dir\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919040    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-run-k8s-cni-cncf-io\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919053    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-var-lib-kubelet\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb-host-slash\") pod \"iptables-alerter-vvphn\" (UID: \"1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb\") " pod="openshift-network-operator/iptables-alerter-vvphn"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919088    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb-iptables-alerter-script\") pod \"iptables-alerter-vvphn\" (UID: \"1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb\") " pod="openshift-network-operator/iptables-alerter-vvphn"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919108    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-systemd-units\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919120    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-run-systemd\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919122    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-multus-cni-dir\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.920423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919147    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-run-openvswitch\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919164    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-etc-openvswitch\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919188    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919205    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-multus-socket-dir-parent\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919214    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-etc-kubernetes\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919238    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-multus-conf-dir\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919238    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/554acfac-aace-48e2-a6e4-54b9a794d6ee-dbus\") pod \"global-pull-secret-syncer-fdd9b\" (UID: \"554acfac-aace-48e2-a6e4-54b9a794d6ee\") " pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919246    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-run-netns\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919271    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-run-ovn\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919294    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/554acfac-aace-48e2-a6e4-54b9a794d6ee-kubelet-config\") pod \"global-pull-secret-syncer-fdd9b\" (UID: \"554acfac-aace-48e2-a6e4-54b9a794d6ee\") " pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919312    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-run-multus-certs\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919331    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-var-lib-kubelet\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919346    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-host-run-netns\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919375    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-etc-kubernetes\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919393    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-slash\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919441    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-run-netns\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919377    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9dd4544-99c9-4565-8f45-b124541bb29e-system-cni-dir\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919480    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-host-slash\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.921038 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919489    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-run-ovn\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.921672 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919439    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-var-lib-openvswitch\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.921672 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919480    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-var-lib-openvswitch\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.921672 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-log-socket\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.921672 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919514    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e38731d-db50-48f8-bf39-caac0473dcc6-tmp-dir\") pod \"node-resolver-bp2rl\" (UID: \"8e38731d-db50-48f8-bf39-caac0473dcc6\") " pod="openshift-dns/node-resolver-bp2rl"
Jul 16 11:51:13.921672 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919583    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1b471a05-b0ca-44b6-ae9b-2f2c73863615-log-socket\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.921672 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919603    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1b471a05-b0ca-44b6-ae9b-2f2c73863615-ovnkube-config\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.921672 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.919842    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9dd4544-99c9-4565-8f45-b124541bb29e-cni-binary-copy\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:13.921940 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.921912    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b471a05-b0ca-44b6-ae9b-2f2c73863615-ovn-node-metrics-cert\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.929682 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:13.929619    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:51:13.929682 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:13.929653    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:51:13.929682 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:13.929664    2564 projected.go:196] Error preparing data for projected volume kube-api-access-48cx9 for pod openshift-network-diagnostics/network-check-target-rpr92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:51:13.929911 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:13.929731    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9 podName:a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:14.429716673 +0000 UTC m=+3.064510727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-48cx9" (UniqueName: "kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9") pod "network-check-target-rpr92" (UID: "a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:51:13.933322 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.932978    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxtg6\" (UniqueName: \"kubernetes.io/projected/8e38731d-db50-48f8-bf39-caac0473dcc6-kube-api-access-fxtg6\") pod \"node-resolver-bp2rl\" (UID: \"8e38731d-db50-48f8-bf39-caac0473dcc6\") " pod="openshift-dns/node-resolver-bp2rl"
Jul 16 11:51:13.933322 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.933273    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56td2\" (UniqueName: \"kubernetes.io/projected/e86ac627-b483-498d-bd18-e4ff68efe17e-kube-api-access-56td2\") pod \"network-metrics-daemon-7hnqd\" (UID: \"e86ac627-b483-498d-bd18-e4ff68efe17e\") " pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:13.933960 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.933941    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bggn\" (UniqueName: \"kubernetes.io/projected/81602ec2-6161-4799-a83c-d8b926799fe2-kube-api-access-5bggn\") pod \"node-ca-8929c\" (UID: \"81602ec2-6161-4799-a83c-d8b926799fe2\") " pod="openshift-image-registry/node-ca-8929c"
Jul 16 11:51:13.934528 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.934478    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlkjp\" (UniqueName: \"kubernetes.io/projected/1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb-kube-api-access-hlkjp\") pod \"iptables-alerter-vvphn\" (UID: \"1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb\") " pod="openshift-network-operator/iptables-alerter-vvphn"
Jul 16 11:51:13.935474 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.935396    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67qt2\" (UniqueName: \"kubernetes.io/projected/1b471a05-b0ca-44b6-ae9b-2f2c73863615-kube-api-access-67qt2\") pod \"ovnkube-node-cd6t8\" (UID: \"1b471a05-b0ca-44b6-ae9b-2f2c73863615\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:13.936436 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:13.936393    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5x45\" (UniqueName: \"kubernetes.io/projected/a9dd4544-99c9-4565-8f45-b124541bb29e-kube-api-access-b5x45\") pod \"multus-7vtc7\" (UID: \"a9dd4544-99c9-4565-8f45-b124541bb29e\") " pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:14.008781 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:14.008739    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-74ll5"
Jul 16 11:51:14.018133 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:14.018102    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t"
Jul 16 11:51:14.027194 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:14.027163    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cwlcj"
Jul 16 11:51:14.032392 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:14.032355    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qj68c"
Jul 16 11:51:14.040415 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:14.040389    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8929c"
Jul 16 11:51:14.048287 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:14.048266    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7vtc7"
Jul 16 11:51:14.056275 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:14.056255    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:14.064110 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:14.064092    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bp2rl"
Jul 16 11:51:14.072971 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:14.072950    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vvphn"
Jul 16 11:51:14.160861 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:14.160832    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 11:51:14.423414 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:14.423368    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret\") pod \"global-pull-secret-syncer-fdd9b\" (UID: \"554acfac-aace-48e2-a6e4-54b9a794d6ee\") " pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:14.423616 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:14.423469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs\") pod \"network-metrics-daemon-7hnqd\" (UID: \"e86ac627-b483-498d-bd18-e4ff68efe17e\") " pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:14.423616 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:14.423503    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:51:14.423616 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:14.423578    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret podName:554acfac-aace-48e2-a6e4-54b9a794d6ee nodeName:}" failed. No retries permitted until 2026-07-16 11:51:15.423557858 +0000 UTC m=+4.058351910 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret") pod "global-pull-secret-syncer-fdd9b" (UID: "554acfac-aace-48e2-a6e4-54b9a794d6ee") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:51:14.423616 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:14.423577    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:51:14.423830 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:14.423627    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs podName:e86ac627-b483-498d-bd18-e4ff68efe17e nodeName:}" failed. No retries permitted until 2026-07-16 11:51:15.423614357 +0000 UTC m=+4.058408428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs") pod "network-metrics-daemon-7hnqd" (UID: "e86ac627-b483-498d-bd18-e4ff68efe17e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:51:14.524302 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:14.524206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48cx9\" (UniqueName: \"kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9\") pod \"network-check-target-rpr92\" (UID: \"a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245\") " pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:14.524481 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:14.524408    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:51:14.524481 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:14.524431    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:51:14.524481 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:14.524442    2564 projected.go:196] Error preparing data for projected volume kube-api-access-48cx9 for pod openshift-network-diagnostics/network-check-target-rpr92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:51:14.524655 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:14.524508    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9 podName:a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:15.524492626 +0000 UTC m=+4.159286677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-48cx9" (UniqueName: "kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9") pod "network-check-target-rpr92" (UID: "a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:51:14.746979 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:14.746906    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 11:46:14 +0000 UTC" deadline="2028-01-10 14:15:11.611138872 +0000 UTC"
Jul 16 11:51:14.746979 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:14.746971    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13034h23m56.864173279s"
Jul 16 11:51:14.849149 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:14.849125    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:14.849268 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:14.849231    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:14.865253 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:14.865228    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf01f887f_219a_4248_a266_511c7fa0eea4.slice/crio-33813e8c0cc79c7e44de5922d2806c69ddd5463531f2699f97a3c4e56c3d3ea5 WatchSource:0}: Error finding container 33813e8c0cc79c7e44de5922d2806c69ddd5463531f2699f97a3c4e56c3d3ea5: Status 404 returned error can't find the container with id 33813e8c0cc79c7e44de5922d2806c69ddd5463531f2699f97a3c4e56c3d3ea5
Jul 16 11:51:14.866651 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:14.866624    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b471a05_b0ca_44b6_ae9b_2f2c73863615.slice/crio-7accde7f52803d23066fe9c7f612918c7bcf3b213a3218af41b0dffbf6684be5 WatchSource:0}: Error finding container 7accde7f52803d23066fe9c7f612918c7bcf3b213a3218af41b0dffbf6684be5: Status 404 returned error can't find the container with id 7accde7f52803d23066fe9c7f612918c7bcf3b213a3218af41b0dffbf6684be5
Jul 16 11:51:14.876823 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:14.876794    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69851010_8a64_40df_b2fa_a65d69a78155.slice/crio-66660a6abf5b3c45eb653a6b86f3c2f4d8aab4e4b505355f4a29e9feee38e7b4 WatchSource:0}: Error finding container 66660a6abf5b3c45eb653a6b86f3c2f4d8aab4e4b505355f4a29e9feee38e7b4: Status 404 returned error can't find the container with id 66660a6abf5b3c45eb653a6b86f3c2f4d8aab4e4b505355f4a29e9feee38e7b4
Jul 16 11:51:14.878016 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:14.877990    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81602ec2_6161_4799_a83c_d8b926799fe2.slice/crio-fdd1d1ee4219e04469642223eb76d12fbca0858d644d216a29b3e0175753c380 WatchSource:0}: Error finding container fdd1d1ee4219e04469642223eb76d12fbca0858d644d216a29b3e0175753c380: Status 404 returned error can't find the container with id fdd1d1ee4219e04469642223eb76d12fbca0858d644d216a29b3e0175753c380
Jul 16 11:51:14.879456 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:14.879405    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9dd4544_99c9_4565_8f45_b124541bb29e.slice/crio-1d84f9ac9787ccd0b16d2bf8cbd9888ea45835305b507b5334ba348299bbbc69 WatchSource:0}: Error finding container 1d84f9ac9787ccd0b16d2bf8cbd9888ea45835305b507b5334ba348299bbbc69: Status 404 returned error can't find the container with id 1d84f9ac9787ccd0b16d2bf8cbd9888ea45835305b507b5334ba348299bbbc69
Jul 16 11:51:14.880950 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:14.880923    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec0d5a60_7817_4c3d_8797_975321a3a094.slice/crio-577c7b5331b1e8d8050c8b2726b101e239f6cd7fe7a3c9ba8bdf84bbb588ddbe WatchSource:0}: Error finding container 577c7b5331b1e8d8050c8b2726b101e239f6cd7fe7a3c9ba8bdf84bbb588ddbe: Status 404 returned error can't find the container with id 577c7b5331b1e8d8050c8b2726b101e239f6cd7fe7a3c9ba8bdf84bbb588ddbe
Jul 16 11:51:15.435230 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:15.435143    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs\") pod \"network-metrics-daemon-7hnqd\" (UID: \"e86ac627-b483-498d-bd18-e4ff68efe17e\") " pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:15.435230 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:15.435205    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret\") pod \"global-pull-secret-syncer-fdd9b\" (UID: \"554acfac-aace-48e2-a6e4-54b9a794d6ee\") " pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:15.435464 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:15.435356    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:51:15.435533 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:15.435465    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret podName:554acfac-aace-48e2-a6e4-54b9a794d6ee nodeName:}" failed. No retries permitted until 2026-07-16 11:51:17.435436165 +0000 UTC m=+6.070230221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret") pod "global-pull-secret-syncer-fdd9b" (UID: "554acfac-aace-48e2-a6e4-54b9a794d6ee") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:51:15.435533 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:15.435508    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:51:15.435649 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:15.435578    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs podName:e86ac627-b483-498d-bd18-e4ff68efe17e nodeName:}" failed. No retries permitted until 2026-07-16 11:51:17.43555765 +0000 UTC m=+6.070351717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs") pod "network-metrics-daemon-7hnqd" (UID: "e86ac627-b483-498d-bd18-e4ff68efe17e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:51:15.535817 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:15.535779    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48cx9\" (UniqueName: \"kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9\") pod \"network-check-target-rpr92\" (UID: \"a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245\") " pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:15.536035 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:15.535960    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:51:15.536035 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:15.535984    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:51:15.536035 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:15.535997    2564 projected.go:196] Error preparing data for projected volume kube-api-access-48cx9 for pod openshift-network-diagnostics/network-check-target-rpr92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:51:15.536216 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:15.536052    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9 podName:a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:17.536032515 +0000 UTC m=+6.170826566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-48cx9" (UniqueName: "kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9") pod "network-check-target-rpr92" (UID: "a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:51:15.748077 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:15.747940    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 11:46:14 +0000 UTC" deadline="2028-02-02 07:01:29.458259007 +0000 UTC"
Jul 16 11:51:15.748077 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:15.748006    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13579h10m13.710257315s"
Jul 16 11:51:15.852043 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:15.852010    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:15.852273 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:15.852204    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:15.852705 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:15.852681    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:15.852821 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:15.852801    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:15.904989 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:15.904808    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8929c" event={"ID":"81602ec2-6161-4799-a83c-d8b926799fe2","Type":"ContainerStarted","Data":"fdd1d1ee4219e04469642223eb76d12fbca0858d644d216a29b3e0175753c380"}
Jul 16 11:51:15.907951 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:15.907861    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74ll5" event={"ID":"69851010-8a64-40df-b2fa-a65d69a78155","Type":"ContainerStarted","Data":"66660a6abf5b3c45eb653a6b86f3c2f4d8aab4e4b505355f4a29e9feee38e7b4"}
Jul 16 11:51:15.919868 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:15.919808    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bp2rl" event={"ID":"8e38731d-db50-48f8-bf39-caac0473dcc6","Type":"ContainerStarted","Data":"900635faa7f355af503f68b50e19e4a2cedaa1fe57c7ec18bf538a0d59611c26"}
Jul 16 11:51:15.936351 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:15.936285    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8" event={"ID":"1b471a05-b0ca-44b6-ae9b-2f2c73863615","Type":"ContainerStarted","Data":"7accde7f52803d23066fe9c7f612918c7bcf3b213a3218af41b0dffbf6684be5"}
Jul 16 11:51:15.951732 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:15.951695    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal" event={"ID":"69bb1843a08e184331a0a7517508501b","Type":"ContainerStarted","Data":"a5c092d039e06b6565599878d1bf8e38bb1eb12c718e8b88e76eb4f7261a54e7"}
Jul 16 11:51:15.969993 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:15.969936    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vvphn" event={"ID":"1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb","Type":"ContainerStarted","Data":"739ae208413e59c8d380d3bf891ab420a90228e133d63518a1f1bc3684ad8d8f"}
Jul 16 11:51:15.986204 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:15.986170    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7vtc7" event={"ID":"a9dd4544-99c9-4565-8f45-b124541bb29e","Type":"ContainerStarted","Data":"1d84f9ac9787ccd0b16d2bf8cbd9888ea45835305b507b5334ba348299bbbc69"}
Jul 16 11:51:16.001228 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:16.001148    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cwlcj" event={"ID":"829adca8-53a6-4b65-a115-f08309589329","Type":"ContainerStarted","Data":"9d5de2023e9dd2d25e2b637d600a5daf753324bf8a0cf603c599cfe18708ebae"}
Jul 16 11:51:16.007929 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:16.007897    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qj68c" event={"ID":"f01f887f-219a-4248-a266-511c7fa0eea4","Type":"ContainerStarted","Data":"33813e8c0cc79c7e44de5922d2806c69ddd5463531f2699f97a3c4e56c3d3ea5"}
Jul 16 11:51:16.019257 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:16.019225    2564 generic.go:356] "Generic (PLEG): container finished" podID="d45dbf681ab5874d9b9ab53dc02f0af6" containerID="8787bc48208190f9415a253b95c3ba5035198545044ec869097dd4813d99dda0" exitCode=0
Jul 16 11:51:16.019380 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:16.019330    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal" event={"ID":"d45dbf681ab5874d9b9ab53dc02f0af6","Type":"ContainerDied","Data":"8787bc48208190f9415a253b95c3ba5035198545044ec869097dd4813d99dda0"}
Jul 16 11:51:16.036883 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:16.036826    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-78.ec2.internal" podStartSLOduration=3.036808835 podStartE2EDuration="3.036808835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:51:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:15.969470796 +0000 UTC m=+4.604264880" watchObservedRunningTime="2026-07-16 11:51:16.036808835 +0000 UTC m=+4.671602941"
Jul 16 11:51:16.050653 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:16.050625    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t" event={"ID":"ec0d5a60-7817-4c3d-8797-975321a3a094","Type":"ContainerStarted","Data":"577c7b5331b1e8d8050c8b2726b101e239f6cd7fe7a3c9ba8bdf84bbb588ddbe"}
Jul 16 11:51:16.851673 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:16.851636    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:16.852166 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:16.851822    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:17.083090 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:17.083051    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal" event={"ID":"d45dbf681ab5874d9b9ab53dc02f0af6","Type":"ContainerStarted","Data":"22f38510798b73345c4c60b20860ffe3bf629870ef71fa502de0af83847c81a3"}
Jul 16 11:51:17.101239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:17.101134    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-78.ec2.internal" podStartSLOduration=4.101112176 podStartE2EDuration="4.101112176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:51:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:17.100386662 +0000 UTC m=+5.735180744" watchObservedRunningTime="2026-07-16 11:51:17.101112176 +0000 UTC m=+5.735906255"
Jul 16 11:51:17.458855 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:17.458046    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs\") pod \"network-metrics-daemon-7hnqd\" (UID: \"e86ac627-b483-498d-bd18-e4ff68efe17e\") " pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:17.458855 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:17.458104    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret\") pod \"global-pull-secret-syncer-fdd9b\" (UID: \"554acfac-aace-48e2-a6e4-54b9a794d6ee\") " pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:17.458855 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:17.458252    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:51:17.458855 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:17.458318    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret podName:554acfac-aace-48e2-a6e4-54b9a794d6ee nodeName:}" failed. No retries permitted until 2026-07-16 11:51:21.458298762 +0000 UTC m=+10.093092816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret") pod "global-pull-secret-syncer-fdd9b" (UID: "554acfac-aace-48e2-a6e4-54b9a794d6ee") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:51:17.458855 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:17.458758    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:51:17.458855 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:17.458816    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs podName:e86ac627-b483-498d-bd18-e4ff68efe17e nodeName:}" failed. No retries permitted until 2026-07-16 11:51:21.458795779 +0000 UTC m=+10.093589847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs") pod "network-metrics-daemon-7hnqd" (UID: "e86ac627-b483-498d-bd18-e4ff68efe17e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:51:17.559890 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:17.559163    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48cx9\" (UniqueName: \"kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9\") pod \"network-check-target-rpr92\" (UID: \"a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245\") " pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:17.559890 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:17.559391    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:51:17.559890 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:17.559422    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:51:17.559890 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:17.559437    2564 projected.go:196] Error preparing data for projected volume kube-api-access-48cx9 for pod openshift-network-diagnostics/network-check-target-rpr92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:51:17.559890 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:17.559504    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9 podName:a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:21.559482781 +0000 UTC m=+10.194276851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-48cx9" (UniqueName: "kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9") pod "network-check-target-rpr92" (UID: "a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:51:17.852014 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:17.851930    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:17.852532 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:17.852096    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:17.852616 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:17.852544    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:17.852673 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:17.852640    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:18.848625 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:18.848574    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:18.848813 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:18.848737    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:19.852201 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:19.851664    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:19.852201 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:19.851712    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:19.852201 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:19.851825    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:19.852201 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:19.852140    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:20.849391 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:20.849352    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:20.849681 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:20.849506    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:21.491686 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:21.491637    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs\") pod \"network-metrics-daemon-7hnqd\" (UID: \"e86ac627-b483-498d-bd18-e4ff68efe17e\") " pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:21.492155 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:21.491714    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret\") pod \"global-pull-secret-syncer-fdd9b\" (UID: \"554acfac-aace-48e2-a6e4-54b9a794d6ee\") " pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:21.492155 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:21.491881    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:51:21.492155 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:21.491952    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret podName:554acfac-aace-48e2-a6e4-54b9a794d6ee nodeName:}" failed. No retries permitted until 2026-07-16 11:51:29.491931348 +0000 UTC m=+18.126725400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret") pod "global-pull-secret-syncer-fdd9b" (UID: "554acfac-aace-48e2-a6e4-54b9a794d6ee") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:51:21.492339 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:21.492285    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:51:21.492339 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:21.492323    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs podName:e86ac627-b483-498d-bd18-e4ff68efe17e nodeName:}" failed. No retries permitted until 2026-07-16 11:51:29.49231152 +0000 UTC m=+18.127105573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs") pod "network-metrics-daemon-7hnqd" (UID: "e86ac627-b483-498d-bd18-e4ff68efe17e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:51:21.592636 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:21.592585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48cx9\" (UniqueName: \"kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9\") pod \"network-check-target-rpr92\" (UID: \"a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245\") " pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:21.592843 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:21.592824    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:51:21.592901 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:21.592855    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:51:21.592901 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:21.592870    2564 projected.go:196] Error preparing data for projected volume kube-api-access-48cx9 for pod openshift-network-diagnostics/network-check-target-rpr92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:51:21.592971 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:21.592937    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9 podName:a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:29.592915352 +0000 UTC m=+18.227709405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-48cx9" (UniqueName: "kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9") pod "network-check-target-rpr92" (UID: "a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:51:21.851552 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:21.849556    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:21.851552 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:21.849693    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:21.851552 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:21.850126    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:21.851552 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:21.850234    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:22.848718 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:22.848683    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:22.849230 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:22.848817    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:23.851338 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:23.851284    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:23.851747 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:23.851448    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:23.851878 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:23.851858    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:23.852043 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:23.851974    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:24.849400 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:24.849364    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:24.849583 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:24.849498    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:25.849454 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:25.849411    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:25.849922 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:25.849557    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:25.849922 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:25.849415    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:25.849922 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:25.849851    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:26.849339 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:26.849290    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:26.849536 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:26.849430    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:27.848739 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:27.848698    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:27.848739 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:27.848744    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:27.848981 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:27.848851    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:27.849249 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:27.849227    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:28.848973 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:28.848941    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:28.849437 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:28.849058    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:29.557604 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:29.557565    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs\") pod \"network-metrics-daemon-7hnqd\" (UID: \"e86ac627-b483-498d-bd18-e4ff68efe17e\") " pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:29.557802 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:29.557619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret\") pod \"global-pull-secret-syncer-fdd9b\" (UID: \"554acfac-aace-48e2-a6e4-54b9a794d6ee\") " pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:29.557802 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:29.557716    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:51:29.557802 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:29.557717    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:51:29.557802 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:29.557769    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret podName:554acfac-aace-48e2-a6e4-54b9a794d6ee nodeName:}" failed. No retries permitted until 2026-07-16 11:51:45.557752612 +0000 UTC m=+34.192546669 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret") pod "global-pull-secret-syncer-fdd9b" (UID: "554acfac-aace-48e2-a6e4-54b9a794d6ee") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:51:29.557802 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:29.557783    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs podName:e86ac627-b483-498d-bd18-e4ff68efe17e nodeName:}" failed. No retries permitted until 2026-07-16 11:51:45.557776681 +0000 UTC m=+34.192570733 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs") pod "network-metrics-daemon-7hnqd" (UID: "e86ac627-b483-498d-bd18-e4ff68efe17e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:51:29.658303 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:29.658265    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48cx9\" (UniqueName: \"kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9\") pod \"network-check-target-rpr92\" (UID: \"a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245\") " pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:29.658499 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:29.658443    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:51:29.658499 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:29.658468    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:51:29.658499 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:29.658479    2564 projected.go:196] Error preparing data for projected volume kube-api-access-48cx9 for pod openshift-network-diagnostics/network-check-target-rpr92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:51:29.658655 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:29.658533    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9 podName:a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:45.658515272 +0000 UTC m=+34.293309338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-48cx9" (UniqueName: "kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9") pod "network-check-target-rpr92" (UID: "a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:51:29.848843 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:29.848760    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:29.849010 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:29.848901    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:29.849373 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:29.848763    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:29.849373 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:29.849352    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:30.848552 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:30.848507    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:30.848738 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:30.848650    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:31.849829 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:31.849785    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:31.850362 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:31.849893    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:31.850362 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:31.850272    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:31.850489 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:31.850394    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:32.849152 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:32.849106    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:32.849371 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:32.849260    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:33.849199 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:33.849164    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:33.849797 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:33.849164    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:33.849797 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:33.849296    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:33.849797 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:33.849399    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:34.848766 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:34.848265    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:34.848766 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:34.848403    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:35.123319 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:35.123079    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qj68c" event={"ID":"f01f887f-219a-4248-a266-511c7fa0eea4","Type":"ContainerStarted","Data":"acee8c5d63a1c4d485b782db0a5b58c7bb177f694d3263165f217dcb41f1d996"}
Jul 16 11:51:35.124640 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:35.124617    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t" event={"ID":"ec0d5a60-7817-4c3d-8797-975321a3a094","Type":"ContainerStarted","Data":"debd90c3d44422a2ba420fd1e1b09b24d3b59ca1fa8ac7e794960dc9e0d10b52"}
Jul 16 11:51:35.125958 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:35.125929    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8929c" event={"ID":"81602ec2-6161-4799-a83c-d8b926799fe2","Type":"ContainerStarted","Data":"de7eb5bf8fe024205c0ecde9991a9b486301ebe551a7c15fca0f6effb5210c3a"}
Jul 16 11:51:35.127314 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:35.127285    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74ll5" event={"ID":"69851010-8a64-40df-b2fa-a65d69a78155","Type":"ContainerStarted","Data":"f484458bdc48df618f2656c2445b25806b4b625991a3e8e2d2c8420538d7f3f7"}
Jul 16 11:51:35.128794 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:35.128771    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bp2rl" event={"ID":"8e38731d-db50-48f8-bf39-caac0473dcc6","Type":"ContainerStarted","Data":"ea2038aa00d5d7b9abc01bf62c0b8a4ca75eb7bb2914f8635edb1771f1d78682"}
Jul 16 11:51:35.132697 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:35.132673    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8" event={"ID":"1b471a05-b0ca-44b6-ae9b-2f2c73863615","Type":"ContainerStarted","Data":"ec4c646341f025dcdade972b8e51c8e7a8b8487cfe7f2c2ec77ff9b977b0642e"}
Jul 16 11:51:35.132783 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:35.132748    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8" event={"ID":"1b471a05-b0ca-44b6-ae9b-2f2c73863615","Type":"ContainerStarted","Data":"0b4eaeb37dd1bf40998cb15b755dee37fae77efce5785c8e4b6f55462fb45cf9"}
Jul 16 11:51:35.134518 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:35.134495    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7vtc7" event={"ID":"a9dd4544-99c9-4565-8f45-b124541bb29e","Type":"ContainerStarted","Data":"9ad4f807a5daf63fa2ef656d896d1979e1351c081973284722e4114e7a1b0ca4"}
Jul 16 11:51:35.135755 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:35.135739    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cwlcj" event={"ID":"829adca8-53a6-4b65-a115-f08309589329","Type":"ContainerStarted","Data":"2824beb851419a9b1b088cd311af7dd22eca0309a6fa5ab5a54fe9ac80845a36"}
Jul 16 11:51:35.140046 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:35.139850    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qj68c" podStartSLOduration=3.547460552 podStartE2EDuration="23.139833733s" totalImagesPullingTime="19.592373181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:35.139165754 +0000 UTC m=+23.773959825" watchObservedRunningTime="2026-07-16 11:51:35.139833733 +0000 UTC m=+23.774627805"
Jul 16 11:51:35.154101 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:35.154069    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bp2rl" podStartSLOduration=2.480199926 podStartE2EDuration="22.154056704s" totalImagesPullingTime="19.673856778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:35.153937509 +0000 UTC m=+23.788731577" watchObservedRunningTime="2026-07-16 11:51:35.154056704 +0000 UTC m=+23.788850774"
Jul 16 11:51:35.168267 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:35.168224    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8929c" podStartSLOduration=3.503809209 podStartE2EDuration="23.168210853s" totalImagesPullingTime="19.664401644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:35.167933914 +0000 UTC m=+23.802727985" watchObservedRunningTime="2026-07-16 11:51:35.168210853 +0000 UTC m=+23.803004923"
Jul 16 11:51:35.212350 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:35.212277    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cwlcj" podStartSLOduration=3.566242285 podStartE2EDuration="23.21225629s" totalImagesPullingTime="19.646014005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:35.212178223 +0000 UTC m=+23.846972298" watchObservedRunningTime="2026-07-16 11:51:35.21225629 +0000 UTC m=+23.847050362"
Jul 16 11:51:35.229783 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:35.229727    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7vtc7" podStartSLOduration=3.331214392 podStartE2EDuration="23.229705899s" totalImagesPullingTime="19.898491507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:35.229085175 +0000 UTC m=+23.863879257" watchObservedRunningTime="2026-07-16 11:51:35.229705899 +0000 UTC m=+23.864499971"
Jul 16 11:51:35.849606 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:35.849362    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:35.849785 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:35.849404    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:35.849785 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:35.849710    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:35.849898 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:35.849811    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:36.049001 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:36.048974    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 11:51:36.139523 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:36.139486    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t" event={"ID":"ec0d5a60-7817-4c3d-8797-975321a3a094","Type":"ContainerStarted","Data":"0c06f411dd79768e28cb31cacd5c8efcfb4472a273377aa00c15f3bc81bd1ebf"}
Jul 16 11:51:36.141004 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:36.140977    2564 generic.go:356] "Generic (PLEG): container finished" podID="69851010-8a64-40df-b2fa-a65d69a78155" containerID="f484458bdc48df618f2656c2445b25806b4b625991a3e8e2d2c8420538d7f3f7" exitCode=0
Jul 16 11:51:36.141130 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:36.141048    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74ll5" event={"ID":"69851010-8a64-40df-b2fa-a65d69a78155","Type":"ContainerDied","Data":"f484458bdc48df618f2656c2445b25806b4b625991a3e8e2d2c8420538d7f3f7"}
Jul 16 11:51:36.144014 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:36.143941    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 11:51:36.144343 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:36.144304    2564 generic.go:356] "Generic (PLEG): container finished" podID="1b471a05-b0ca-44b6-ae9b-2f2c73863615" containerID="ec4c646341f025dcdade972b8e51c8e7a8b8487cfe7f2c2ec77ff9b977b0642e" exitCode=1
Jul 16 11:51:36.144415 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:36.144360    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8" event={"ID":"1b471a05-b0ca-44b6-ae9b-2f2c73863615","Type":"ContainerDied","Data":"ec4c646341f025dcdade972b8e51c8e7a8b8487cfe7f2c2ec77ff9b977b0642e"}
Jul 16 11:51:36.144468 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:36.144431    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8" event={"ID":"1b471a05-b0ca-44b6-ae9b-2f2c73863615","Type":"ContainerStarted","Data":"2bb4578a52ca3738dafd7b3eb7e41cbf6f1277c4b173fdef233b85011a446b8b"}
Jul 16 11:51:36.144510 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:36.144478    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8" event={"ID":"1b471a05-b0ca-44b6-ae9b-2f2c73863615","Type":"ContainerStarted","Data":"18cb68219d921f891285dd264c1461a446867840950151ebb5b4b11fea09b6e3"}
Jul 16 11:51:36.144545 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:36.144519    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8" event={"ID":"1b471a05-b0ca-44b6-ae9b-2f2c73863615","Type":"ContainerStarted","Data":"c22758a751c6d4cec355fef0b6fadda39505122aded5c3da6b7ad89d1c63cb1b"}
Jul 16 11:51:36.144573 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:36.144555    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8" event={"ID":"1b471a05-b0ca-44b6-ae9b-2f2c73863615","Type":"ContainerStarted","Data":"89d3ea4e92333a75cc0bb3faba98a4557be7d2a29c44ffbbb407239d51fff329"}
Jul 16 11:51:36.145660 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:36.145640    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vvphn" event={"ID":"1a4d55b0-179c-4a9b-9d2e-bc14e0bd37cb","Type":"ContainerStarted","Data":"9dfe73891a6e3d9c3796aebb01d05c25c0ff05bb3d1438292143f580938980e9"}
Jul 16 11:51:36.178922 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:36.178878    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vvphn" podStartSLOduration=3.597329578 podStartE2EDuration="23.17886369s" totalImagesPullingTime="19.581534112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:36.178546092 +0000 UTC m=+24.813340176" watchObservedRunningTime="2026-07-16 11:51:36.17886369 +0000 UTC m=+24.813657761"
Jul 16 11:51:36.768172 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:36.768079    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T11:51:36.048998302Z","UUID":"f8e7a633-1bb0-4ac7-8284-1a4229db0e7a","Handler":null,"Name":"","Endpoint":""}
Jul 16 11:51:36.769868 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:36.769838    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 11:51:36.770000 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:36.769878    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 11:51:36.848831 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:36.848800    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:36.849009 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:36.848920    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:37.151274 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:37.151237    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t" event={"ID":"ec0d5a60-7817-4c3d-8797-975321a3a094","Type":"ContainerStarted","Data":"2a8d9879c276d1c228ecaab564053daab92c900465d9fc5bca2bf34efd4e1499"}
Jul 16 11:51:37.169695 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:37.169639    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5zr8t" podStartSLOduration=3.6458247740000003 podStartE2EDuration="25.169618363s" totalImagesPullingTime="21.523793589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:51:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:37.168999739 +0000 UTC m=+25.803793812" watchObservedRunningTime="2026-07-16 11:51:37.169618363 +0000 UTC m=+25.804412435"
Jul 16 11:51:37.849305 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:37.849100    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:37.849497 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:37.849100    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:37.849497 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:37.849446    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:37.849627 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:37.849599    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:37.994824 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:37.994743    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qj68c"
Jul 16 11:51:37.995420 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:37.995398    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qj68c"
Jul 16 11:51:38.157225 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:38.157201    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 11:51:38.157704 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:38.157658    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8" event={"ID":"1b471a05-b0ca-44b6-ae9b-2f2c73863615","Type":"ContainerStarted","Data":"cf26132377290bb0065bbfb48a1b479c3cd153f772b8660689a93ec4e34871c3"}
Jul 16 11:51:38.158092 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:38.157928    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qj68c"
Jul 16 11:51:38.158426 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:38.158407    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qj68c"
Jul 16 11:51:38.848820 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:38.848787    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:38.849065 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:38.848928    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:39.849909 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:39.849419    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:39.849909 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:39.849432    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:39.849909 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:39.849558    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:39.849909 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:39.849624    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:40.848673 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:40.848432    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:40.848796 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:40.848714    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:41.168032 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:41.168004    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 11:51:41.168721 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:41.168402    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8" event={"ID":"1b471a05-b0ca-44b6-ae9b-2f2c73863615","Type":"ContainerStarted","Data":"be4f574365aebdd723116089df034f178b69d1d0a3a7068da462b6798d221ccb"}
Jul 16 11:51:41.168721 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:41.168648    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:41.168874 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:41.168858    2564 scope.go:117] "RemoveContainer" containerID="ec4c646341f025dcdade972b8e51c8e7a8b8487cfe7f2c2ec77ff9b977b0642e"
Jul 16 11:51:41.170559 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:41.170489    2564 generic.go:356] "Generic (PLEG): container finished" podID="69851010-8a64-40df-b2fa-a65d69a78155" containerID="75d2a38b1747ae822f84664f53924e5e58381fcd6fe06ed48febdc769cec15ab" exitCode=0
Jul 16 11:51:41.170559 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:41.170525    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74ll5" event={"ID":"69851010-8a64-40df-b2fa-a65d69a78155","Type":"ContainerDied","Data":"75d2a38b1747ae822f84664f53924e5e58381fcd6fe06ed48febdc769cec15ab"}
Jul 16 11:51:41.185621 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:41.185601    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:41.849127 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:41.849095    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:41.849290 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:41.849187    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:41.849290 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:41.849199    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:41.849399 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:41.849288    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:42.176707 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:42.176682    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 11:51:42.177124 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:42.177030    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8" event={"ID":"1b471a05-b0ca-44b6-ae9b-2f2c73863615","Type":"ContainerStarted","Data":"780e957c186ec60921537d7513b5d843e5f0cd11d79cf583a3b28273a5839d4a"}
Jul 16 11:51:42.177215 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:42.177199    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:42.177290 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:42.177256    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:42.194187 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:42.194163    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:51:42.206419 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:42.206379    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8" podStartSLOduration=10.220951498 podStartE2EDuration="30.206364821s" totalImagesPullingTime="19.985413323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:42.206298416 +0000 UTC m=+30.841092487" watchObservedRunningTime="2026-07-16 11:51:42.206364821 +0000 UTC m=+30.841158892"
Jul 16 11:51:42.229483 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:42.228410    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rpr92"]
Jul 16 11:51:42.229483 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:42.228573    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:42.229483 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:42.229115    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:42.230926 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:42.230900    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fdd9b"]
Jul 16 11:51:42.231026 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:42.231011    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:42.231121 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:42.231099    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:42.243954 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:42.243929    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7hnqd"]
Jul 16 11:51:42.244059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:42.244046    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:42.244177 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:42.244158    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:43.851892 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:43.851696    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:43.852250 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:43.851740    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:43.852250 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:43.851970    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:43.852250 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:43.851765    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:43.852250 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:43.852036    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:43.852250 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:43.852106    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:44.183430 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:44.183397    2564 generic.go:356] "Generic (PLEG): container finished" podID="69851010-8a64-40df-b2fa-a65d69a78155" containerID="6f93bd761a0466ea5aaed7326acfdf927c532fbb401ed49d9f88d8c9f10614af" exitCode=0
Jul 16 11:51:44.183618 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:44.183479    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74ll5" event={"ID":"69851010-8a64-40df-b2fa-a65d69a78155","Type":"ContainerDied","Data":"6f93bd761a0466ea5aaed7326acfdf927c532fbb401ed49d9f88d8c9f10614af"}
Jul 16 11:51:45.580434 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:45.580392    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs\") pod \"network-metrics-daemon-7hnqd\" (UID: \"e86ac627-b483-498d-bd18-e4ff68efe17e\") " pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:45.581112 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:45.580438    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret\") pod \"global-pull-secret-syncer-fdd9b\" (UID: \"554acfac-aace-48e2-a6e4-54b9a794d6ee\") " pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:45.581112 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:45.580546    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:51:45.581112 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:45.580546    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:51:45.581112 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:45.580609    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret podName:554acfac-aace-48e2-a6e4-54b9a794d6ee nodeName:}" failed. No retries permitted until 2026-07-16 11:52:17.580594623 +0000 UTC m=+66.215388677 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret") pod "global-pull-secret-syncer-fdd9b" (UID: "554acfac-aace-48e2-a6e4-54b9a794d6ee") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:51:45.581112 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:45.580624    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs podName:e86ac627-b483-498d-bd18-e4ff68efe17e nodeName:}" failed. No retries permitted until 2026-07-16 11:52:17.580617296 +0000 UTC m=+66.215411347 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs") pod "network-metrics-daemon-7hnqd" (UID: "e86ac627-b483-498d-bd18-e4ff68efe17e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:51:45.681196 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:45.681161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48cx9\" (UniqueName: \"kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9\") pod \"network-check-target-rpr92\" (UID: \"a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245\") " pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:45.681382 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:45.681362    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:51:45.681450 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:45.681390    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:51:45.681450 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:45.681404    2564 projected.go:196] Error preparing data for projected volume kube-api-access-48cx9 for pod openshift-network-diagnostics/network-check-target-rpr92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:51:45.681553 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:45.681481    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9 podName:a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245 nodeName:}" failed. No retries permitted until 2026-07-16 11:52:17.681453022 +0000 UTC m=+66.316247088 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-48cx9" (UniqueName: "kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9") pod "network-check-target-rpr92" (UID: "a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:51:45.849381 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:45.849275    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:45.849381 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:45.849321    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:45.849381 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:45.849348    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:45.849661 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:45.849454    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7hnqd" podUID="e86ac627-b483-498d-bd18-e4ff68efe17e"
Jul 16 11:51:45.849661 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:45.849503    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rpr92" podUID="a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245"
Jul 16 11:51:45.849661 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:45.849610    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdd9b" podUID="554acfac-aace-48e2-a6e4-54b9a794d6ee"
Jul 16 11:51:47.192093 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.192056    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74ll5" event={"ID":"69851010-8a64-40df-b2fa-a65d69a78155","Type":"ContainerStarted","Data":"5d9d2152b3bebd9f991a618d6ec7ca71db8130beda89db07b3b2a28e1d683654"}
Jul 16 11:51:47.735379 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.735275    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-78.ec2.internal" event="NodeReady"
Jul 16 11:51:47.735554 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.735415    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 11:51:47.791320 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.791281    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2qsjs"]
Jul 16 11:51:47.808044 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.808017    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8cj4r"]
Jul 16 11:51:47.808184 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.808163    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:47.810618 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.810594    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 11:51:47.811145 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.811126    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qlctg\""
Jul 16 11:51:47.811277 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.811204    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 11:51:47.813697 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.813679    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 11:51:47.813805 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.813721    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 11:51:47.828926 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.828890    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8cj4r"]
Jul 16 11:51:47.828926 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.828928    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2qsjs"]
Jul 16 11:51:47.829078 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.829025    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8cj4r"
Jul 16 11:51:47.831956 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.831936    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 11:51:47.831956 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.831953    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 11:51:47.832289 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.832275    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2lz8k\""
Jul 16 11:51:47.832489 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.832469    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 11:51:47.849114 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.849084    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:51:47.849265 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.849085    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:51:47.849265 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.849085    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:51:47.852887 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.852863    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 11:51:47.853076 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.853001    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 11:51:47.853076 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.853066    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 11:51:47.853198 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.853093    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gtptt\""
Jul 16 11:51:47.853338 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.853310    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 11:51:47.853410 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.853315    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vn7fb\""
Jul 16 11:51:47.881861 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.881834    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bfqxq"]
Jul 16 11:51:47.896116 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.896081    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e79115f4-3fb7-422c-8d99-62d65531c257-crio-socket\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:47.896278 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.896122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhw2l\" (UniqueName: \"kubernetes.io/projected/e79115f4-3fb7-422c-8d99-62d65531c257-kube-api-access-hhw2l\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:47.896278 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.896170    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e79115f4-3fb7-422c-8d99-62d65531c257-data-volume\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:47.896278 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.896238    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:47.896416 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.896295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:47.901064 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.901042    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bfqxq"]
Jul 16 11:51:47.901164 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.901135    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:51:47.904048 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.904031    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 11:51:47.904432 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.904416    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b759k\""
Jul 16 11:51:47.904493 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.904477    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 11:51:47.997496 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.997403    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:47.997496 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.997440    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36c30764-f4ed-4fbc-9369-61a80c162b83-tmp-dir\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:51:47.997680 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:47.997530    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 11:51:47.997680 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.997569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:47.997680 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:47.997616    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm podName:e79115f4-3fb7-422c-8d99-62d65531c257 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:48.497594702 +0000 UTC m=+37.132388772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qsjs" (UID: "e79115f4-3fb7-422c-8d99-62d65531c257") : configmap "kube-rbac-proxy" not found
Jul 16 11:51:47.997680 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.997663    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36c30764-f4ed-4fbc-9369-61a80c162b83-config-volume\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:51:47.997869 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:47.997686    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:47.997869 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.997686    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87611f27-ba17-46a3-8489-7ef7ad49d48d-cert\") pod \"ingress-canary-8cj4r\" (UID: \"87611f27-ba17-46a3-8489-7ef7ad49d48d\") " pod="openshift-ingress-canary/ingress-canary-8cj4r"
Jul 16 11:51:47.997869 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:47.997725    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls podName:e79115f4-3fb7-422c-8d99-62d65531c257 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:48.497714064 +0000 UTC m=+37.132508116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qsjs" (UID: "e79115f4-3fb7-422c-8d99-62d65531c257") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:47.997869 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.997800    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e79115f4-3fb7-422c-8d99-62d65531c257-crio-socket\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:47.997869 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.997825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhw2l\" (UniqueName: \"kubernetes.io/projected/e79115f4-3fb7-422c-8d99-62d65531c257-kube-api-access-hhw2l\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:47.997869 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.997850    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrjmq\" (UniqueName: \"kubernetes.io/projected/36c30764-f4ed-4fbc-9369-61a80c162b83-kube-api-access-wrjmq\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:51:47.998134 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.997885    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e79115f4-3fb7-422c-8d99-62d65531c257-data-volume\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:47.998134 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.997901    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:51:47.998134 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.997917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flrzj\" (UniqueName: \"kubernetes.io/projected/87611f27-ba17-46a3-8489-7ef7ad49d48d-kube-api-access-flrzj\") pod \"ingress-canary-8cj4r\" (UID: \"87611f27-ba17-46a3-8489-7ef7ad49d48d\") " pod="openshift-ingress-canary/ingress-canary-8cj4r"
Jul 16 11:51:47.998134 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.998014    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e79115f4-3fb7-422c-8d99-62d65531c257-crio-socket\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:47.998303 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:47.998223    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e79115f4-3fb7-422c-8d99-62d65531c257-data-volume\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:48.008013 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.007987    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhw2l\" (UniqueName: \"kubernetes.io/projected/e79115f4-3fb7-422c-8d99-62d65531c257-kube-api-access-hhw2l\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:48.098627 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.098590    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36c30764-f4ed-4fbc-9369-61a80c162b83-config-volume\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:51:48.098627 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.098628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87611f27-ba17-46a3-8489-7ef7ad49d48d-cert\") pod \"ingress-canary-8cj4r\" (UID: \"87611f27-ba17-46a3-8489-7ef7ad49d48d\") " pod="openshift-ingress-canary/ingress-canary-8cj4r"
Jul 16 11:51:48.098858 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.098668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrjmq\" (UniqueName: \"kubernetes.io/projected/36c30764-f4ed-4fbc-9369-61a80c162b83-kube-api-access-wrjmq\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:51:48.098858 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.098796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:51:48.098858 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.098839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flrzj\" (UniqueName: \"kubernetes.io/projected/87611f27-ba17-46a3-8489-7ef7ad49d48d-kube-api-access-flrzj\") pod \"ingress-canary-8cj4r\" (UID: \"87611f27-ba17-46a3-8489-7ef7ad49d48d\") " pod="openshift-ingress-canary/ingress-canary-8cj4r"
Jul 16 11:51:48.099009 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.098880    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36c30764-f4ed-4fbc-9369-61a80c162b83-tmp-dir\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:51:48.099009 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:48.098911    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:51:48.099009 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:48.098978    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls podName:36c30764-f4ed-4fbc-9369-61a80c162b83 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:48.598957239 +0000 UTC m=+37.233751305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls") pod "dns-default-bfqxq" (UID: "36c30764-f4ed-4fbc-9369-61a80c162b83") : secret "dns-default-metrics-tls" not found
Jul 16 11:51:48.099211 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.099194    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36c30764-f4ed-4fbc-9369-61a80c162b83-tmp-dir\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:51:48.099372 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.099354    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36c30764-f4ed-4fbc-9369-61a80c162b83-config-volume\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:51:48.101283 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.101256    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87611f27-ba17-46a3-8489-7ef7ad49d48d-cert\") pod \"ingress-canary-8cj4r\" (UID: \"87611f27-ba17-46a3-8489-7ef7ad49d48d\") " pod="openshift-ingress-canary/ingress-canary-8cj4r"
Jul 16 11:51:48.112060 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.112031    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrjmq\" (UniqueName: \"kubernetes.io/projected/36c30764-f4ed-4fbc-9369-61a80c162b83-kube-api-access-wrjmq\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:51:48.112259 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.112241    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flrzj\" (UniqueName: \"kubernetes.io/projected/87611f27-ba17-46a3-8489-7ef7ad49d48d-kube-api-access-flrzj\") pod \"ingress-canary-8cj4r\" (UID: \"87611f27-ba17-46a3-8489-7ef7ad49d48d\") " pod="openshift-ingress-canary/ingress-canary-8cj4r"
Jul 16 11:51:48.140214 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.140185    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8cj4r"
Jul 16 11:51:48.197584 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.197557    2564 generic.go:356] "Generic (PLEG): container finished" podID="69851010-8a64-40df-b2fa-a65d69a78155" containerID="5d9d2152b3bebd9f991a618d6ec7ca71db8130beda89db07b3b2a28e1d683654" exitCode=0
Jul 16 11:51:48.197991 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.197613    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74ll5" event={"ID":"69851010-8a64-40df-b2fa-a65d69a78155","Type":"ContainerDied","Data":"5d9d2152b3bebd9f991a618d6ec7ca71db8130beda89db07b3b2a28e1d683654"}
Jul 16 11:51:48.344513 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.344319    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8cj4r"]
Jul 16 11:51:48.348060 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:48.348026    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87611f27_ba17_46a3_8489_7ef7ad49d48d.slice/crio-0d6293c3e1d7efd7a34fff295c0d593afa2b9d43d02bd17c6777b550412a6d87 WatchSource:0}: Error finding container 0d6293c3e1d7efd7a34fff295c0d593afa2b9d43d02bd17c6777b550412a6d87: Status 404 returned error can't find the container with id 0d6293c3e1d7efd7a34fff295c0d593afa2b9d43d02bd17c6777b550412a6d87
Jul 16 11:51:48.501539 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.501502    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:48.501725 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.501553    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:48.501725 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:48.501632    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 11:51:48.501725 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:48.501687    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:48.501725 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:48.501699    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm podName:e79115f4-3fb7-422c-8d99-62d65531c257 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:49.501681084 +0000 UTC m=+38.136475133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qsjs" (UID: "e79115f4-3fb7-422c-8d99-62d65531c257") : configmap "kube-rbac-proxy" not found
Jul 16 11:51:48.501882 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:48.501745    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls podName:e79115f4-3fb7-422c-8d99-62d65531c257 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:49.501730276 +0000 UTC m=+38.136524343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qsjs" (UID: "e79115f4-3fb7-422c-8d99-62d65531c257") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:48.583558 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.583483    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bp2rl_8e38731d-db50-48f8-bf39-caac0473dcc6/dns-node-resolver/0.log"
Jul 16 11:51:48.602802 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.602772    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:51:48.602932 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:48.602918    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:51:48.602990 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:48.602981    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls podName:36c30764-f4ed-4fbc-9369-61a80c162b83 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:49.602963156 +0000 UTC m=+38.237757210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls") pod "dns-default-bfqxq" (UID: "36c30764-f4ed-4fbc-9369-61a80c162b83") : secret "dns-default-metrics-tls" not found
Jul 16 11:51:48.936556 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:48.936526    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8929c_81602ec2-6161-4799-a83c-d8b926799fe2/node-ca/0.log"
Jul 16 11:51:49.202114 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:49.202031    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8cj4r" event={"ID":"87611f27-ba17-46a3-8489-7ef7ad49d48d","Type":"ContainerStarted","Data":"0d6293c3e1d7efd7a34fff295c0d593afa2b9d43d02bd17c6777b550412a6d87"}
Jul 16 11:51:49.510851 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:49.510762    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:49.510851 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:49.510825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:49.511069 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:49.510881    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 11:51:49.511069 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:49.510956    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm podName:e79115f4-3fb7-422c-8d99-62d65531c257 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:51.510935338 +0000 UTC m=+40.145729393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qsjs" (UID: "e79115f4-3fb7-422c-8d99-62d65531c257") : configmap "kube-rbac-proxy" not found
Jul 16 11:51:49.511069 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:49.510972    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:49.511069 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:49.511020    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls podName:e79115f4-3fb7-422c-8d99-62d65531c257 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:51.511005372 +0000 UTC m=+40.145799445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qsjs" (UID: "e79115f4-3fb7-422c-8d99-62d65531c257") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:49.612178 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:49.612145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:51:49.612388 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:49.612341    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:51:49.612452 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:49.612405    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls podName:36c30764-f4ed-4fbc-9369-61a80c162b83 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:51.612386448 +0000 UTC m=+40.247180512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls") pod "dns-default-bfqxq" (UID: "36c30764-f4ed-4fbc-9369-61a80c162b83") : secret "dns-default-metrics-tls" not found
Jul 16 11:51:51.528544 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.528494    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:51.528544 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.528550    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:51.529055 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:51.528647    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 11:51:51.529055 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:51.528710    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:51.529055 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:51.528736    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm podName:e79115f4-3fb7-422c-8d99-62d65531c257 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:55.528712568 +0000 UTC m=+44.163506620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qsjs" (UID: "e79115f4-3fb7-422c-8d99-62d65531c257") : configmap "kube-rbac-proxy" not found
Jul 16 11:51:51.529055 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:51.528760    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls podName:e79115f4-3fb7-422c-8d99-62d65531c257 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:55.528745079 +0000 UTC m=+44.163539147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qsjs" (UID: "e79115f4-3fb7-422c-8d99-62d65531c257") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:51.630014 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.629969    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:51:51.630202 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:51.630190    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:51:51.630265 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:51.630259    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls podName:36c30764-f4ed-4fbc-9369-61a80c162b83 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:55.630241666 +0000 UTC m=+44.265035717 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls") pod "dns-default-bfqxq" (UID: "36c30764-f4ed-4fbc-9369-61a80c162b83") : secret "dns-default-metrics-tls" not found
Jul 16 11:51:51.648201 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.648167    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6"]
Jul 16 11:51:51.656823 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.656799    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6"
Jul 16 11:51:51.659298 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.659271    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 16 11:51:51.659634 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.659612    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 16 11:51:51.659634 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.659630    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 16 11:51:51.660762 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.660740    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 16 11:51:51.661391 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.660740    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gbzmc\""
Jul 16 11:51:51.662049 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.662028    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6"]
Jul 16 11:51:51.832490 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.832457    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g79tl\" (UniqueName: \"kubernetes.io/projected/d05c681c-8aa4-46b1-9bea-78c25a160ed1-kube-api-access-g79tl\") pod \"kube-storage-version-migrator-operator-799cb7f958-s5dl6\" (UID: \"d05c681c-8aa4-46b1-9bea-78c25a160ed1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6"
Jul 16 11:51:51.832666 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.832547    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d05c681c-8aa4-46b1-9bea-78c25a160ed1-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-s5dl6\" (UID: \"d05c681c-8aa4-46b1-9bea-78c25a160ed1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6"
Jul 16 11:51:51.832666 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.832600    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d05c681c-8aa4-46b1-9bea-78c25a160ed1-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-s5dl6\" (UID: \"d05c681c-8aa4-46b1-9bea-78c25a160ed1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6"
Jul 16 11:51:51.933694 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.933654    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d05c681c-8aa4-46b1-9bea-78c25a160ed1-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-s5dl6\" (UID: \"d05c681c-8aa4-46b1-9bea-78c25a160ed1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6"
Jul 16 11:51:51.933876 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.933763    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g79tl\" (UniqueName: \"kubernetes.io/projected/d05c681c-8aa4-46b1-9bea-78c25a160ed1-kube-api-access-g79tl\") pod \"kube-storage-version-migrator-operator-799cb7f958-s5dl6\" (UID: \"d05c681c-8aa4-46b1-9bea-78c25a160ed1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6"
Jul 16 11:51:51.933876 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.933815    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d05c681c-8aa4-46b1-9bea-78c25a160ed1-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-s5dl6\" (UID: \"d05c681c-8aa4-46b1-9bea-78c25a160ed1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6"
Jul 16 11:51:51.934423 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.934401    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d05c681c-8aa4-46b1-9bea-78c25a160ed1-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-s5dl6\" (UID: \"d05c681c-8aa4-46b1-9bea-78c25a160ed1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6"
Jul 16 11:51:51.937582 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.937561    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d05c681c-8aa4-46b1-9bea-78c25a160ed1-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-s5dl6\" (UID: \"d05c681c-8aa4-46b1-9bea-78c25a160ed1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6"
Jul 16 11:51:51.943262 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.943229    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g79tl\" (UniqueName: \"kubernetes.io/projected/d05c681c-8aa4-46b1-9bea-78c25a160ed1-kube-api-access-g79tl\") pod \"kube-storage-version-migrator-operator-799cb7f958-s5dl6\" (UID: \"d05c681c-8aa4-46b1-9bea-78c25a160ed1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6"
Jul 16 11:51:51.989068 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:51.989034    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6"
Jul 16 11:51:52.663385 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.663348    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8"]
Jul 16 11:51:52.682230 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.682197    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8"]
Jul 16 11:51:52.682369 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.682313    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8"
Jul 16 11:51:52.685475 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.685440    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 16 11:51:52.686594 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.686579    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 16 11:51:52.686721 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.686591    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 16 11:51:52.686721 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.686606    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vj6dj\""
Jul 16 11:51:52.686721 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.686585    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 16 11:51:52.765478 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.765448    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-dj44p"]
Jul 16 11:51:52.781390 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.781366    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-dj44p"]
Jul 16 11:51:52.781500 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.781405    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dj44p"
Jul 16 11:51:52.784382 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.784366    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-g7n9k\""
Jul 16 11:51:52.841963 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.841939    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsfrm\" (UniqueName: \"kubernetes.io/projected/daa11569-3bfd-4bae-b8d9-282706f1a129-kube-api-access-lsfrm\") pod \"service-ca-operator-7695fc6c8c-6j6m8\" (UID: \"daa11569-3bfd-4bae-b8d9-282706f1a129\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8"
Jul 16 11:51:52.842091 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.842070    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/daa11569-3bfd-4bae-b8d9-282706f1a129-config\") pod \"service-ca-operator-7695fc6c8c-6j6m8\" (UID: \"daa11569-3bfd-4bae-b8d9-282706f1a129\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8"
Jul 16 11:51:52.842141 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.842105    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/daa11569-3bfd-4bae-b8d9-282706f1a129-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6j6m8\" (UID: \"daa11569-3bfd-4bae-b8d9-282706f1a129\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8"
Jul 16 11:51:52.942774 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.942752    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/daa11569-3bfd-4bae-b8d9-282706f1a129-config\") pod \"service-ca-operator-7695fc6c8c-6j6m8\" (UID: \"daa11569-3bfd-4bae-b8d9-282706f1a129\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8"
Jul 16 11:51:52.942854 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.942784    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/daa11569-3bfd-4bae-b8d9-282706f1a129-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6j6m8\" (UID: \"daa11569-3bfd-4bae-b8d9-282706f1a129\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8"
Jul 16 11:51:52.942854 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.942812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsfrm\" (UniqueName: \"kubernetes.io/projected/daa11569-3bfd-4bae-b8d9-282706f1a129-kube-api-access-lsfrm\") pod \"service-ca-operator-7695fc6c8c-6j6m8\" (UID: \"daa11569-3bfd-4bae-b8d9-282706f1a129\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8"
Jul 16 11:51:52.942941 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.942872    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvqxr\" (UniqueName: \"kubernetes.io/projected/be71122e-b5ee-46d1-85ee-8fb02ccebb75-kube-api-access-xvqxr\") pod \"network-check-source-869dcfcdcd-dj44p\" (UID: \"be71122e-b5ee-46d1-85ee-8fb02ccebb75\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dj44p"
Jul 16 11:51:52.943307 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.943290    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/daa11569-3bfd-4bae-b8d9-282706f1a129-config\") pod \"service-ca-operator-7695fc6c8c-6j6m8\" (UID: \"daa11569-3bfd-4bae-b8d9-282706f1a129\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8"
Jul 16 11:51:52.945432 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.945415    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/daa11569-3bfd-4bae-b8d9-282706f1a129-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6j6m8\" (UID: \"daa11569-3bfd-4bae-b8d9-282706f1a129\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8"
Jul 16 11:51:52.951954 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.951930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsfrm\" (UniqueName: \"kubernetes.io/projected/daa11569-3bfd-4bae-b8d9-282706f1a129-kube-api-access-lsfrm\") pod \"service-ca-operator-7695fc6c8c-6j6m8\" (UID: \"daa11569-3bfd-4bae-b8d9-282706f1a129\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8"
Jul 16 11:51:52.991959 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:52.991751    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8"
Jul 16 11:51:53.044415 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.044219    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvqxr\" (UniqueName: \"kubernetes.io/projected/be71122e-b5ee-46d1-85ee-8fb02ccebb75-kube-api-access-xvqxr\") pod \"network-check-source-869dcfcdcd-dj44p\" (UID: \"be71122e-b5ee-46d1-85ee-8fb02ccebb75\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dj44p"
Jul 16 11:51:53.055395 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.055316    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvqxr\" (UniqueName: \"kubernetes.io/projected/be71122e-b5ee-46d1-85ee-8fb02ccebb75-kube-api-access-xvqxr\") pod \"network-check-source-869dcfcdcd-dj44p\" (UID: \"be71122e-b5ee-46d1-85ee-8fb02ccebb75\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dj44p"
Jul 16 11:51:53.089946 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.089918    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dj44p"
Jul 16 11:51:53.118790 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.118747    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6"]
Jul 16 11:51:53.123106 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:53.123055    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd05c681c_8aa4_46b1_9bea_78c25a160ed1.slice/crio-f5031fd8efbd2155387443655891f594ad2c267470335f2f40361f4b444bd2d4 WatchSource:0}: Error finding container f5031fd8efbd2155387443655891f594ad2c267470335f2f40361f4b444bd2d4: Status 404 returned error can't find the container with id f5031fd8efbd2155387443655891f594ad2c267470335f2f40361f4b444bd2d4
Jul 16 11:51:53.187007 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.186781    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8"]
Jul 16 11:51:53.215225 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.215190    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f4b68b7d-rx878"]
Jul 16 11:51:53.237207 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.237104    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74ll5" event={"ID":"69851010-8a64-40df-b2fa-a65d69a78155","Type":"ContainerStarted","Data":"80eb834e754f95972d98b44f63b62a3fb8dd8e114ea1e8e1b4b099e418950501"}
Jul 16 11:51:53.237207 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.237147    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8cj4r" event={"ID":"87611f27-ba17-46a3-8489-7ef7ad49d48d","Type":"ContainerStarted","Data":"c1acc6d29658bd894e1817ff54a4ed6ae273f44491081b591b4fde96880fa43e"}
Jul 16 11:51:53.237207 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.237167    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6" event={"ID":"d05c681c-8aa4-46b1-9bea-78c25a160ed1","Type":"ContainerStarted","Data":"f5031fd8efbd2155387443655891f594ad2c267470335f2f40361f4b444bd2d4"}
Jul 16 11:51:53.237474 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.237278    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.243480 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.243457    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f4b68b7d-rx878"]
Jul 16 11:51:53.245602 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.245578    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 11:51:53.245974 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.245954    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pbnkd\""
Jul 16 11:51:53.246204 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.246176    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 11:51:53.246399 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.246385    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 11:51:53.259688 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.259668    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 11:51:53.294117 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.294091    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-dj44p"]
Jul 16 11:51:53.305210 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:53.305186    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa11569_3bfd_4bae_b8d9_282706f1a129.slice/crio-9155dd3c9d5753700d8aed7e6a10928ebef1585227ae5ac55f30a9c110086a5d WatchSource:0}: Error finding container 9155dd3c9d5753700d8aed7e6a10928ebef1585227ae5ac55f30a9c110086a5d: Status 404 returned error can't find the container with id 9155dd3c9d5753700d8aed7e6a10928ebef1585227ae5ac55f30a9c110086a5d
Jul 16 11:51:53.305512 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:51:53.305477    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe71122e_b5ee_46d1_85ee_8fb02ccebb75.slice/crio-f4be6d8c96970ff8885abfcd1bd18d261a2d777adbb0a460deca6f03010539f4 WatchSource:0}: Error finding container f4be6d8c96970ff8885abfcd1bd18d261a2d777adbb0a460deca6f03010539f4: Status 404 returned error can't find the container with id f4be6d8c96970ff8885abfcd1bd18d261a2d777adbb0a460deca6f03010539f4
Jul 16 11:51:53.347030 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.347010    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-bound-sa-token\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.347107 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.347042    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.347107 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.347061    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7436447-6212-4385-8ed0-15aff9c83bd8-ca-trust-extracted\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.347178 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.347157    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7436447-6212-4385-8ed0-15aff9c83bd8-trusted-ca\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.347261 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.347244    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7436447-6212-4385-8ed0-15aff9c83bd8-image-registry-private-configuration\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.347293 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.347270    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-certificates\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.347377 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.347362    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7436447-6212-4385-8ed0-15aff9c83bd8-installation-pull-secrets\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.347410 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.347393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt6ds\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-kube-api-access-zt6ds\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.380024 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.379982    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8cj4r" podStartSLOduration=1.760707133 podStartE2EDuration="6.379966165s" totalImagesPullingTime="4.619259032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:53.379896929 +0000 UTC m=+42.014690998" watchObservedRunningTime="2026-07-16 11:51:53.379966165 +0000 UTC m=+42.014760236"
Jul 16 11:51:53.448346 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.448308    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7436447-6212-4385-8ed0-15aff9c83bd8-image-registry-private-configuration\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.448459 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.448364    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-certificates\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.448459 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.448409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7436447-6212-4385-8ed0-15aff9c83bd8-installation-pull-secrets\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.448459 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.448431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt6ds\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-kube-api-access-zt6ds\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.448602 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.448470    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-bound-sa-token\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.448602 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.448489    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.448602 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.448510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7436447-6212-4385-8ed0-15aff9c83bd8-ca-trust-extracted\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.448602 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.448544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7436447-6212-4385-8ed0-15aff9c83bd8-trusted-ca\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.448602 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:53.448592    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:51:53.448826 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:53.448607    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4b68b7d-rx878: secret "image-registry-tls" not found
Jul 16 11:51:53.448826 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:53.448668    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls podName:a7436447-6212-4385-8ed0-15aff9c83bd8 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:53.948644891 +0000 UTC m=+42.583438951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls") pod "image-registry-5f4b68b7d-rx878" (UID: "a7436447-6212-4385-8ed0-15aff9c83bd8") : secret "image-registry-tls" not found
Jul 16 11:51:53.449023 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.449002    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-certificates\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.449255 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.449236    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7436447-6212-4385-8ed0-15aff9c83bd8-trusted-ca\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.451572 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.451546    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7436447-6212-4385-8ed0-15aff9c83bd8-installation-pull-secrets\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.451663 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.451583    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7436447-6212-4385-8ed0-15aff9c83bd8-image-registry-private-configuration\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.462499 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.462449    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7436447-6212-4385-8ed0-15aff9c83bd8-ca-trust-extracted\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.464406 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.464387    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt6ds\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-kube-api-access-zt6ds\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.466015 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.465993    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-bound-sa-token\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.951477 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:53.951438    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:53.952199 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:53.951577    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:51:53.952199 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:53.951592    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4b68b7d-rx878: secret "image-registry-tls" not found
Jul 16 11:51:53.952199 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:53.951653    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls podName:a7436447-6212-4385-8ed0-15aff9c83bd8 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:54.951635526 +0000 UTC m=+43.586429588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls") pod "image-registry-5f4b68b7d-rx878" (UID: "a7436447-6212-4385-8ed0-15aff9c83bd8") : secret "image-registry-tls" not found
Jul 16 11:51:54.225145 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:54.225026    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dj44p" event={"ID":"be71122e-b5ee-46d1-85ee-8fb02ccebb75","Type":"ContainerStarted","Data":"f4be6d8c96970ff8885abfcd1bd18d261a2d777adbb0a460deca6f03010539f4"}
Jul 16 11:51:54.226609 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:54.226579    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8" event={"ID":"daa11569-3bfd-4bae-b8d9-282706f1a129","Type":"ContainerStarted","Data":"9155dd3c9d5753700d8aed7e6a10928ebef1585227ae5ac55f30a9c110086a5d"}
Jul 16 11:51:54.230877 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:54.230849    2564 generic.go:356] "Generic (PLEG): container finished" podID="69851010-8a64-40df-b2fa-a65d69a78155" containerID="80eb834e754f95972d98b44f63b62a3fb8dd8e114ea1e8e1b4b099e418950501" exitCode=0
Jul 16 11:51:54.231419 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:54.231388    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74ll5" event={"ID":"69851010-8a64-40df-b2fa-a65d69a78155","Type":"ContainerDied","Data":"80eb834e754f95972d98b44f63b62a3fb8dd8e114ea1e8e1b4b099e418950501"}
Jul 16 11:51:54.959278 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:54.959234    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:54.959747 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:54.959415    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:51:54.959747 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:54.959438    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4b68b7d-rx878: secret "image-registry-tls" not found
Jul 16 11:51:54.959747 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:54.959511    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls podName:a7436447-6212-4385-8ed0-15aff9c83bd8 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:56.959490798 +0000 UTC m=+45.594284860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls") pod "image-registry-5f4b68b7d-rx878" (UID: "a7436447-6212-4385-8ed0-15aff9c83bd8") : secret "image-registry-tls" not found
Jul 16 11:51:55.237995 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:55.237913    2564 generic.go:356] "Generic (PLEG): container finished" podID="69851010-8a64-40df-b2fa-a65d69a78155" containerID="773f4885667d24238761d51f3ba4e5f4e9c9cd6c619a8af9fe918627e06d3194" exitCode=0
Jul 16 11:51:55.237995 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:55.237960    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74ll5" event={"ID":"69851010-8a64-40df-b2fa-a65d69a78155","Type":"ContainerDied","Data":"773f4885667d24238761d51f3ba4e5f4e9c9cd6c619a8af9fe918627e06d3194"}
Jul 16 11:51:55.562395 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:55.562312    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:55.562395 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:55.562372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:51:55.562576 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:55.562429    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 11:51:55.562576 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:55.562487    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:55.562576 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:55.562492    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm podName:e79115f4-3fb7-422c-8d99-62d65531c257 nodeName:}" failed. No retries permitted until 2026-07-16 11:52:03.562476297 +0000 UTC m=+52.197270345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qsjs" (UID: "e79115f4-3fb7-422c-8d99-62d65531c257") : configmap "kube-rbac-proxy" not found
Jul 16 11:51:55.562576 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:55.562527    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls podName:e79115f4-3fb7-422c-8d99-62d65531c257 nodeName:}" failed. No retries permitted until 2026-07-16 11:52:03.562515687 +0000 UTC m=+52.197309756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qsjs" (UID: "e79115f4-3fb7-422c-8d99-62d65531c257") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:55.662731 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:55.662697    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:51:55.662885 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:55.662850    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:51:55.662963 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:55.662931    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls podName:36c30764-f4ed-4fbc-9369-61a80c162b83 nodeName:}" failed. No retries permitted until 2026-07-16 11:52:03.662911666 +0000 UTC m=+52.297705733 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls") pod "dns-default-bfqxq" (UID: "36c30764-f4ed-4fbc-9369-61a80c162b83") : secret "dns-default-metrics-tls" not found
Jul 16 11:51:56.245255 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:56.245212    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-74ll5" event={"ID":"69851010-8a64-40df-b2fa-a65d69a78155","Type":"ContainerStarted","Data":"34d2b5faf0f88e09a39fabe97f783df7bd3d0cadc8a889e95381d3be361982d5"}
Jul 16 11:51:56.270549 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:56.270502    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-74ll5" podStartSLOduration=10.653284504 podStartE2EDuration="44.270485273s" totalImagesPullingTime="33.617200769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:51:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:56.269132437 +0000 UTC m=+44.903926500" watchObservedRunningTime="2026-07-16 11:51:56.270485273 +0000 UTC m=+44.905279345"
Jul 16 11:51:56.973230 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:56.973208    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:51:56.973384 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:56.973368    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:51:56.973425 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:56.973385    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4b68b7d-rx878: secret "image-registry-tls" not found
Jul 16 11:51:56.973471 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:51:56.973434    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls podName:a7436447-6212-4385-8ed0-15aff9c83bd8 nodeName:}" failed. No retries permitted until 2026-07-16 11:52:00.973417577 +0000 UTC m=+49.608211627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls") pod "image-registry-5f4b68b7d-rx878" (UID: "a7436447-6212-4385-8ed0-15aff9c83bd8") : secret "image-registry-tls" not found
Jul 16 11:51:57.250278 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:57.250098    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dj44p" event={"ID":"be71122e-b5ee-46d1-85ee-8fb02ccebb75","Type":"ContainerStarted","Data":"f947438594a38156338b4e3f69af698767aa2f80160367797ca5da1ba9989006"}
Jul 16 11:51:57.252098 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:57.252064    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6" event={"ID":"d05c681c-8aa4-46b1-9bea-78c25a160ed1","Type":"ContainerStarted","Data":"de1840896cdbe3bb61ca64556cf4b629c56825441a18a13eaf9145071ca7ba50"}
Jul 16 11:51:57.266727 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:57.266662    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dj44p" podStartSLOduration=1.604962183 podStartE2EDuration="5.266640892s" totalImagesPullingTime="3.661678709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:57.266104288 +0000 UTC m=+45.900898383" watchObservedRunningTime="2026-07-16 11:51:57.266640892 +0000 UTC m=+45.901434964"
Jul 16 11:51:57.289436 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:57.289378    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6" podStartSLOduration=2.717938427 podStartE2EDuration="6.289359168s" totalImagesPullingTime="3.571420741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:57.288934268 +0000 UTC m=+45.923728344" watchObservedRunningTime="2026-07-16 11:51:57.289359168 +0000 UTC m=+45.924153233"
Jul 16 11:51:59.260392 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:59.260356    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8" event={"ID":"daa11569-3bfd-4bae-b8d9-282706f1a129","Type":"ContainerStarted","Data":"b18f3c7b3516be00a1a44032eb9e02a8c4de3daa726f8cf259f5ec988d77c4ac"}
Jul 16 11:51:59.316257 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:51:59.316079    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8" podStartSLOduration=1.515482249 podStartE2EDuration="7.316058902s" totalImagesPullingTime="5.800576653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:59.315713161 +0000 UTC m=+47.950507234" watchObservedRunningTime="2026-07-16 11:51:59.316058902 +0000 UTC m=+47.950852975"
Jul 16 11:52:01.009454 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:01.009417    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:52:01.009876 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:52:01.009585    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:52:01.009876 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:52:01.009607    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4b68b7d-rx878: secret "image-registry-tls" not found
Jul 16 11:52:01.009876 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:52:01.009663    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls podName:a7436447-6212-4385-8ed0-15aff9c83bd8 nodeName:}" failed. No retries permitted until 2026-07-16 11:52:09.00964674 +0000 UTC m=+57.644440788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls") pod "image-registry-5f4b68b7d-rx878" (UID: "a7436447-6212-4385-8ed0-15aff9c83bd8") : secret "image-registry-tls" not found
Jul 16 11:52:03.075366 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.075312    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-b6rkt"]
Jul 16 11:52:03.094278 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.094245    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-b6rkt"]
Jul 16 11:52:03.094474 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.094369    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-b6rkt"
Jul 16 11:52:03.102909 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.102890    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 16 11:52:03.103515 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.103484    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 16 11:52:03.103636 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.103532    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-s2rqt\""
Jul 16 11:52:03.103636 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.103590    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 16 11:52:03.103636 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.103590    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 16 11:52:03.126583 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.126545    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ee6a7fda-6fb9-4946-9988-0611b0e7601e-signing-key\") pod \"service-ca-79f68b9f4f-b6rkt\" (UID: \"ee6a7fda-6fb9-4946-9988-0611b0e7601e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-b6rkt"
Jul 16 11:52:03.126583 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.126583    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkl4x\" (UniqueName: \"kubernetes.io/projected/ee6a7fda-6fb9-4946-9988-0611b0e7601e-kube-api-access-xkl4x\") pod \"service-ca-79f68b9f4f-b6rkt\" (UID: \"ee6a7fda-6fb9-4946-9988-0611b0e7601e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-b6rkt"
Jul 16 11:52:03.126778 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.126717    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ee6a7fda-6fb9-4946-9988-0611b0e7601e-signing-cabundle\") pod \"service-ca-79f68b9f4f-b6rkt\" (UID: \"ee6a7fda-6fb9-4946-9988-0611b0e7601e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-b6rkt"
Jul 16 11:52:03.227430 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.227390    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ee6a7fda-6fb9-4946-9988-0611b0e7601e-signing-key\") pod \"service-ca-79f68b9f4f-b6rkt\" (UID: \"ee6a7fda-6fb9-4946-9988-0611b0e7601e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-b6rkt"
Jul 16 11:52:03.227430 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.227428    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkl4x\" (UniqueName: \"kubernetes.io/projected/ee6a7fda-6fb9-4946-9988-0611b0e7601e-kube-api-access-xkl4x\") pod \"service-ca-79f68b9f4f-b6rkt\" (UID: \"ee6a7fda-6fb9-4946-9988-0611b0e7601e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-b6rkt"
Jul 16 11:52:03.227623 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.227508    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ee6a7fda-6fb9-4946-9988-0611b0e7601e-signing-cabundle\") pod \"service-ca-79f68b9f4f-b6rkt\" (UID: \"ee6a7fda-6fb9-4946-9988-0611b0e7601e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-b6rkt"
Jul 16 11:52:03.228072 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.228053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ee6a7fda-6fb9-4946-9988-0611b0e7601e-signing-cabundle\") pod \"service-ca-79f68b9f4f-b6rkt\" (UID: \"ee6a7fda-6fb9-4946-9988-0611b0e7601e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-b6rkt"
Jul 16 11:52:03.229976 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.229944    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ee6a7fda-6fb9-4946-9988-0611b0e7601e-signing-key\") pod \"service-ca-79f68b9f4f-b6rkt\" (UID: \"ee6a7fda-6fb9-4946-9988-0611b0e7601e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-b6rkt"
Jul 16 11:52:03.238015 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.237988    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkl4x\" (UniqueName: \"kubernetes.io/projected/ee6a7fda-6fb9-4946-9988-0611b0e7601e-kube-api-access-xkl4x\") pod \"service-ca-79f68b9f4f-b6rkt\" (UID: \"ee6a7fda-6fb9-4946-9988-0611b0e7601e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-b6rkt"
Jul 16 11:52:03.403595 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.403545    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-b6rkt"
Jul 16 11:52:03.550283 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.550251    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-b6rkt"]
Jul 16 11:52:03.553682 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:52:03.553649    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee6a7fda_6fb9_4946_9988_0611b0e7601e.slice/crio-825838ea9a8e62c0bce56a16ce748fb14783cbc5048b5754e706c4dc64d13f1c WatchSource:0}: Error finding container 825838ea9a8e62c0bce56a16ce748fb14783cbc5048b5754e706c4dc64d13f1c: Status 404 returned error can't find the container with id 825838ea9a8e62c0bce56a16ce748fb14783cbc5048b5754e706c4dc64d13f1c
Jul 16 11:52:03.630748 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.630706    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:52:03.630890 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.630763    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:52:03.630890 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:52:03.630858    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:52:03.630971 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:52:03.630961    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls podName:e79115f4-3fb7-422c-8d99-62d65531c257 nodeName:}" failed. No retries permitted until 2026-07-16 11:52:19.630906287 +0000 UTC m=+68.265700336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qsjs" (UID: "e79115f4-3fb7-422c-8d99-62d65531c257") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:52:03.631291 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.631271    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e79115f4-3fb7-422c-8d99-62d65531c257-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:52:03.731704 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:03.731604    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:52:03.731848 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:52:03.731767    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:52:03.731848 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:52:03.731834    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls podName:36c30764-f4ed-4fbc-9369-61a80c162b83 nodeName:}" failed. No retries permitted until 2026-07-16 11:52:19.731816732 +0000 UTC m=+68.366610780 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls") pod "dns-default-bfqxq" (UID: "36c30764-f4ed-4fbc-9369-61a80c162b83") : secret "dns-default-metrics-tls" not found
Jul 16 11:52:04.275109 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:04.275070    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-b6rkt" event={"ID":"ee6a7fda-6fb9-4946-9988-0611b0e7601e","Type":"ContainerStarted","Data":"8fb38f543e5de8ccb4fac18d86b84e7df02782cba12e98fd831172e808056e78"}
Jul 16 11:52:04.275625 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:04.275134    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-b6rkt" event={"ID":"ee6a7fda-6fb9-4946-9988-0611b0e7601e","Type":"ContainerStarted","Data":"825838ea9a8e62c0bce56a16ce748fb14783cbc5048b5754e706c4dc64d13f1c"}
Jul 16 11:52:04.305591 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:04.305539    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-b6rkt" podStartSLOduration=1.3055208010000001 podStartE2EDuration="1.305520801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:52:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:04.305484444 +0000 UTC m=+52.940278515" watchObservedRunningTime="2026-07-16 11:52:04.305520801 +0000 UTC m=+52.940314872"
Jul 16 11:52:09.077233 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:09.077184    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:52:09.079796 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:09.079773    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls\") pod \"image-registry-5f4b68b7d-rx878\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") " pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:52:09.148839 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:09.148798    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:52:09.287992 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:09.287959    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f4b68b7d-rx878"]
Jul 16 11:52:09.290865 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:52:09.290832    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7436447_6212_4385_8ed0_15aff9c83bd8.slice/crio-4c77ec9c1d71fa2ccd17c87302fd6476e552f7df3dd11d6cf5f76831ff54dbf6 WatchSource:0}: Error finding container 4c77ec9c1d71fa2ccd17c87302fd6476e552f7df3dd11d6cf5f76831ff54dbf6: Status 404 returned error can't find the container with id 4c77ec9c1d71fa2ccd17c87302fd6476e552f7df3dd11d6cf5f76831ff54dbf6
Jul 16 11:52:10.296214 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:10.296184    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f4b68b7d-rx878" event={"ID":"a7436447-6212-4385-8ed0-15aff9c83bd8","Type":"ContainerStarted","Data":"551caa15a1b7e38f83181a63833b465cdda6c695f29c0ed384648dc7c5652577"}
Jul 16 11:52:10.296648 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:10.296230    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f4b68b7d-rx878" event={"ID":"a7436447-6212-4385-8ed0-15aff9c83bd8","Type":"ContainerStarted","Data":"4c77ec9c1d71fa2ccd17c87302fd6476e552f7df3dd11d6cf5f76831ff54dbf6"}
Jul 16 11:52:10.296648 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:10.296259    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:52:10.350921 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:10.350870    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f4b68b7d-rx878" podStartSLOduration=17.350852857 podStartE2EDuration="17.350852857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:51:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:10.350264934 +0000 UTC m=+58.985059024" watchObservedRunningTime="2026-07-16 11:52:10.350852857 +0000 UTC m=+58.985646928"
Jul 16 11:52:14.194650 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:14.194620    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd6t8"
Jul 16 11:52:17.652610 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:17.652571    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret\") pod \"global-pull-secret-syncer-fdd9b\" (UID: \"554acfac-aace-48e2-a6e4-54b9a794d6ee\") " pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:52:17.653108 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:17.652659    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs\") pod \"network-metrics-daemon-7hnqd\" (UID: \"e86ac627-b483-498d-bd18-e4ff68efe17e\") " pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:52:17.655507 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:17.655480    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 11:52:17.656556 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:17.656540    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 11:52:17.665577 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:17.665551    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/554acfac-aace-48e2-a6e4-54b9a794d6ee-original-pull-secret\") pod \"global-pull-secret-syncer-fdd9b\" (UID: \"554acfac-aace-48e2-a6e4-54b9a794d6ee\") " pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:52:17.665710 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:17.665691    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e86ac627-b483-498d-bd18-e4ff68efe17e-metrics-certs\") pod \"network-metrics-daemon-7hnqd\" (UID: \"e86ac627-b483-498d-bd18-e4ff68efe17e\") " pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:52:17.753247 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:17.753206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48cx9\" (UniqueName: \"kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9\") pod \"network-check-target-rpr92\" (UID: \"a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245\") " pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:52:17.755867 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:17.755837    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48cx9\" (UniqueName: \"kubernetes.io/projected/a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245-kube-api-access-48cx9\") pod \"network-check-target-rpr92\" (UID: \"a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245\") " pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:52:17.864671 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:17.864631    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdd9b"
Jul 16 11:52:17.867578 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:17.867556    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vn7fb\""
Jul 16 11:52:17.869205 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:17.869188    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7hnqd"
Jul 16 11:52:17.871966 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:17.871938    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gtptt\""
Jul 16 11:52:17.879990 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:17.879966    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:52:18.029145 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:18.029118    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7hnqd"]
Jul 16 11:52:18.047559 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:18.047526    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fdd9b"]
Jul 16 11:52:18.050897 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:52:18.050864    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod554acfac_aace_48e2_a6e4_54b9a794d6ee.slice/crio-49999b401a037a6fc73b640c13285780702d83f0152095f63c458afb6724b80a WatchSource:0}: Error finding container 49999b401a037a6fc73b640c13285780702d83f0152095f63c458afb6724b80a: Status 404 returned error can't find the container with id 49999b401a037a6fc73b640c13285780702d83f0152095f63c458afb6724b80a
Jul 16 11:52:18.066810 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:18.066777    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rpr92"]
Jul 16 11:52:18.070654 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:52:18.070616    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b9f92c_d63b_4c5a_a22b_ed1ef8c6d245.slice/crio-48d6abae8f9b4cfad15b56c627159cc0a3c9801fee4581046e54f93be678168a WatchSource:0}: Error finding container 48d6abae8f9b4cfad15b56c627159cc0a3c9801fee4581046e54f93be678168a: Status 404 returned error can't find the container with id 48d6abae8f9b4cfad15b56c627159cc0a3c9801fee4581046e54f93be678168a
Jul 16 11:52:18.324616 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:18.324519    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7hnqd" event={"ID":"e86ac627-b483-498d-bd18-e4ff68efe17e","Type":"ContainerStarted","Data":"3950c35da2b3771a7ebd6f2432ccfba9b8f0112da7d5092d218026f5ee1feae1"}
Jul 16 11:52:18.325979 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:18.325954    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rpr92" event={"ID":"a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245","Type":"ContainerStarted","Data":"a6c8c10c33dcca4ebcc69026ddcf0d4a6fc10db2fc02af50d1a32834875b7cea"}
Jul 16 11:52:18.326124 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:18.325993    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rpr92" event={"ID":"a4b9f92c-d63b-4c5a-a22b-ed1ef8c6d245","Type":"ContainerStarted","Data":"48d6abae8f9b4cfad15b56c627159cc0a3c9801fee4581046e54f93be678168a"}
Jul 16 11:52:18.326124 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:18.326041    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:52:18.327177 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:18.327153    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fdd9b" event={"ID":"554acfac-aace-48e2-a6e4-54b9a794d6ee","Type":"ContainerStarted","Data":"49999b401a037a6fc73b640c13285780702d83f0152095f63c458afb6724b80a"}
Jul 16 11:52:19.334208 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:19.334107    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7hnqd" event={"ID":"e86ac627-b483-498d-bd18-e4ff68efe17e","Type":"ContainerStarted","Data":"a927fa63efb59f91dc3ec603c4b34f0c81facdd938a2d7c6046dcc923802546f"}
Jul 16 11:52:19.334208 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:19.334177    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7hnqd" event={"ID":"e86ac627-b483-498d-bd18-e4ff68efe17e","Type":"ContainerStarted","Data":"1e591eb015b98f33191bacb5dbb166f15393168a0f6ed29099b73ae1abd5de70"}
Jul 16 11:52:19.361641 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:19.361574    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rpr92" podStartSLOduration=66.361552689 podStartE2EDuration="1m6.361552689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:51:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:18.350178513 +0000 UTC m=+66.984972585" watchObservedRunningTime="2026-07-16 11:52:19.361552689 +0000 UTC m=+67.996346761"
Jul 16 11:52:19.670299 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:19.670256    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:52:19.672771 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:19.672735    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e79115f4-3fb7-422c-8d99-62d65531c257-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qsjs\" (UID: \"e79115f4-3fb7-422c-8d99-62d65531c257\") " pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:52:19.771314 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:19.771273    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:52:19.774141 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:19.774111    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36c30764-f4ed-4fbc-9369-61a80c162b83-metrics-tls\") pod \"dns-default-bfqxq\" (UID: \"36c30764-f4ed-4fbc-9369-61a80c162b83\") " pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:52:19.920692 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:19.920611    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qlctg\""
Jul 16 11:52:19.928258 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:19.928215    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2qsjs"
Jul 16 11:52:20.013005 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:20.012975    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b759k\""
Jul 16 11:52:20.020760 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:20.020722    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:52:20.112247 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:20.112184    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7hnqd" podStartSLOduration=67.070363049 podStartE2EDuration="1m8.112157642s" totalImagesPullingTime="1.041794593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:19.362055992 +0000 UTC m=+67.996850063" watchObservedRunningTime="2026-07-16 11:52:20.112157642 +0000 UTC m=+68.746951712"
Jul 16 11:52:20.112536 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:20.112455    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2qsjs"]
Jul 16 11:52:20.112536 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:52:20.112492    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode79115f4_3fb7_422c_8d99_62d65531c257.slice/crio-6c220940b51b136348d5b722533a4438d1605caa6b5ead870ff3484de77ec94c WatchSource:0}: Error finding container 6c220940b51b136348d5b722533a4438d1605caa6b5ead870ff3484de77ec94c: Status 404 returned error can't find the container with id 6c220940b51b136348d5b722533a4438d1605caa6b5ead870ff3484de77ec94c
Jul 16 11:52:20.183289 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:20.183199    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bfqxq"]
Jul 16 11:52:20.187296 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:52:20.187263    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c30764_f4ed_4fbc_9369_61a80c162b83.slice/crio-0d90ddbe5668130a29ecc95202601f75b4131a6cc7be4caf8bdc13d7630bf7d2 WatchSource:0}: Error finding container 0d90ddbe5668130a29ecc95202601f75b4131a6cc7be4caf8bdc13d7630bf7d2: Status 404 returned error can't find the container with id 0d90ddbe5668130a29ecc95202601f75b4131a6cc7be4caf8bdc13d7630bf7d2
Jul 16 11:52:20.339882 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:20.339839    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bfqxq" event={"ID":"36c30764-f4ed-4fbc-9369-61a80c162b83","Type":"ContainerStarted","Data":"0d90ddbe5668130a29ecc95202601f75b4131a6cc7be4caf8bdc13d7630bf7d2"}
Jul 16 11:52:20.341162 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:20.341132    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qsjs" event={"ID":"e79115f4-3fb7-422c-8d99-62d65531c257","Type":"ContainerStarted","Data":"6c220940b51b136348d5b722533a4438d1605caa6b5ead870ff3484de77ec94c"}
Jul 16 11:52:23.355577 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:23.355532    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fdd9b" event={"ID":"554acfac-aace-48e2-a6e4-54b9a794d6ee","Type":"ContainerStarted","Data":"6bedce3b7e8ce08c9482e42924ded9dcf48f42966c8e001029ed6559e8676c3b"}
Jul 16 11:52:23.357759 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:23.357700    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bfqxq" event={"ID":"36c30764-f4ed-4fbc-9369-61a80c162b83","Type":"ContainerStarted","Data":"c5df90ed179fa15c994d849a897665b076c6c72f64cab09682448778c845f886"}
Jul 16 11:52:23.357759 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:23.357758    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bfqxq" event={"ID":"36c30764-f4ed-4fbc-9369-61a80c162b83","Type":"ContainerStarted","Data":"8155c11c82b9c28649fae8f9a2575a2a6920b4f3e02cd7ee61fd4db6a9b13215"}
Jul 16 11:52:23.357976 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:23.357807    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:52:23.386778 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:23.386715    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fdd9b" podStartSLOduration=65.778777821 podStartE2EDuration="1m10.386700181s" totalImagesPullingTime="4.60792236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:23.379713066 +0000 UTC m=+72.014507138" watchObservedRunningTime="2026-07-16 11:52:23.386700181 +0000 UTC m=+72.021494251"
Jul 16 11:52:23.405524 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:23.405455    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bfqxq" podStartSLOduration=33.940011556 podStartE2EDuration="36.4054376s" totalImagesPullingTime="2.465426044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:23.403975412 +0000 UTC m=+72.038769484" watchObservedRunningTime="2026-07-16 11:52:23.4054376 +0000 UTC m=+72.040231670"
Jul 16 11:52:28.377881 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:28.377843    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qsjs" event={"ID":"e79115f4-3fb7-422c-8d99-62d65531c257","Type":"ContainerStarted","Data":"2db500103d752dd7f8ae20ab69f33201965ed9f1c616c6210d9b93b683dabdd8"}
Jul 16 11:52:28.980855 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:28.980817    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g"]
Jul 16 11:52:28.993684 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:28.993648    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g"
Jul 16 11:52:28.994236 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:28.994175    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g"]
Jul 16 11:52:29.001168 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.001135    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 11:52:29.001355 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.001135    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 16 11:52:29.001787 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.001558    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 11:52:29.001787 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.001189    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 11:52:29.030062 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.030019    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f4b68b7d-rx878"]
Jul 16 11:52:29.035739 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.035702    2564 patch_prober.go:28] interesting pod/image-registry-5f4b68b7d-rx878 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 16 11:52:29.035912 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.035764    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5f4b68b7d-rx878" podUID="a7436447-6212-4385-8ed0-15aff9c83bd8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 11:52:29.089542 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.089507    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9czvt"]
Jul 16 11:52:29.108562 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.108528    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9czvt"
Jul 16 11:52:29.110786 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.110760    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9czvt"]
Jul 16 11:52:29.111852 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.111806    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 16 11:52:29.112061 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.112038    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cxf8n\""
Jul 16 11:52:29.144190 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.144151    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdkrj\" (UniqueName: \"kubernetes.io/projected/71df8939-5c1a-4cd4-9723-ff47364785db-kube-api-access-bdkrj\") pod \"klusterlet-addon-workmgr-664797ddf8-k6r8g\" (UID: \"71df8939-5c1a-4cd4-9723-ff47364785db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g"
Jul 16 11:52:29.144386 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.144206    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/71df8939-5c1a-4cd4-9723-ff47364785db-klusterlet-config\") pod \"klusterlet-addon-workmgr-664797ddf8-k6r8g\" (UID: \"71df8939-5c1a-4cd4-9723-ff47364785db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g"
Jul 16 11:52:29.144386 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.144310    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71df8939-5c1a-4cd4-9723-ff47364785db-tmp\") pod \"klusterlet-addon-workmgr-664797ddf8-k6r8g\" (UID: \"71df8939-5c1a-4cd4-9723-ff47364785db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g"
Jul 16 11:52:29.237912 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.237820    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-667f9448f5-wxsg7"]
Jul 16 11:52:29.245034 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.245000    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/71df8939-5c1a-4cd4-9723-ff47364785db-klusterlet-config\") pod \"klusterlet-addon-workmgr-664797ddf8-k6r8g\" (UID: \"71df8939-5c1a-4cd4-9723-ff47364785db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g"
Jul 16 11:52:29.245233 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.245054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/efc1f5b6-ea75-450f-b72b-a47a5af547aa-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-9czvt\" (UID: \"efc1f5b6-ea75-450f-b72b-a47a5af547aa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9czvt"
Jul 16 11:52:29.245233 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.245102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71df8939-5c1a-4cd4-9723-ff47364785db-tmp\") pod \"klusterlet-addon-workmgr-664797ddf8-k6r8g\" (UID: \"71df8939-5c1a-4cd4-9723-ff47364785db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g"
Jul 16 11:52:29.245233 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.245125    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdkrj\" (UniqueName: \"kubernetes.io/projected/71df8939-5c1a-4cd4-9723-ff47364785db-kube-api-access-bdkrj\") pod \"klusterlet-addon-workmgr-664797ddf8-k6r8g\" (UID: \"71df8939-5c1a-4cd4-9723-ff47364785db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g"
Jul 16 11:52:29.245673 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.245643    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71df8939-5c1a-4cd4-9723-ff47364785db-tmp\") pod \"klusterlet-addon-workmgr-664797ddf8-k6r8g\" (UID: \"71df8939-5c1a-4cd4-9723-ff47364785db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g"
Jul 16 11:52:29.248197 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.248169    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/71df8939-5c1a-4cd4-9723-ff47364785db-klusterlet-config\") pod \"klusterlet-addon-workmgr-664797ddf8-k6r8g\" (UID: \"71df8939-5c1a-4cd4-9723-ff47364785db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g"
Jul 16 11:52:29.260041 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.260013    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.269755 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.269728    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdkrj\" (UniqueName: \"kubernetes.io/projected/71df8939-5c1a-4cd4-9723-ff47364785db-kube-api-access-bdkrj\") pod \"klusterlet-addon-workmgr-664797ddf8-k6r8g\" (UID: \"71df8939-5c1a-4cd4-9723-ff47364785db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g"
Jul 16 11:52:29.290412 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.290376    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-667f9448f5-wxsg7"]
Jul 16 11:52:29.307939 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.307910    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g"
Jul 16 11:52:29.346105 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.346075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9968b111-2956-4e07-8ceb-8596724f4057-ca-trust-extracted\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.346265 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.346119    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9968b111-2956-4e07-8ceb-8596724f4057-trusted-ca\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.346265 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.346147    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9968b111-2956-4e07-8ceb-8596724f4057-installation-pull-secrets\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.346265 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.346213    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9968b111-2956-4e07-8ceb-8596724f4057-image-registry-private-configuration\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.346265 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.346242    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9968b111-2956-4e07-8ceb-8596724f4057-registry-certificates\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.346431 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.346279    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9968b111-2956-4e07-8ceb-8596724f4057-bound-sa-token\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.346431 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.346301    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9968b111-2956-4e07-8ceb-8596724f4057-registry-tls\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.346431 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.346363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn7hr\" (UniqueName: \"kubernetes.io/projected/9968b111-2956-4e07-8ceb-8596724f4057-kube-api-access-mn7hr\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.346431 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.346393    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/efc1f5b6-ea75-450f-b72b-a47a5af547aa-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-9czvt\" (UID: \"efc1f5b6-ea75-450f-b72b-a47a5af547aa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9czvt"
Jul 16 11:52:29.349721 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.349690    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/efc1f5b6-ea75-450f-b72b-a47a5af547aa-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-9czvt\" (UID: \"efc1f5b6-ea75-450f-b72b-a47a5af547aa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9czvt"
Jul 16 11:52:29.421858 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.421819    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9czvt"
Jul 16 11:52:29.447421 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.447076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn7hr\" (UniqueName: \"kubernetes.io/projected/9968b111-2956-4e07-8ceb-8596724f4057-kube-api-access-mn7hr\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.447421 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.447121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9968b111-2956-4e07-8ceb-8596724f4057-ca-trust-extracted\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.447421 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.447141    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9968b111-2956-4e07-8ceb-8596724f4057-trusted-ca\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.447421 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.447156    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9968b111-2956-4e07-8ceb-8596724f4057-installation-pull-secrets\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.447421 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.447177    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9968b111-2956-4e07-8ceb-8596724f4057-image-registry-private-configuration\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.447421 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.447195    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9968b111-2956-4e07-8ceb-8596724f4057-registry-certificates\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.447421 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.447217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9968b111-2956-4e07-8ceb-8596724f4057-bound-sa-token\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.447421 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.447235    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9968b111-2956-4e07-8ceb-8596724f4057-registry-tls\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.449380 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.448401    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9968b111-2956-4e07-8ceb-8596724f4057-ca-trust-extracted\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.449380 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.449317    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9968b111-2956-4e07-8ceb-8596724f4057-registry-certificates\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.449576 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.449433    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9968b111-2956-4e07-8ceb-8596724f4057-trusted-ca\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.450991 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.450962    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9968b111-2956-4e07-8ceb-8596724f4057-installation-pull-secrets\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.451433 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.451414    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9968b111-2956-4e07-8ceb-8596724f4057-image-registry-private-configuration\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.451543 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.451523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9968b111-2956-4e07-8ceb-8596724f4057-registry-tls\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.461866 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.461844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9968b111-2956-4e07-8ceb-8596724f4057-bound-sa-token\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.462893 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.462866    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn7hr\" (UniqueName: \"kubernetes.io/projected/9968b111-2956-4e07-8ceb-8596724f4057-kube-api-access-mn7hr\") pod \"image-registry-667f9448f5-wxsg7\" (UID: \"9968b111-2956-4e07-8ceb-8596724f4057\") " pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.487553 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.487520    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g"]
Jul 16 11:52:29.491679 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:52:29.491643    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71df8939_5c1a_4cd4_9723_ff47364785db.slice/crio-a0ad29197cb2dff9aefbff64c0ebf60e911f54d8e3fab1cb12f591ca3d92ee00 WatchSource:0}: Error finding container a0ad29197cb2dff9aefbff64c0ebf60e911f54d8e3fab1cb12f591ca3d92ee00: Status 404 returned error can't find the container with id a0ad29197cb2dff9aefbff64c0ebf60e911f54d8e3fab1cb12f591ca3d92ee00
Jul 16 11:52:29.571124 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.571084    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:29.638074 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.638040    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9czvt"]
Jul 16 11:52:29.639199 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:52:29.639171    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc1f5b6_ea75_450f_b72b_a47a5af547aa.slice/crio-34f3d2d475164ed2f859a664d4c5efca15e786ec5acf6b65f3976e60bec8aa83 WatchSource:0}: Error finding container 34f3d2d475164ed2f859a664d4c5efca15e786ec5acf6b65f3976e60bec8aa83: Status 404 returned error can't find the container with id 34f3d2d475164ed2f859a664d4c5efca15e786ec5acf6b65f3976e60bec8aa83
Jul 16 11:52:29.743358 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:29.743148    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-667f9448f5-wxsg7"]
Jul 16 11:52:29.746370 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:52:29.746302    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9968b111_2956_4e07_8ceb_8596724f4057.slice/crio-6e3e99344524f08fa9db52657b809646834f8638017140e619e59f6d5ce26bab WatchSource:0}: Error finding container 6e3e99344524f08fa9db52657b809646834f8638017140e619e59f6d5ce26bab: Status 404 returned error can't find the container with id 6e3e99344524f08fa9db52657b809646834f8638017140e619e59f6d5ce26bab
Jul 16 11:52:30.388004 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:30.387969    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9czvt" event={"ID":"efc1f5b6-ea75-450f-b72b-a47a5af547aa","Type":"ContainerStarted","Data":"34f3d2d475164ed2f859a664d4c5efca15e786ec5acf6b65f3976e60bec8aa83"}
Jul 16 11:52:30.389287 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:30.389251    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g" event={"ID":"71df8939-5c1a-4cd4-9723-ff47364785db","Type":"ContainerStarted","Data":"a0ad29197cb2dff9aefbff64c0ebf60e911f54d8e3fab1cb12f591ca3d92ee00"}
Jul 16 11:52:30.390908 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:30.390883    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-667f9448f5-wxsg7" event={"ID":"9968b111-2956-4e07-8ceb-8596724f4057","Type":"ContainerStarted","Data":"af3a2948de93c18383b81f7003d0df22a0b2d84fb348eea5cf7fbbc41817ec27"}
Jul 16 11:52:30.391033 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:30.390931    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-667f9448f5-wxsg7" event={"ID":"9968b111-2956-4e07-8ceb-8596724f4057","Type":"ContainerStarted","Data":"6e3e99344524f08fa9db52657b809646834f8638017140e619e59f6d5ce26bab"}
Jul 16 11:52:30.391094 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:30.391086    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:30.416048 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:30.415987    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-667f9448f5-wxsg7" podStartSLOduration=1.415965868 podStartE2EDuration="1.415965868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:52:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:30.415716343 +0000 UTC m=+79.050510439" watchObservedRunningTime="2026-07-16 11:52:30.415965868 +0000 UTC m=+79.050759965"
Jul 16 11:52:33.364100 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.364065    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bfqxq"
Jul 16 11:52:33.405570 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.405524    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qsjs" event={"ID":"e79115f4-3fb7-422c-8d99-62d65531c257","Type":"ContainerStarted","Data":"e63ddf932097c053f2860543aede030a4d1579b0d4b936cf89d667d27ca1273b"}
Jul 16 11:52:33.407542 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.407475    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9czvt" event={"ID":"efc1f5b6-ea75-450f-b72b-a47a5af547aa","Type":"ContainerStarted","Data":"dbb7ecfc0fa5b2eb019ec391dc93f306298210d762e8447a63ceef6a6f5cf400"}
Jul 16 11:52:33.407916 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.407888    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9czvt"
Jul 16 11:52:33.414248 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.414217    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9czvt"
Jul 16 11:52:33.432031 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.431869    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9czvt" podStartSLOduration=1.711136258 podStartE2EDuration="4.431850674s" totalImagesPullingTime="2.720714416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:33.430688592 +0000 UTC m=+82.065482664" watchObservedRunningTime="2026-07-16 11:52:33.431850674 +0000 UTC m=+82.066644744"
Jul 16 11:52:33.753939 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.753902    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-2sjp2"]
Jul 16 11:52:33.756425 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.756396    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2"
Jul 16 11:52:33.761830 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.761802    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 16 11:52:33.762011 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.761960    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 11:52:33.762791 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.762770    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 11:52:33.762904 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.762778    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 16 11:52:33.763032 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.763003    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dnmm6\""
Jul 16 11:52:33.763128 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.763083    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 11:52:33.778471 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.778434    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-2sjp2"]
Jul 16 11:52:33.884528 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.884492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/667ec765-f8ba-48c6-b5b3-8668a2cb7ea5-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-2sjp2\" (UID: \"667ec765-f8ba-48c6-b5b3-8668a2cb7ea5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2"
Jul 16 11:52:33.884724 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.884552    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8rtz\" (UniqueName: \"kubernetes.io/projected/667ec765-f8ba-48c6-b5b3-8668a2cb7ea5-kube-api-access-w8rtz\") pod \"prometheus-operator-64785b6675-2sjp2\" (UID: \"667ec765-f8ba-48c6-b5b3-8668a2cb7ea5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2"
Jul 16 11:52:33.884724 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.884582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/667ec765-f8ba-48c6-b5b3-8668a2cb7ea5-metrics-client-ca\") pod \"prometheus-operator-64785b6675-2sjp2\" (UID: \"667ec765-f8ba-48c6-b5b3-8668a2cb7ea5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2"
Jul 16 11:52:33.884851 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.884758    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/667ec765-f8ba-48c6-b5b3-8668a2cb7ea5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-2sjp2\" (UID: \"667ec765-f8ba-48c6-b5b3-8668a2cb7ea5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2"
Jul 16 11:52:33.985848 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.985814    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/667ec765-f8ba-48c6-b5b3-8668a2cb7ea5-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-2sjp2\" (UID: \"667ec765-f8ba-48c6-b5b3-8668a2cb7ea5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2"
Jul 16 11:52:33.986044 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.985863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8rtz\" (UniqueName: \"kubernetes.io/projected/667ec765-f8ba-48c6-b5b3-8668a2cb7ea5-kube-api-access-w8rtz\") pod \"prometheus-operator-64785b6675-2sjp2\" (UID: \"667ec765-f8ba-48c6-b5b3-8668a2cb7ea5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2"
Jul 16 11:52:33.986044 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.985894    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/667ec765-f8ba-48c6-b5b3-8668a2cb7ea5-metrics-client-ca\") pod \"prometheus-operator-64785b6675-2sjp2\" (UID: \"667ec765-f8ba-48c6-b5b3-8668a2cb7ea5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2"
Jul 16 11:52:33.986044 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:52:33.986002    2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 16 11:52:33.986200 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.986053    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/667ec765-f8ba-48c6-b5b3-8668a2cb7ea5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-2sjp2\" (UID: \"667ec765-f8ba-48c6-b5b3-8668a2cb7ea5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2"
Jul 16 11:52:33.986200 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:52:33.986079    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/667ec765-f8ba-48c6-b5b3-8668a2cb7ea5-prometheus-operator-tls podName:667ec765-f8ba-48c6-b5b3-8668a2cb7ea5 nodeName:}" failed. No retries permitted until 2026-07-16 11:52:34.486057313 +0000 UTC m=+83.120851380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/667ec765-f8ba-48c6-b5b3-8668a2cb7ea5-prometheus-operator-tls") pod "prometheus-operator-64785b6675-2sjp2" (UID: "667ec765-f8ba-48c6-b5b3-8668a2cb7ea5") : secret "prometheus-operator-tls" not found
Jul 16 11:52:33.986743 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.986687    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/667ec765-f8ba-48c6-b5b3-8668a2cb7ea5-metrics-client-ca\") pod \"prometheus-operator-64785b6675-2sjp2\" (UID: \"667ec765-f8ba-48c6-b5b3-8668a2cb7ea5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2"
Jul 16 11:52:33.988640 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.988610    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/667ec765-f8ba-48c6-b5b3-8668a2cb7ea5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-2sjp2\" (UID: \"667ec765-f8ba-48c6-b5b3-8668a2cb7ea5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2"
Jul 16 11:52:33.999220 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:33.999186    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8rtz\" (UniqueName: \"kubernetes.io/projected/667ec765-f8ba-48c6-b5b3-8668a2cb7ea5-kube-api-access-w8rtz\") pod \"prometheus-operator-64785b6675-2sjp2\" (UID: \"667ec765-f8ba-48c6-b5b3-8668a2cb7ea5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2"
Jul 16 11:52:34.491575 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:34.491533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/667ec765-f8ba-48c6-b5b3-8668a2cb7ea5-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-2sjp2\" (UID: \"667ec765-f8ba-48c6-b5b3-8668a2cb7ea5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2"
Jul 16 11:52:34.494215 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:34.494188    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/667ec765-f8ba-48c6-b5b3-8668a2cb7ea5-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-2sjp2\" (UID: \"667ec765-f8ba-48c6-b5b3-8668a2cb7ea5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2"
Jul 16 11:52:34.667990 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:34.667949    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2"
Jul 16 11:52:37.978253 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:37.978216    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-2sjp2"]
Jul 16 11:52:37.981347 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:52:37.981288    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667ec765_f8ba_48c6_b5b3_8668a2cb7ea5.slice/crio-6fbe6e93fb710754fc880197e9f8d4c9679a466ec21b56c83340ba762832bd82 WatchSource:0}: Error finding container 6fbe6e93fb710754fc880197e9f8d4c9679a466ec21b56c83340ba762832bd82: Status 404 returned error can't find the container with id 6fbe6e93fb710754fc880197e9f8d4c9679a466ec21b56c83340ba762832bd82
Jul 16 11:52:38.428804 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:38.428758    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qsjs" event={"ID":"e79115f4-3fb7-422c-8d99-62d65531c257","Type":"ContainerStarted","Data":"01f0658d94ef1aa7a54f5d34f71e8e80c7ff1067c7e6e6d9e73ad39a065f5c61"}
Jul 16 11:52:38.430303 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:38.430272    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g" event={"ID":"71df8939-5c1a-4cd4-9723-ff47364785db","Type":"ContainerStarted","Data":"acbd261287e3ba37e569580bc907517ca53c4c484cdf3dd4e9f204c797145db7"}
Jul 16 11:52:38.430488 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:38.430463    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g"
Jul 16 11:52:38.431586 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:38.431556    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2" event={"ID":"667ec765-f8ba-48c6-b5b3-8668a2cb7ea5","Type":"ContainerStarted","Data":"6fbe6e93fb710754fc880197e9f8d4c9679a466ec21b56c83340ba762832bd82"}
Jul 16 11:52:38.432430 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:38.432411    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g"
Jul 16 11:52:38.449785 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:38.449731    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2qsjs" podStartSLOduration=33.901372624 podStartE2EDuration="51.449715185s" totalImagesPullingTime="17.548342561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:51:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:38.448400494 +0000 UTC m=+87.083194661" watchObservedRunningTime="2026-07-16 11:52:38.449715185 +0000 UTC m=+87.084509255"
Jul 16 11:52:38.468158 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:38.468102    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-664797ddf8-k6r8g" podStartSLOduration=2.053237219 podStartE2EDuration="10.468085921s" totalImagesPullingTime="8.414848702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:38.468075449 +0000 UTC m=+87.102869522" watchObservedRunningTime="2026-07-16 11:52:38.468085921 +0000 UTC m=+87.102879994"
Jul 16 11:52:39.036561 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:39.036529    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:52:39.437235 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:39.437195    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2" event={"ID":"667ec765-f8ba-48c6-b5b3-8668a2cb7ea5","Type":"ContainerStarted","Data":"c3392ef9a49f8270f3693ad0f66c3a8c8e53b16bdf9e86eed6f2d6937cc08045"}
Jul 16 11:52:39.437442 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:39.437264    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2" event={"ID":"667ec765-f8ba-48c6-b5b3-8668a2cb7ea5","Type":"ContainerStarted","Data":"2b418ab6ab31a91470264d6004d0183d535c78ad146133ebd221aabc31be1642"}
Jul 16 11:52:39.459237 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:39.459183    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-2sjp2" podStartSLOduration=5.142907489 podStartE2EDuration="6.459165892s" totalImagesPullingTime="1.316258403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:52:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:39.458294854 +0000 UTC m=+88.093088925" watchObservedRunningTime="2026-07-16 11:52:39.459165892 +0000 UTC m=+88.093959963"
Jul 16 11:52:41.444287 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.444252    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7fsk8"]
Jul 16 11:52:41.447795 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.447775    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.452650 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.452627    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vz9xv\""
Jul 16 11:52:41.453035 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.453019    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 11:52:41.453097 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.453055    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 11:52:41.453689 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.453666    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 11:52:41.548267 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.548218    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d030df13-f44a-4e02-8f03-b903776e57a8-sys\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.548267 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.548271    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrw42\" (UniqueName: \"kubernetes.io/projected/d030df13-f44a-4e02-8f03-b903776e57a8-kube-api-access-vrw42\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.548511 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.548317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d030df13-f44a-4e02-8f03-b903776e57a8-root\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.548511 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.548402    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d030df13-f44a-4e02-8f03-b903776e57a8-node-exporter-wtmp\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.548511 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.548465    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d030df13-f44a-4e02-8f03-b903776e57a8-metrics-client-ca\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.548511 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.548490    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d030df13-f44a-4e02-8f03-b903776e57a8-node-exporter-tls\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.548651 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.548517    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d030df13-f44a-4e02-8f03-b903776e57a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.548651 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.548602    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d030df13-f44a-4e02-8f03-b903776e57a8-node-exporter-textfile\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.548651 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.548646    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d030df13-f44a-4e02-8f03-b903776e57a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.649992 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.649944    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d030df13-f44a-4e02-8f03-b903776e57a8-root\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.649992 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.649997    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d030df13-f44a-4e02-8f03-b903776e57a8-node-exporter-wtmp\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.650241 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.650028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d030df13-f44a-4e02-8f03-b903776e57a8-metrics-client-ca\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.650241 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.650043    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d030df13-f44a-4e02-8f03-b903776e57a8-node-exporter-tls\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.650241 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.650062    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d030df13-f44a-4e02-8f03-b903776e57a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.650241 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.650066    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d030df13-f44a-4e02-8f03-b903776e57a8-root\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.650241 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.650094    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d030df13-f44a-4e02-8f03-b903776e57a8-node-exporter-textfile\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.650241 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.650119    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d030df13-f44a-4e02-8f03-b903776e57a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.650241 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.650140    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d030df13-f44a-4e02-8f03-b903776e57a8-sys\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.650241 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.650157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrw42\" (UniqueName: \"kubernetes.io/projected/d030df13-f44a-4e02-8f03-b903776e57a8-kube-api-access-vrw42\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.650241 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.650225    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d030df13-f44a-4e02-8f03-b903776e57a8-node-exporter-wtmp\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.650772 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.650264    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d030df13-f44a-4e02-8f03-b903776e57a8-sys\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.650772 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.650594    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d030df13-f44a-4e02-8f03-b903776e57a8-node-exporter-textfile\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.650772 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.650677    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d030df13-f44a-4e02-8f03-b903776e57a8-metrics-client-ca\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.650772 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.650754    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d030df13-f44a-4e02-8f03-b903776e57a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.652571 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.652550    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d030df13-f44a-4e02-8f03-b903776e57a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.652767 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.652749    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d030df13-f44a-4e02-8f03-b903776e57a8-node-exporter-tls\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.666733 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.666694    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrw42\" (UniqueName: \"kubernetes.io/projected/d030df13-f44a-4e02-8f03-b903776e57a8-kube-api-access-vrw42\") pod \"node-exporter-7fsk8\" (UID: \"d030df13-f44a-4e02-8f03-b903776e57a8\") " pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.757990 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:41.757898    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7fsk8"
Jul 16 11:52:41.769304 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:52:41.769270    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd030df13_f44a_4e02_8f03_b903776e57a8.slice/crio-f0cabb9870b6ccedf711e30192c83aba62f54ddc8cad1b3790cfe1f61c5eff85 WatchSource:0}: Error finding container f0cabb9870b6ccedf711e30192c83aba62f54ddc8cad1b3790cfe1f61c5eff85: Status 404 returned error can't find the container with id f0cabb9870b6ccedf711e30192c83aba62f54ddc8cad1b3790cfe1f61c5eff85
Jul 16 11:52:42.450762 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:42.450720    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7fsk8" event={"ID":"d030df13-f44a-4e02-8f03-b903776e57a8","Type":"ContainerStarted","Data":"f0cabb9870b6ccedf711e30192c83aba62f54ddc8cad1b3790cfe1f61c5eff85"}
Jul 16 11:52:43.455859 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:43.455821    2564 generic.go:356] "Generic (PLEG): container finished" podID="d030df13-f44a-4e02-8f03-b903776e57a8" containerID="684bce9228358b29cbf77a92f5a15d8b2c2b64d43a0f653dcdda6ab77182e0ca" exitCode=0
Jul 16 11:52:43.456240 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:43.455876    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7fsk8" event={"ID":"d030df13-f44a-4e02-8f03-b903776e57a8","Type":"ContainerDied","Data":"684bce9228358b29cbf77a92f5a15d8b2c2b64d43a0f653dcdda6ab77182e0ca"}
Jul 16 11:52:44.461282 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:44.461239    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7fsk8" event={"ID":"d030df13-f44a-4e02-8f03-b903776e57a8","Type":"ContainerStarted","Data":"db6bae6c94b87b78194fffc03f46549b118a58f9f891e40e3d609bbf45dce26a"}
Jul 16 11:52:44.461702 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:44.461366    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7fsk8" event={"ID":"d030df13-f44a-4e02-8f03-b903776e57a8","Type":"ContainerStarted","Data":"b510abdca8ea49dd2600793e46c75b1050a1e3e7de4399205a53b3524b08417e"}
Jul 16 11:52:44.515822 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:44.515763    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7fsk8" podStartSLOduration=2.457816238 podStartE2EDuration="3.515746882s" totalImagesPullingTime="984.991073ms" totalInitContainerRuntime="72.939571ms" isStatefulPod=true podCreationTimestamp="2026-07-16 11:52:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:44.515273765 +0000 UTC m=+93.150067836" watchObservedRunningTime="2026-07-16 11:52:44.515746882 +0000 UTC m=+93.150540953"
Jul 16 11:52:45.915251 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:45.915214    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8695566d49-2mb6f"]
Jul 16 11:52:45.918575 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:45.918549    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:45.923308 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:45.923277    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bt5lx\""
Jul 16 11:52:45.923454 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:45.923309    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 16 11:52:45.923454 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:45.923277    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 16 11:52:45.923454 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:45.923285    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 16 11:52:45.923617 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:45.923492    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f96gnd6sn1olt\""
Jul 16 11:52:45.923617 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:45.923559    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 16 11:52:45.938380 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:45.938346    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8695566d49-2mb6f"]
Jul 16 11:52:45.987120 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:45.987078    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:45.987305 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:45.987127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-metrics-server-audit-profiles\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:45.987305 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:45.987196    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-client-ca-bundle\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:45.987305 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:45.987246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-audit-log\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:45.987305 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:45.987276    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-secret-metrics-server-tls\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:45.987496 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:45.987342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqszg\" (UniqueName: \"kubernetes.io/projected/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-kube-api-access-zqszg\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:45.987496 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:45.987362    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-secret-metrics-server-client-certs\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:46.088600 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:46.088555    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqszg\" (UniqueName: \"kubernetes.io/projected/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-kube-api-access-zqszg\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:46.088600 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:46.088599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-secret-metrics-server-client-certs\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:46.088819 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:46.088791    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:46.088867 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:46.088854    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-metrics-server-audit-profiles\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:46.088915 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:46.088899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-client-ca-bundle\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:46.088990 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:46.088954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-audit-log\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:46.089045 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:46.088988    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-secret-metrics-server-tls\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:46.089359 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:46.089315    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-audit-log\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:46.089645 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:46.089622    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:46.090124 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:46.090101    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-metrics-server-audit-profiles\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:46.091434 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:46.091413    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-secret-metrics-server-client-certs\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:46.091899 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:46.091880    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-secret-metrics-server-tls\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:46.092034 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:46.092015    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-client-ca-bundle\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:46.099006 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:46.098976    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqszg\" (UniqueName: \"kubernetes.io/projected/7262dac5-3e13-4ad6-be18-0c87ac6e82a9-kube-api-access-zqszg\") pod \"metrics-server-8695566d49-2mb6f\" (UID: \"7262dac5-3e13-4ad6-be18-0c87ac6e82a9\") " pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:46.229022 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:46.228918    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:52:46.385042 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:46.385004    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8695566d49-2mb6f"]
Jul 16 11:52:46.388972 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:52:46.388946    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7262dac5_3e13_4ad6_be18_0c87ac6e82a9.slice/crio-7b1c2a3e064a20aeff2e5912fd4b8fe8396a8b6977df147f1cffec74b7d103ab WatchSource:0}: Error finding container 7b1c2a3e064a20aeff2e5912fd4b8fe8396a8b6977df147f1cffec74b7d103ab: Status 404 returned error can't find the container with id 7b1c2a3e064a20aeff2e5912fd4b8fe8396a8b6977df147f1cffec74b7d103ab
Jul 16 11:52:46.470212 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:46.470179    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8695566d49-2mb6f" event={"ID":"7262dac5-3e13-4ad6-be18-0c87ac6e82a9","Type":"ContainerStarted","Data":"7b1c2a3e064a20aeff2e5912fd4b8fe8396a8b6977df147f1cffec74b7d103ab"}
Jul 16 11:52:48.479913 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:48.479873    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8695566d49-2mb6f" event={"ID":"7262dac5-3e13-4ad6-be18-0c87ac6e82a9","Type":"ContainerStarted","Data":"0a746290b2fe57c2fcb87b7b1bb68c17412af33da34665ec6dbfb4ca9ca6f318"}
Jul 16 11:52:48.501239 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:48.501173    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8695566d49-2mb6f" podStartSLOduration=2.286733903 podStartE2EDuration="3.501151174s" totalImagesPullingTime="1.214417271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:52:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:48.499410294 +0000 UTC m=+97.134204362" watchObservedRunningTime="2026-07-16 11:52:48.501151174 +0000 UTC m=+97.135945245"
Jul 16 11:52:49.336569 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:49.336533    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rpr92"
Jul 16 11:52:51.399939 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:51.399913    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-667f9448f5-wxsg7"
Jul 16 11:52:54.059056 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.058999    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5f4b68b7d-rx878" podUID="a7436447-6212-4385-8ed0-15aff9c83bd8" containerName="registry" containerID="cri-o://551caa15a1b7e38f83181a63833b465cdda6c695f29c0ed384648dc7c5652577" gracePeriod=30
Jul 16 11:52:54.319651 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.319577    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:52:54.357735 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.357703    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7436447-6212-4385-8ed0-15aff9c83bd8-installation-pull-secrets\") pod \"a7436447-6212-4385-8ed0-15aff9c83bd8\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") "
Jul 16 11:52:54.357897 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.357746    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt6ds\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-kube-api-access-zt6ds\") pod \"a7436447-6212-4385-8ed0-15aff9c83bd8\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") "
Jul 16 11:52:54.357897 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.357789    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7436447-6212-4385-8ed0-15aff9c83bd8-ca-trust-extracted\") pod \"a7436447-6212-4385-8ed0-15aff9c83bd8\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") "
Jul 16 11:52:54.357897 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.357829    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls\") pod \"a7436447-6212-4385-8ed0-15aff9c83bd8\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") "
Jul 16 11:52:54.357897 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.357856    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7436447-6212-4385-8ed0-15aff9c83bd8-image-registry-private-configuration\") pod \"a7436447-6212-4385-8ed0-15aff9c83bd8\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") "
Jul 16 11:52:54.357897 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.357883    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7436447-6212-4385-8ed0-15aff9c83bd8-trusted-ca\") pod \"a7436447-6212-4385-8ed0-15aff9c83bd8\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") "
Jul 16 11:52:54.358116 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.357976    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-bound-sa-token\") pod \"a7436447-6212-4385-8ed0-15aff9c83bd8\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") "
Jul 16 11:52:54.358116 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.358002    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-certificates\") pod \"a7436447-6212-4385-8ed0-15aff9c83bd8\" (UID: \"a7436447-6212-4385-8ed0-15aff9c83bd8\") "
Jul 16 11:52:54.358573 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.358542    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a7436447-6212-4385-8ed0-15aff9c83bd8" (UID: "a7436447-6212-4385-8ed0-15aff9c83bd8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:52:54.358940 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.358715    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7436447-6212-4385-8ed0-15aff9c83bd8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a7436447-6212-4385-8ed0-15aff9c83bd8" (UID: "a7436447-6212-4385-8ed0-15aff9c83bd8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:52:54.360612 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.360578    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-kube-api-access-zt6ds" (OuterVolumeSpecName: "kube-api-access-zt6ds") pod "a7436447-6212-4385-8ed0-15aff9c83bd8" (UID: "a7436447-6212-4385-8ed0-15aff9c83bd8"). InnerVolumeSpecName "kube-api-access-zt6ds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:52:54.360612 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.360601    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7436447-6212-4385-8ed0-15aff9c83bd8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a7436447-6212-4385-8ed0-15aff9c83bd8" (UID: "a7436447-6212-4385-8ed0-15aff9c83bd8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:52:54.360789 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.360645    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a7436447-6212-4385-8ed0-15aff9c83bd8" (UID: "a7436447-6212-4385-8ed0-15aff9c83bd8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:52:54.360789 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.360752    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7436447-6212-4385-8ed0-15aff9c83bd8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a7436447-6212-4385-8ed0-15aff9c83bd8" (UID: "a7436447-6212-4385-8ed0-15aff9c83bd8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:52:54.360894 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.360803    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a7436447-6212-4385-8ed0-15aff9c83bd8" (UID: "a7436447-6212-4385-8ed0-15aff9c83bd8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:52:54.368506 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.368321    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7436447-6212-4385-8ed0-15aff9c83bd8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a7436447-6212-4385-8ed0-15aff9c83bd8" (UID: "a7436447-6212-4385-8ed0-15aff9c83bd8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:52:54.458971 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.458937    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-bound-sa-token\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:52:54.458971 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.458968    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-certificates\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:52:54.458971 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.458978    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7436447-6212-4385-8ed0-15aff9c83bd8-installation-pull-secrets\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:52:54.459204 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.458988    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt6ds\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-kube-api-access-zt6ds\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:52:54.459204 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.458997    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7436447-6212-4385-8ed0-15aff9c83bd8-ca-trust-extracted\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:52:54.459204 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.459005    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7436447-6212-4385-8ed0-15aff9c83bd8-registry-tls\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:52:54.459204 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.459016    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7436447-6212-4385-8ed0-15aff9c83bd8-image-registry-private-configuration\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:52:54.459204 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.459026    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7436447-6212-4385-8ed0-15aff9c83bd8-trusted-ca\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:52:54.506463 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.506432    2564 generic.go:356] "Generic (PLEG): container finished" podID="a7436447-6212-4385-8ed0-15aff9c83bd8" containerID="551caa15a1b7e38f83181a63833b465cdda6c695f29c0ed384648dc7c5652577" exitCode=0
Jul 16 11:52:54.506638 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.506474    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f4b68b7d-rx878"
Jul 16 11:52:54.506638 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.506475    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f4b68b7d-rx878" event={"ID":"a7436447-6212-4385-8ed0-15aff9c83bd8","Type":"ContainerDied","Data":"551caa15a1b7e38f83181a63833b465cdda6c695f29c0ed384648dc7c5652577"}
Jul 16 11:52:54.506638 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.506616    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f4b68b7d-rx878" event={"ID":"a7436447-6212-4385-8ed0-15aff9c83bd8","Type":"ContainerDied","Data":"4c77ec9c1d71fa2ccd17c87302fd6476e552f7df3dd11d6cf5f76831ff54dbf6"}
Jul 16 11:52:54.506735 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.506641    2564 scope.go:117] "RemoveContainer" containerID="551caa15a1b7e38f83181a63833b465cdda6c695f29c0ed384648dc7c5652577"
Jul 16 11:52:54.515576 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.515558    2564 scope.go:117] "RemoveContainer" containerID="551caa15a1b7e38f83181a63833b465cdda6c695f29c0ed384648dc7c5652577"
Jul 16 11:52:54.515902 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:52:54.515878    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"551caa15a1b7e38f83181a63833b465cdda6c695f29c0ed384648dc7c5652577\": container with ID starting with 551caa15a1b7e38f83181a63833b465cdda6c695f29c0ed384648dc7c5652577 not found: ID does not exist" containerID="551caa15a1b7e38f83181a63833b465cdda6c695f29c0ed384648dc7c5652577"
Jul 16 11:52:54.516002 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.515911    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"551caa15a1b7e38f83181a63833b465cdda6c695f29c0ed384648dc7c5652577"} err="failed to get container status \"551caa15a1b7e38f83181a63833b465cdda6c695f29c0ed384648dc7c5652577\": rpc error: code = NotFound desc = could not find container \"551caa15a1b7e38f83181a63833b465cdda6c695f29c0ed384648dc7c5652577\": container with ID starting with 551caa15a1b7e38f83181a63833b465cdda6c695f29c0ed384648dc7c5652577 not found: ID does not exist"
Jul 16 11:52:54.545449 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.545411    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f4b68b7d-rx878"]
Jul 16 11:52:54.555956 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:54.555909    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5f4b68b7d-rx878"]
Jul 16 11:52:55.854080 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:52:55.854040    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7436447-6212-4385-8ed0-15aff9c83bd8" path="/var/lib/kubelet/pods/a7436447-6212-4385-8ed0-15aff9c83bd8/volumes"
Jul 16 11:53:00.753624 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.753583    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69f888d55b-ctd95"]
Jul 16 11:53:00.754097 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.753942    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7436447-6212-4385-8ed0-15aff9c83bd8" containerName="registry"
Jul 16 11:53:00.754097 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.753960    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7436447-6212-4385-8ed0-15aff9c83bd8" containerName="registry"
Jul 16 11:53:00.754097 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.754042    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7436447-6212-4385-8ed0-15aff9c83bd8" containerName="registry"
Jul 16 11:53:00.763155 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.763125    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.770434 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.770405    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 16 11:53:00.770580 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.770561    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rcddz\""
Jul 16 11:53:00.770629 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.770558    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 16 11:53:00.771699 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.771675    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 16 11:53:00.771825 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.771735    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 16 11:53:00.771825 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.771745    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 16 11:53:00.771949 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.771901    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 16 11:53:00.772913 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.772892    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 16 11:53:00.774468 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.774445    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69f888d55b-ctd95"]
Jul 16 11:53:00.777289 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.777268    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 16 11:53:00.809811 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.809770    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-oauth-serving-cert\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.809987 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.809827    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-serving-cert\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.809987 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.809849    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-trusted-ca-bundle\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.809987 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.809941    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-service-ca\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.810082 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.809989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-oauth-config\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.810082 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.810022    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-config\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.810082 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.810040    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpwh4\" (UniqueName: \"kubernetes.io/projected/39fc12d3-4323-41d3-bae1-7681e87c9ff5-kube-api-access-gpwh4\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.911402 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.911366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-service-ca\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.911568 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.911416    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-oauth-config\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.911568 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.911495    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-config\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.911568 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.911522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpwh4\" (UniqueName: \"kubernetes.io/projected/39fc12d3-4323-41d3-bae1-7681e87c9ff5-kube-api-access-gpwh4\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.911568 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.911548    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-oauth-serving-cert\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.911737 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.911572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-serving-cert\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.911737 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.911596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-trusted-ca-bundle\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.914195 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.914163    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-oauth-config\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.914340 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.914229    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-serving-cert\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.923259 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.923230    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpwh4\" (UniqueName: \"kubernetes.io/projected/39fc12d3-4323-41d3-bae1-7681e87c9ff5-kube-api-access-gpwh4\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.928842 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.928798    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-service-ca\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.928980 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.928809    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-config\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.928980 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.928854    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-oauth-serving-cert\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:00.928980 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:00.928954    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-trusted-ca-bundle\") pod \"console-69f888d55b-ctd95\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") " pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:01.073144 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:01.073050    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:01.245249 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:01.245223    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69f888d55b-ctd95"]
Jul 16 11:53:01.247481 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:53:01.247456    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39fc12d3_4323_41d3_bae1_7681e87c9ff5.slice/crio-31593b87fa6c0dd03b19b2b208c2670c0cf009f48118b36036b5e64e13aafe81 WatchSource:0}: Error finding container 31593b87fa6c0dd03b19b2b208c2670c0cf009f48118b36036b5e64e13aafe81: Status 404 returned error can't find the container with id 31593b87fa6c0dd03b19b2b208c2670c0cf009f48118b36036b5e64e13aafe81
Jul 16 11:53:01.536891 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:01.536856    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f888d55b-ctd95" event={"ID":"39fc12d3-4323-41d3-bae1-7681e87c9ff5","Type":"ContainerStarted","Data":"31593b87fa6c0dd03b19b2b208c2670c0cf009f48118b36036b5e64e13aafe81"}
Jul 16 11:53:04.550988 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:04.550953    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f888d55b-ctd95" event={"ID":"39fc12d3-4323-41d3-bae1-7681e87c9ff5","Type":"ContainerStarted","Data":"7f3463eb9fb7298116b1afd59ba3b4113e07ad4127abdf0e10c01944c552aa5f"}
Jul 16 11:53:04.581377 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:04.581293    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69f888d55b-ctd95" podStartSLOduration=1.411429329 podStartE2EDuration="4.581277289s" totalImagesPullingTime="3.16984796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:53:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:53:04.578841878 +0000 UTC m=+113.213635948" watchObservedRunningTime="2026-07-16 11:53:04.581277289 +0000 UTC m=+113.216071359"
Jul 16 11:53:05.556506 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:05.556468    2564 generic.go:356] "Generic (PLEG): container finished" podID="daa11569-3bfd-4bae-b8d9-282706f1a129" containerID="b18f3c7b3516be00a1a44032eb9e02a8c4de3daa726f8cf259f5ec988d77c4ac" exitCode=0
Jul 16 11:53:05.556882 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:05.556539    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8" event={"ID":"daa11569-3bfd-4bae-b8d9-282706f1a129","Type":"ContainerDied","Data":"b18f3c7b3516be00a1a44032eb9e02a8c4de3daa726f8cf259f5ec988d77c4ac"}
Jul 16 11:53:05.556882 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:05.556840    2564 scope.go:117] "RemoveContainer" containerID="b18f3c7b3516be00a1a44032eb9e02a8c4de3daa726f8cf259f5ec988d77c4ac"
Jul 16 11:53:06.229555 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:06.229508    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:53:06.229760 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:06.229593    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:53:06.563813 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:06.563720    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6j6m8" event={"ID":"daa11569-3bfd-4bae-b8d9-282706f1a129","Type":"ContainerStarted","Data":"d4c72aefaf6058a520ce823494870637d96e48834f87dcd503a469a2f5f787e4"}
Jul 16 11:53:07.837208 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:07.837169    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8695566d49-2mb6f_7262dac5-3e13-4ad6-be18-0c87ac6e82a9/metrics-server/0.log"
Jul 16 11:53:08.234573 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:08.234537    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7fsk8_d030df13-f44a-4e02-8f03-b903776e57a8/init-textfile/0.log"
Jul 16 11:53:08.437144 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:08.437111    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7fsk8_d030df13-f44a-4e02-8f03-b903776e57a8/node-exporter/0.log"
Jul 16 11:53:08.634252 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:08.634226    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7fsk8_d030df13-f44a-4e02-8f03-b903776e57a8/kube-rbac-proxy/0.log"
Jul 16 11:53:11.073499 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:11.073455    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:11.073937 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:11.073526    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:11.078259 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:11.078236    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:11.585713 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:11.585680    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:53:12.036527 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:12.036497    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-2sjp2_667ec765-f8ba-48c6-b5b3-8668a2cb7ea5/prometheus-operator/0.log"
Jul 16 11:53:12.240983 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:12.240955    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-2sjp2_667ec765-f8ba-48c6-b5b3-8668a2cb7ea5/kube-rbac-proxy/0.log"
Jul 16 11:53:12.433268 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:12.433237    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-9czvt_efc1f5b6-ea75-450f-b72b-a47a5af547aa/prometheus-operator-admission-webhook/0.log"
Jul 16 11:53:13.590889 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:13.590852    2564 generic.go:356] "Generic (PLEG): container finished" podID="d05c681c-8aa4-46b1-9bea-78c25a160ed1" containerID="de1840896cdbe3bb61ca64556cf4b629c56825441a18a13eaf9145071ca7ba50" exitCode=0
Jul 16 11:53:13.591270 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:13.590921    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6" event={"ID":"d05c681c-8aa4-46b1-9bea-78c25a160ed1","Type":"ContainerDied","Data":"de1840896cdbe3bb61ca64556cf4b629c56825441a18a13eaf9145071ca7ba50"}
Jul 16 11:53:13.591350 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:13.591275    2564 scope.go:117] "RemoveContainer" containerID="de1840896cdbe3bb61ca64556cf4b629c56825441a18a13eaf9145071ca7ba50"
Jul 16 11:53:14.595786 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:14.595756    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s5dl6" event={"ID":"d05c681c-8aa4-46b1-9bea-78c25a160ed1","Type":"ContainerStarted","Data":"ec258af4c8a63bcd3427f7b657e651c1c3f0598db0e3986218a24d01e989b2d9"}
Jul 16 11:53:14.650597 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:14.650571    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69f888d55b-ctd95_39fc12d3-4323-41d3-bae1-7681e87c9ff5/console/0.log"
Jul 16 11:53:26.235094 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:26.235067    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:53:26.238951 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:53:26.238930    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8695566d49-2mb6f"
Jul 16 11:54:05.951045 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:05.950945    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-689dc86744-xxmks"]
Jul 16 11:54:05.954145 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:05.954120    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:05.957547 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:05.957521    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 16 11:54:05.958296 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:05.958273    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 16 11:54:05.958398 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:05.958294    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-sc2tx\""
Jul 16 11:54:05.958398 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:05.958284    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 16 11:54:05.958846 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:05.958827    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 16 11:54:05.958950 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:05.958868    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 16 11:54:05.965212 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:05.965187    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 16 11:54:05.978300 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:05.978268    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-689dc86744-xxmks"]
Jul 16 11:54:06.003503 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.003462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-telemeter-client-tls\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.003706 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.003515    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.003706 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.003536    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-federate-client-tls\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.003706 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.003600    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-secret-telemeter-client\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.003706 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.003675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-serving-certs-ca-bundle\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.003901 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.003709    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.003901 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.003737    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-metrics-client-ca\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.003901 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.003776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6fkf\" (UniqueName: \"kubernetes.io/projected/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-kube-api-access-b6fkf\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.104216 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.104176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-telemeter-client-tls\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.104447 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.104232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.104447 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.104264    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-federate-client-tls\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.104447 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.104294    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-secret-telemeter-client\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.104447 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.104346    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-serving-certs-ca-bundle\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.104447 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.104373    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.104447 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.104396    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-metrics-client-ca\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.104779 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.104528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6fkf\" (UniqueName: \"kubernetes.io/projected/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-kube-api-access-b6fkf\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.105384 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.105356    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.105486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.105451    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-metrics-client-ca\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.105486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.105425    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-serving-certs-ca-bundle\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.107056 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.107035    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-federate-client-tls\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.107159 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.107132    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-telemeter-client-tls\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.107662 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.107641    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.107856 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.107841    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-secret-telemeter-client\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.113968 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.113935    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6fkf\" (UniqueName: \"kubernetes.io/projected/57e0fac1-c52b-4d57-8349-9d1cd3a557e6-kube-api-access-b6fkf\") pod \"telemeter-client-689dc86744-xxmks\" (UID: \"57e0fac1-c52b-4d57-8349-9d1cd3a557e6\") " pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.266487 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.266406    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-689dc86744-xxmks"
Jul 16 11:54:06.424992 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.424757    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-689dc86744-xxmks"]
Jul 16 11:54:06.428932 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:54:06.428889    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57e0fac1_c52b_4d57_8349_9d1cd3a557e6.slice/crio-4faf8ad9ea8819394e1fb91afd2977c7efeb19e10dd4e134f96e36768a5e9fa6 WatchSource:0}: Error finding container 4faf8ad9ea8819394e1fb91afd2977c7efeb19e10dd4e134f96e36768a5e9fa6: Status 404 returned error can't find the container with id 4faf8ad9ea8819394e1fb91afd2977c7efeb19e10dd4e134f96e36768a5e9fa6
Jul 16 11:54:06.779288 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:06.779249    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-689dc86744-xxmks" event={"ID":"57e0fac1-c52b-4d57-8349-9d1cd3a557e6","Type":"ContainerStarted","Data":"4faf8ad9ea8819394e1fb91afd2977c7efeb19e10dd4e134f96e36768a5e9fa6"}
Jul 16 11:54:08.787713 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:08.787622    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-689dc86744-xxmks" event={"ID":"57e0fac1-c52b-4d57-8349-9d1cd3a557e6","Type":"ContainerStarted","Data":"adc77862041622613db9e6508d5180e092f88c62b3271b35c95f0efd3868e7e3"}
Jul 16 11:54:09.793465 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:09.793436    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-689dc86744-xxmks" event={"ID":"57e0fac1-c52b-4d57-8349-9d1cd3a557e6","Type":"ContainerStarted","Data":"865c231fd28b17be6e5a2e344360cc8fb17d09aa5f415de57b02d28a26acc02c"}
Jul 16 11:54:10.799240 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:10.799196    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-689dc86744-xxmks" event={"ID":"57e0fac1-c52b-4d57-8349-9d1cd3a557e6","Type":"ContainerStarted","Data":"f262cf6421911c6cd7899dc67fa29d423362a8bfbc93aaa55800802afc79421a"}
Jul 16 11:54:10.827143 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:10.827081    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-689dc86744-xxmks" podStartSLOduration=2.653083836 podStartE2EDuration="5.827061864s" totalImagesPullingTime="3.173978028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:54:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:54:10.824786982 +0000 UTC m=+179.459581053" watchObservedRunningTime="2026-07-16 11:54:10.827061864 +0000 UTC m=+179.461855935"
Jul 16 11:54:11.543063 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.543033    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8559bbc9b6-jqwd7"]
Jul 16 11:54:11.546222 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.546207    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.562651 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.562624    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8559bbc9b6-jqwd7"]
Jul 16 11:54:11.652232 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.652204    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-oauth-config\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.652407 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.652240    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-config\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.652407 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.652272    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2pjf\" (UniqueName: \"kubernetes.io/projected/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-kube-api-access-m2pjf\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.652407 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.652347    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-serving-cert\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.652407 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.652380    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-service-ca\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.652407 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.652398    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-oauth-serving-cert\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.652564 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.652416    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-trusted-ca-bundle\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.753227 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.753195    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-serving-cert\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.753425 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.753241    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-service-ca\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.753425 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.753260    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-oauth-serving-cert\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.753425 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.753281    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-trusted-ca-bundle\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.753425 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.753311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-oauth-config\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.753425 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.753366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-config\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.753705 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.753430    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2pjf\" (UniqueName: \"kubernetes.io/projected/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-kube-api-access-m2pjf\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.754013 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.753983    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-service-ca\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.754129 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.754082    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-oauth-serving-cert\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.754426 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.754403    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-trusted-ca-bundle\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.754474 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.754405    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-config\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.755901 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.755874    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-serving-cert\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.755997 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.755979    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-oauth-config\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.762654 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.762630    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2pjf\" (UniqueName: \"kubernetes.io/projected/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-kube-api-access-m2pjf\") pod \"console-8559bbc9b6-jqwd7\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") " pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.855420 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.855321    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:11.984993 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:11.984967    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8559bbc9b6-jqwd7"]
Jul 16 11:54:11.986873 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:54:11.986833    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42ceb1d_9e7b_4e09_b6e7_d905aab17bb3.slice/crio-e6c0aa24ad4cce69aab0868f2da72da2e6330f3925ff7e460ae41266c384c767 WatchSource:0}: Error finding container e6c0aa24ad4cce69aab0868f2da72da2e6330f3925ff7e460ae41266c384c767: Status 404 returned error can't find the container with id e6c0aa24ad4cce69aab0868f2da72da2e6330f3925ff7e460ae41266c384c767
Jul 16 11:54:12.807501 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:12.807469    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8559bbc9b6-jqwd7" event={"ID":"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3","Type":"ContainerStarted","Data":"43965b121d3fb3261c43e3023415ffe188b0969c90f2709db5f38bceb05f9f65"}
Jul 16 11:54:12.807642 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:12.807515    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8559bbc9b6-jqwd7" event={"ID":"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3","Type":"ContainerStarted","Data":"e6c0aa24ad4cce69aab0868f2da72da2e6330f3925ff7e460ae41266c384c767"}
Jul 16 11:54:12.826189 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:12.826141    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8559bbc9b6-jqwd7" podStartSLOduration=1.826125923 podStartE2EDuration="1.826125923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:54:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:54:12.825108049 +0000 UTC m=+181.459902120" watchObservedRunningTime="2026-07-16 11:54:12.826125923 +0000 UTC m=+181.460919993"
Jul 16 11:54:21.858243 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:21.858211    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:21.858776 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:21.858267    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:21.862937 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:21.862913    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:22.851394 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:22.851367    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:54:22.903127 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:22.903086    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69f888d55b-ctd95"]
Jul 16 11:54:47.925870 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:47.925826    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69f888d55b-ctd95" podUID="39fc12d3-4323-41d3-bae1-7681e87c9ff5" containerName="console" containerID="cri-o://7f3463eb9fb7298116b1afd59ba3b4113e07ad4127abdf0e10c01944c552aa5f" gracePeriod=15
Jul 16 11:54:48.172912 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.172886    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:54:48.249587 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.249494    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-oauth-config\") pod \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") "
Jul 16 11:54:48.249587 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.249541    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-trusted-ca-bundle\") pod \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") "
Jul 16 11:54:48.249587 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.249571    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-oauth-serving-cert\") pod \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") "
Jul 16 11:54:48.249861 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.249614    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-serving-cert\") pod \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") "
Jul 16 11:54:48.249861 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.249664    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-config\") pod \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") "
Jul 16 11:54:48.249861 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.249728    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-service-ca\") pod \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") "
Jul 16 11:54:48.249861 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.249749    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpwh4\" (UniqueName: \"kubernetes.io/projected/39fc12d3-4323-41d3-bae1-7681e87c9ff5-kube-api-access-gpwh4\") pod \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\" (UID: \"39fc12d3-4323-41d3-bae1-7681e87c9ff5\") "
Jul 16 11:54:48.250031 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.250007    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "39fc12d3-4323-41d3-bae1-7681e87c9ff5" (UID: "39fc12d3-4323-41d3-bae1-7681e87c9ff5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:54:48.250115 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.250080    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "39fc12d3-4323-41d3-bae1-7681e87c9ff5" (UID: "39fc12d3-4323-41d3-bae1-7681e87c9ff5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:54:48.250115 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.250090    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-config" (OuterVolumeSpecName: "console-config") pod "39fc12d3-4323-41d3-bae1-7681e87c9ff5" (UID: "39fc12d3-4323-41d3-bae1-7681e87c9ff5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:54:48.250485 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.250241    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-service-ca" (OuterVolumeSpecName: "service-ca") pod "39fc12d3-4323-41d3-bae1-7681e87c9ff5" (UID: "39fc12d3-4323-41d3-bae1-7681e87c9ff5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:54:48.252007 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.251984    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "39fc12d3-4323-41d3-bae1-7681e87c9ff5" (UID: "39fc12d3-4323-41d3-bae1-7681e87c9ff5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:48.252082 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.252010    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "39fc12d3-4323-41d3-bae1-7681e87c9ff5" (UID: "39fc12d3-4323-41d3-bae1-7681e87c9ff5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:48.252161 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.252144    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39fc12d3-4323-41d3-bae1-7681e87c9ff5-kube-api-access-gpwh4" (OuterVolumeSpecName: "kube-api-access-gpwh4") pod "39fc12d3-4323-41d3-bae1-7681e87c9ff5" (UID: "39fc12d3-4323-41d3-bae1-7681e87c9ff5"). InnerVolumeSpecName "kube-api-access-gpwh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:54:48.350681 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.350632    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-config\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:54:48.350681 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.350674    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-service-ca\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:54:48.350681 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.350683    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpwh4\" (UniqueName: \"kubernetes.io/projected/39fc12d3-4323-41d3-bae1-7681e87c9ff5-kube-api-access-gpwh4\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:54:48.350681 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.350694    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-oauth-config\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:54:48.350931 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.350704    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-trusted-ca-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:54:48.350931 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.350712    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39fc12d3-4323-41d3-bae1-7681e87c9ff5-oauth-serving-cert\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:54:48.350931 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.350719    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39fc12d3-4323-41d3-bae1-7681e87c9ff5-console-serving-cert\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:54:48.938120 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.938088    2564 generic.go:356] "Generic (PLEG): container finished" podID="39fc12d3-4323-41d3-bae1-7681e87c9ff5" containerID="7f3463eb9fb7298116b1afd59ba3b4113e07ad4127abdf0e10c01944c552aa5f" exitCode=0
Jul 16 11:54:48.938545 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.938137    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f888d55b-ctd95"
Jul 16 11:54:48.938545 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.938151    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f888d55b-ctd95" event={"ID":"39fc12d3-4323-41d3-bae1-7681e87c9ff5","Type":"ContainerDied","Data":"7f3463eb9fb7298116b1afd59ba3b4113e07ad4127abdf0e10c01944c552aa5f"}
Jul 16 11:54:48.938545 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.938190    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f888d55b-ctd95" event={"ID":"39fc12d3-4323-41d3-bae1-7681e87c9ff5","Type":"ContainerDied","Data":"31593b87fa6c0dd03b19b2b208c2670c0cf009f48118b36036b5e64e13aafe81"}
Jul 16 11:54:48.938545 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.938208    2564 scope.go:117] "RemoveContainer" containerID="7f3463eb9fb7298116b1afd59ba3b4113e07ad4127abdf0e10c01944c552aa5f"
Jul 16 11:54:48.947012 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.946997    2564 scope.go:117] "RemoveContainer" containerID="7f3463eb9fb7298116b1afd59ba3b4113e07ad4127abdf0e10c01944c552aa5f"
Jul 16 11:54:48.947258 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:54:48.947239    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f3463eb9fb7298116b1afd59ba3b4113e07ad4127abdf0e10c01944c552aa5f\": container with ID starting with 7f3463eb9fb7298116b1afd59ba3b4113e07ad4127abdf0e10c01944c552aa5f not found: ID does not exist" containerID="7f3463eb9fb7298116b1afd59ba3b4113e07ad4127abdf0e10c01944c552aa5f"
Jul 16 11:54:48.947317 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.947266    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f3463eb9fb7298116b1afd59ba3b4113e07ad4127abdf0e10c01944c552aa5f"} err="failed to get container status \"7f3463eb9fb7298116b1afd59ba3b4113e07ad4127abdf0e10c01944c552aa5f\": rpc error: code = NotFound desc = could not find container \"7f3463eb9fb7298116b1afd59ba3b4113e07ad4127abdf0e10c01944c552aa5f\": container with ID starting with 7f3463eb9fb7298116b1afd59ba3b4113e07ad4127abdf0e10c01944c552aa5f not found: ID does not exist"
Jul 16 11:54:48.963879 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.963849    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69f888d55b-ctd95"]
Jul 16 11:54:48.970068 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:48.970048    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69f888d55b-ctd95"]
Jul 16 11:54:49.853658 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:54:49.853618    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39fc12d3-4323-41d3-bae1-7681e87c9ff5" path="/var/lib/kubelet/pods/39fc12d3-4323-41d3-bae1-7681e87c9ff5/volumes"
Jul 16 11:55:17.133217 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.133185    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79f9bf858b-lhr7g"]
Jul 16 11:55:17.133596 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.133480    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39fc12d3-4323-41d3-bae1-7681e87c9ff5" containerName="console"
Jul 16 11:55:17.133596 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.133492    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="39fc12d3-4323-41d3-bae1-7681e87c9ff5" containerName="console"
Jul 16 11:55:17.133596 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.133558    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="39fc12d3-4323-41d3-bae1-7681e87c9ff5" containerName="console"
Jul 16 11:55:17.137541 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.137525    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.168699 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.168675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fvjs\" (UniqueName: \"kubernetes.io/projected/1fda5593-856d-4c30-a9b4-3eefb959d8d6-kube-api-access-6fvjs\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.168806 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.168703    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-config\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.168806 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.168726    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-serving-cert\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.168806 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.168741    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-oauth-serving-cert\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.168806 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.168777    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-service-ca\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.168806 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.168798    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-oauth-config\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.168981 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.168840    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-trusted-ca-bundle\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.183803 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.183773    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79f9bf858b-lhr7g"]
Jul 16 11:55:17.270036 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.270010    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-oauth-config\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.270144 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.270053    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-trusted-ca-bundle\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.270144 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.270077    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fvjs\" (UniqueName: \"kubernetes.io/projected/1fda5593-856d-4c30-a9b4-3eefb959d8d6-kube-api-access-6fvjs\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.270144 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.270102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-config\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.270144 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.270132    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-serving-cert\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.270366 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.270161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-oauth-serving-cert\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.270366 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.270207    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-service-ca\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.270933 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.270911    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-config\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.271022 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.270941    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-service-ca\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.271062 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.271028    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-trusted-ca-bundle\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.271095 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.271065    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-oauth-serving-cert\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.272568 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.272542    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-serving-cert\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.272568 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.272558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-oauth-config\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.280941 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.280920    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fvjs\" (UniqueName: \"kubernetes.io/projected/1fda5593-856d-4c30-a9b4-3eefb959d8d6-kube-api-access-6fvjs\") pod \"console-79f9bf858b-lhr7g\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") " pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.446248 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.446187    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:17.585083 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:17.585057    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79f9bf858b-lhr7g"]
Jul 16 11:55:17.588294 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:55:17.588272    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fda5593_856d_4c30_a9b4_3eefb959d8d6.slice/crio-187e71b66b1c3e9adeeaa1eb464b4a308acd0d69b99eb2e1c1e4ae1e8bff5e79 WatchSource:0}: Error finding container 187e71b66b1c3e9adeeaa1eb464b4a308acd0d69b99eb2e1c1e4ae1e8bff5e79: Status 404 returned error can't find the container with id 187e71b66b1c3e9adeeaa1eb464b4a308acd0d69b99eb2e1c1e4ae1e8bff5e79
Jul 16 11:55:18.041094 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:18.041052    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f9bf858b-lhr7g" event={"ID":"1fda5593-856d-4c30-a9b4-3eefb959d8d6","Type":"ContainerStarted","Data":"b97b61d67e57c16f32673f4b1d97afb63f0c449e5469697d7bec702f879e3981"}
Jul 16 11:55:18.041289 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:18.041143    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f9bf858b-lhr7g" event={"ID":"1fda5593-856d-4c30-a9b4-3eefb959d8d6","Type":"ContainerStarted","Data":"187e71b66b1c3e9adeeaa1eb464b4a308acd0d69b99eb2e1c1e4ae1e8bff5e79"}
Jul 16 11:55:18.072118 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:18.072071    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79f9bf858b-lhr7g" podStartSLOduration=1.072057527 podStartE2EDuration="1.072057527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:55:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:55:18.069883405 +0000 UTC m=+246.704677481" watchObservedRunningTime="2026-07-16 11:55:18.072057527 +0000 UTC m=+246.706851660"
Jul 16 11:55:27.446792 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:27.446760    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:27.447203 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:27.446811    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:27.451087 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:27.451068    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:28.079685 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:28.079660    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 11:55:28.146666 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:28.146633    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8559bbc9b6-jqwd7"]
Jul 16 11:55:53.166863 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.166802    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8559bbc9b6-jqwd7" podUID="d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3" containerName="console" containerID="cri-o://43965b121d3fb3261c43e3023415ffe188b0969c90f2709db5f38bceb05f9f65" gracePeriod=15
Jul 16 11:55:53.411024 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.410991    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:55:53.560561 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.560468    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-service-ca\") pod \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") "
Jul 16 11:55:53.560561 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.560521    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-config\") pod \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") "
Jul 16 11:55:53.560561 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.560547    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2pjf\" (UniqueName: \"kubernetes.io/projected/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-kube-api-access-m2pjf\") pod \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") "
Jul 16 11:55:53.560561 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.560563    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-oauth-serving-cert\") pod \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") "
Jul 16 11:55:53.560819 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.560690    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-trusted-ca-bundle\") pod \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") "
Jul 16 11:55:53.560819 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.560744    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-oauth-config\") pod \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") "
Jul 16 11:55:53.560819 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.560810    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-serving-cert\") pod \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\" (UID: \"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3\") "
Jul 16 11:55:53.560964 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.560929    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-service-ca" (OuterVolumeSpecName: "service-ca") pod "d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3" (UID: "d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:55:53.561019 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.560960    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3" (UID: "d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:55:53.561117 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.561096    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-service-ca\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:55:53.561117 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.561098    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-config" (OuterVolumeSpecName: "console-config") pod "d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3" (UID: "d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:55:53.561117 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.561116    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-oauth-serving-cert\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:55:53.561294 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.561151    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3" (UID: "d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:55:53.563155 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.563122    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3" (UID: "d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:55:53.563155 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.563141    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-kube-api-access-m2pjf" (OuterVolumeSpecName: "kube-api-access-m2pjf") pod "d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3" (UID: "d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3"). InnerVolumeSpecName "kube-api-access-m2pjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:55:53.563364 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.563346    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3" (UID: "d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:55:53.662185 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.662147    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-config\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:55:53.662185 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.662178    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2pjf\" (UniqueName: \"kubernetes.io/projected/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-kube-api-access-m2pjf\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:55:53.662185 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.662187    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-trusted-ca-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:55:53.662443 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.662197    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-oauth-config\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:55:53.662443 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:53.662206    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3-console-serving-cert\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:55:54.179021 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:54.178986    2564 generic.go:356] "Generic (PLEG): container finished" podID="d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3" containerID="43965b121d3fb3261c43e3023415ffe188b0969c90f2709db5f38bceb05f9f65" exitCode=0
Jul 16 11:55:54.179439 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:54.179035    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8559bbc9b6-jqwd7"
Jul 16 11:55:54.179439 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:54.179054    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8559bbc9b6-jqwd7" event={"ID":"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3","Type":"ContainerDied","Data":"43965b121d3fb3261c43e3023415ffe188b0969c90f2709db5f38bceb05f9f65"}
Jul 16 11:55:54.179439 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:54.179096    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8559bbc9b6-jqwd7" event={"ID":"d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3","Type":"ContainerDied","Data":"e6c0aa24ad4cce69aab0868f2da72da2e6330f3925ff7e460ae41266c384c767"}
Jul 16 11:55:54.179439 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:54.179115    2564 scope.go:117] "RemoveContainer" containerID="43965b121d3fb3261c43e3023415ffe188b0969c90f2709db5f38bceb05f9f65"
Jul 16 11:55:54.187447 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:54.187423    2564 scope.go:117] "RemoveContainer" containerID="43965b121d3fb3261c43e3023415ffe188b0969c90f2709db5f38bceb05f9f65"
Jul 16 11:55:54.187718 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:55:54.187700    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43965b121d3fb3261c43e3023415ffe188b0969c90f2709db5f38bceb05f9f65\": container with ID starting with 43965b121d3fb3261c43e3023415ffe188b0969c90f2709db5f38bceb05f9f65 not found: ID does not exist" containerID="43965b121d3fb3261c43e3023415ffe188b0969c90f2709db5f38bceb05f9f65"
Jul 16 11:55:54.187790 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:54.187724    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43965b121d3fb3261c43e3023415ffe188b0969c90f2709db5f38bceb05f9f65"} err="failed to get container status \"43965b121d3fb3261c43e3023415ffe188b0969c90f2709db5f38bceb05f9f65\": rpc error: code = NotFound desc = could not find container \"43965b121d3fb3261c43e3023415ffe188b0969c90f2709db5f38bceb05f9f65\": container with ID starting with 43965b121d3fb3261c43e3023415ffe188b0969c90f2709db5f38bceb05f9f65 not found: ID does not exist"
Jul 16 11:55:54.197582 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:54.197554    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8559bbc9b6-jqwd7"]
Jul 16 11:55:54.201860 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:54.201836    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8559bbc9b6-jqwd7"]
Jul 16 11:55:55.853727 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:55:55.853695    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3" path="/var/lib/kubelet/pods/d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3/volumes"
Jul 16 11:56:11.711849 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:11.711814    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 11:56:11.715367 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:11.715342    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 11:56:11.718630 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:11.718611    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 11:56:23.222547 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.222510    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4"]
Jul 16 11:56:23.225071 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.222795    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3" containerName="console"
Jul 16 11:56:23.225071 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.222807    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3" containerName="console"
Jul 16 11:56:23.225071 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.222872    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d42ceb1d-9e7b-4e09-b6e7-d905aab17bb3" containerName="console"
Jul 16 11:56:23.226096 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.226079    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4"
Jul 16 11:56:23.229553 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.229526    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 16 11:56:23.229718 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.229526    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 16 11:56:23.230184 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.230163    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-twtbb\""
Jul 16 11:56:23.235805 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.235735    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4"]
Jul 16 11:56:23.288279 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.288249    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb87f44b-d739-4f87-8ab0-1b0640542ac1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4\" (UID: \"fb87f44b-d739-4f87-8ab0-1b0640542ac1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4"
Jul 16 11:56:23.288279 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.288284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb87f44b-d739-4f87-8ab0-1b0640542ac1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4\" (UID: \"fb87f44b-d739-4f87-8ab0-1b0640542ac1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4"
Jul 16 11:56:23.288536 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.288350    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5978d\" (UniqueName: \"kubernetes.io/projected/fb87f44b-d739-4f87-8ab0-1b0640542ac1-kube-api-access-5978d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4\" (UID: \"fb87f44b-d739-4f87-8ab0-1b0640542ac1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4"
Jul 16 11:56:23.388725 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.388685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5978d\" (UniqueName: \"kubernetes.io/projected/fb87f44b-d739-4f87-8ab0-1b0640542ac1-kube-api-access-5978d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4\" (UID: \"fb87f44b-d739-4f87-8ab0-1b0640542ac1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4"
Jul 16 11:56:23.388887 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.388768    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb87f44b-d739-4f87-8ab0-1b0640542ac1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4\" (UID: \"fb87f44b-d739-4f87-8ab0-1b0640542ac1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4"
Jul 16 11:56:23.388887 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.388802    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb87f44b-d739-4f87-8ab0-1b0640542ac1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4\" (UID: \"fb87f44b-d739-4f87-8ab0-1b0640542ac1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4"
Jul 16 11:56:23.389173 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.389152    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb87f44b-d739-4f87-8ab0-1b0640542ac1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4\" (UID: \"fb87f44b-d739-4f87-8ab0-1b0640542ac1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4"
Jul 16 11:56:23.389249 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.389220    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb87f44b-d739-4f87-8ab0-1b0640542ac1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4\" (UID: \"fb87f44b-d739-4f87-8ab0-1b0640542ac1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4"
Jul 16 11:56:23.398508 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.398471    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5978d\" (UniqueName: \"kubernetes.io/projected/fb87f44b-d739-4f87-8ab0-1b0640542ac1-kube-api-access-5978d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4\" (UID: \"fb87f44b-d739-4f87-8ab0-1b0640542ac1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4"
Jul 16 11:56:23.536313 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.536217    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4"
Jul 16 11:56:23.676677 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.676638    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4"]
Jul 16 11:56:23.679654 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:56:23.679624    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb87f44b_d739_4f87_8ab0_1b0640542ac1.slice/crio-30b8a0cd8c76742155f7c825ad5fb1581698f9584f1ca8b767a3f935ee3aac1d WatchSource:0}: Error finding container 30b8a0cd8c76742155f7c825ad5fb1581698f9584f1ca8b767a3f935ee3aac1d: Status 404 returned error can't find the container with id 30b8a0cd8c76742155f7c825ad5fb1581698f9584f1ca8b767a3f935ee3aac1d
Jul 16 11:56:23.681467 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:23.681452    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 11:56:24.290856 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:24.290811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4" event={"ID":"fb87f44b-d739-4f87-8ab0-1b0640542ac1","Type":"ContainerStarted","Data":"30b8a0cd8c76742155f7c825ad5fb1581698f9584f1ca8b767a3f935ee3aac1d"}
Jul 16 11:56:30.316181 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:30.316143    2564 generic.go:356] "Generic (PLEG): container finished" podID="fb87f44b-d739-4f87-8ab0-1b0640542ac1" containerID="f7acaf5d204e001d3d7e8621ac04665fb8eeb6e241620332bf6dd93547ce9fce" exitCode=0
Jul 16 11:56:30.316677 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:30.316191    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4" event={"ID":"fb87f44b-d739-4f87-8ab0-1b0640542ac1","Type":"ContainerDied","Data":"f7acaf5d204e001d3d7e8621ac04665fb8eeb6e241620332bf6dd93547ce9fce"}
Jul 16 11:56:33.330387 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:33.330347    2564 generic.go:356] "Generic (PLEG): container finished" podID="fb87f44b-d739-4f87-8ab0-1b0640542ac1" containerID="39f0356343b5c8a8ef9d92c8d705e93523693b94387b7b2b968c67e6d8dd6975" exitCode=0
Jul 16 11:56:33.330826 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:33.330424    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4" event={"ID":"fb87f44b-d739-4f87-8ab0-1b0640542ac1","Type":"ContainerDied","Data":"39f0356343b5c8a8ef9d92c8d705e93523693b94387b7b2b968c67e6d8dd6975"}
Jul 16 11:56:41.368568 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:41.368532    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4" event={"ID":"fb87f44b-d739-4f87-8ab0-1b0640542ac1","Type":"ContainerStarted","Data":"48bca025ac7cef4d111abbd38d3ab6fc667a1ffa6cdd1476abdab4940c60e94f"}
Jul 16 11:56:41.390174 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:41.390120    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4" podStartSLOduration=2.419642405 podStartE2EDuration="18.390103972s" totalImagesPullingTime="15.970461567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:56:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:56:41.389079799 +0000 UTC m=+330.023873881" watchObservedRunningTime="2026-07-16 11:56:41.390103972 +0000 UTC m=+330.024898042"
Jul 16 11:56:42.373993 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:42.373957    2564 generic.go:356] "Generic (PLEG): container finished" podID="fb87f44b-d739-4f87-8ab0-1b0640542ac1" containerID="48bca025ac7cef4d111abbd38d3ab6fc667a1ffa6cdd1476abdab4940c60e94f" exitCode=0
Jul 16 11:56:42.374401 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:42.374028    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4" event={"ID":"fb87f44b-d739-4f87-8ab0-1b0640542ac1","Type":"ContainerDied","Data":"48bca025ac7cef4d111abbd38d3ab6fc667a1ffa6cdd1476abdab4940c60e94f"}
Jul 16 11:56:43.503070 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:43.503037    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4"
Jul 16 11:56:43.558503 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:43.558475    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb87f44b-d739-4f87-8ab0-1b0640542ac1-bundle\") pod \"fb87f44b-d739-4f87-8ab0-1b0640542ac1\" (UID: \"fb87f44b-d739-4f87-8ab0-1b0640542ac1\") "
Jul 16 11:56:43.558689 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:43.558554    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb87f44b-d739-4f87-8ab0-1b0640542ac1-util\") pod \"fb87f44b-d739-4f87-8ab0-1b0640542ac1\" (UID: \"fb87f44b-d739-4f87-8ab0-1b0640542ac1\") "
Jul 16 11:56:43.558689 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:43.558580    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5978d\" (UniqueName: \"kubernetes.io/projected/fb87f44b-d739-4f87-8ab0-1b0640542ac1-kube-api-access-5978d\") pod \"fb87f44b-d739-4f87-8ab0-1b0640542ac1\" (UID: \"fb87f44b-d739-4f87-8ab0-1b0640542ac1\") "
Jul 16 11:56:43.559174 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:43.559146    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb87f44b-d739-4f87-8ab0-1b0640542ac1-bundle" (OuterVolumeSpecName: "bundle") pod "fb87f44b-d739-4f87-8ab0-1b0640542ac1" (UID: "fb87f44b-d739-4f87-8ab0-1b0640542ac1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:56:43.560850 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:43.560828    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb87f44b-d739-4f87-8ab0-1b0640542ac1-kube-api-access-5978d" (OuterVolumeSpecName: "kube-api-access-5978d") pod "fb87f44b-d739-4f87-8ab0-1b0640542ac1" (UID: "fb87f44b-d739-4f87-8ab0-1b0640542ac1"). InnerVolumeSpecName "kube-api-access-5978d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:56:43.563795 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:43.563769    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb87f44b-d739-4f87-8ab0-1b0640542ac1-util" (OuterVolumeSpecName: "util") pod "fb87f44b-d739-4f87-8ab0-1b0640542ac1" (UID: "fb87f44b-d739-4f87-8ab0-1b0640542ac1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:56:43.659858 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:43.659757    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb87f44b-d739-4f87-8ab0-1b0640542ac1-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:56:43.659858 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:43.659801    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb87f44b-d739-4f87-8ab0-1b0640542ac1-util\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:56:43.659858 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:43.659811    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5978d\" (UniqueName: \"kubernetes.io/projected/fb87f44b-d739-4f87-8ab0-1b0640542ac1-kube-api-access-5978d\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:56:44.383174 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:44.383145    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4"
Jul 16 11:56:44.383174 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:44.383158    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r7kh4" event={"ID":"fb87f44b-d739-4f87-8ab0-1b0640542ac1","Type":"ContainerDied","Data":"30b8a0cd8c76742155f7c825ad5fb1581698f9584f1ca8b767a3f935ee3aac1d"}
Jul 16 11:56:44.383422 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:44.383205    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30b8a0cd8c76742155f7c825ad5fb1581698f9584f1ca8b767a3f935ee3aac1d"
Jul 16 11:56:51.845713 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:51.845680    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f89lv"]
Jul 16 11:56:51.846111 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:51.845965    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb87f44b-d739-4f87-8ab0-1b0640542ac1" containerName="pull"
Jul 16 11:56:51.846111 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:51.845975    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb87f44b-d739-4f87-8ab0-1b0640542ac1" containerName="pull"
Jul 16 11:56:51.846111 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:51.845988    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb87f44b-d739-4f87-8ab0-1b0640542ac1" containerName="extract"
Jul 16 11:56:51.846111 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:51.845993    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb87f44b-d739-4f87-8ab0-1b0640542ac1" containerName="extract"
Jul 16 11:56:51.846111 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:51.846005    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb87f44b-d739-4f87-8ab0-1b0640542ac1" containerName="util"
Jul 16 11:56:51.846111 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:51.846010    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb87f44b-d739-4f87-8ab0-1b0640542ac1" containerName="util"
Jul 16 11:56:51.846111 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:51.846057    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb87f44b-d739-4f87-8ab0-1b0640542ac1" containerName="extract"
Jul 16 11:56:51.848104 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:51.848089    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f89lv"
Jul 16 11:56:51.851054 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:51.851026    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 16 11:56:51.851266 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:51.851252    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 16 11:56:51.851382 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:51.851363    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-762v9\""
Jul 16 11:56:51.863626 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:51.863598    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f89lv"]
Jul 16 11:56:51.931432 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:51.931396    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4590bcf8-3e67-4e49-a0e6-6d7300b9bc56-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f89lv\" (UID: \"4590bcf8-3e67-4e49-a0e6-6d7300b9bc56\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f89lv"
Jul 16 11:56:51.931621 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:51.931569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtwpd\" (UniqueName: \"kubernetes.io/projected/4590bcf8-3e67-4e49-a0e6-6d7300b9bc56-kube-api-access-rtwpd\") pod \"cert-manager-operator-controller-manager-55c444bf86-f89lv\" (UID: \"4590bcf8-3e67-4e49-a0e6-6d7300b9bc56\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f89lv"
Jul 16 11:56:52.032476 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:52.032432    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4590bcf8-3e67-4e49-a0e6-6d7300b9bc56-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f89lv\" (UID: \"4590bcf8-3e67-4e49-a0e6-6d7300b9bc56\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f89lv"
Jul 16 11:56:52.032634 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:52.032513    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtwpd\" (UniqueName: \"kubernetes.io/projected/4590bcf8-3e67-4e49-a0e6-6d7300b9bc56-kube-api-access-rtwpd\") pod \"cert-manager-operator-controller-manager-55c444bf86-f89lv\" (UID: \"4590bcf8-3e67-4e49-a0e6-6d7300b9bc56\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f89lv"
Jul 16 11:56:52.032814 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:52.032795    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4590bcf8-3e67-4e49-a0e6-6d7300b9bc56-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f89lv\" (UID: \"4590bcf8-3e67-4e49-a0e6-6d7300b9bc56\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f89lv"
Jul 16 11:56:52.042022 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:52.041990    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtwpd\" (UniqueName: \"kubernetes.io/projected/4590bcf8-3e67-4e49-a0e6-6d7300b9bc56-kube-api-access-rtwpd\") pod \"cert-manager-operator-controller-manager-55c444bf86-f89lv\" (UID: \"4590bcf8-3e67-4e49-a0e6-6d7300b9bc56\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f89lv"
Jul 16 11:56:52.158153 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:52.158113    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f89lv"
Jul 16 11:56:52.299374 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:52.299260    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f89lv"]
Jul 16 11:56:52.301652 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:56:52.301612    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4590bcf8_3e67_4e49_a0e6_6d7300b9bc56.slice/crio-548b24a83f7a86adc04c2ba0e351388c8f91c102b699a797cb2add3d8f325d8b WatchSource:0}: Error finding container 548b24a83f7a86adc04c2ba0e351388c8f91c102b699a797cb2add3d8f325d8b: Status 404 returned error can't find the container with id 548b24a83f7a86adc04c2ba0e351388c8f91c102b699a797cb2add3d8f325d8b
Jul 16 11:56:52.412403 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:52.412302    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f89lv" event={"ID":"4590bcf8-3e67-4e49-a0e6-6d7300b9bc56","Type":"ContainerStarted","Data":"548b24a83f7a86adc04c2ba0e351388c8f91c102b699a797cb2add3d8f325d8b"}
Jul 16 11:56:54.424005 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:54.423972    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f89lv" event={"ID":"4590bcf8-3e67-4e49-a0e6-6d7300b9bc56","Type":"ContainerStarted","Data":"70ce497a8e3dc7b50e74c03cffabc6e4a180720a792088dc3bb9adf048cdc81b"}
Jul 16 11:56:54.454582 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:54.454507    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f89lv" podStartSLOduration=2.033088555 podStartE2EDuration="3.454486423s" totalImagesPullingTime="1.421397868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:56:54.450896274 +0000 UTC m=+343.085690370" watchObservedRunningTime="2026-07-16 11:56:54.454486423 +0000 UTC m=+343.089280498"
Jul 16 11:56:55.645028 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.644991    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn"]
Jul 16 11:56:55.647572 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.647554    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn"
Jul 16 11:56:55.652426 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.652404    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 16 11:56:55.652839 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.652805    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-twtbb\""
Jul 16 11:56:55.652942 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.652805    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 16 11:56:55.689545 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.689507    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn"]
Jul 16 11:56:55.764433 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.764392    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcq4w\" (UniqueName: \"kubernetes.io/projected/5c370eaf-792f-472c-bb9a-2d25a975280e-kube-api-access-dcq4w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn\" (UID: \"5c370eaf-792f-472c-bb9a-2d25a975280e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn"
Jul 16 11:56:55.764601 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.764520    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c370eaf-792f-472c-bb9a-2d25a975280e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn\" (UID: \"5c370eaf-792f-472c-bb9a-2d25a975280e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn"
Jul 16 11:56:55.764601 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.764551    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c370eaf-792f-472c-bb9a-2d25a975280e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn\" (UID: \"5c370eaf-792f-472c-bb9a-2d25a975280e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn"
Jul 16 11:56:55.865228 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.865192    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcq4w\" (UniqueName: \"kubernetes.io/projected/5c370eaf-792f-472c-bb9a-2d25a975280e-kube-api-access-dcq4w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn\" (UID: \"5c370eaf-792f-472c-bb9a-2d25a975280e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn"
Jul 16 11:56:55.865420 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.865269    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c370eaf-792f-472c-bb9a-2d25a975280e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn\" (UID: \"5c370eaf-792f-472c-bb9a-2d25a975280e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn"
Jul 16 11:56:55.865420 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.865286    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c370eaf-792f-472c-bb9a-2d25a975280e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn\" (UID: \"5c370eaf-792f-472c-bb9a-2d25a975280e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn"
Jul 16 11:56:55.865699 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.865678    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c370eaf-792f-472c-bb9a-2d25a975280e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn\" (UID: \"5c370eaf-792f-472c-bb9a-2d25a975280e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn"
Jul 16 11:56:55.865736 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.865700    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c370eaf-792f-472c-bb9a-2d25a975280e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn\" (UID: \"5c370eaf-792f-472c-bb9a-2d25a975280e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn"
Jul 16 11:56:55.883827 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.883793    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ltrlp"]
Jul 16 11:56:55.886170 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.886151    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ltrlp"
Jul 16 11:56:55.893685 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.893660    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcq4w\" (UniqueName: \"kubernetes.io/projected/5c370eaf-792f-472c-bb9a-2d25a975280e-kube-api-access-dcq4w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn\" (UID: \"5c370eaf-792f-472c-bb9a-2d25a975280e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn"
Jul 16 11:56:55.895307 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.895249    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-nf2p9\""
Jul 16 11:56:55.895645 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.895626    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 16 11:56:55.895696 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.895678    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 16 11:56:55.957023 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.956988    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn"
Jul 16 11:56:55.966258 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.966227    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee8c198c-7c7f-4167-9d4c-4c36a7dbc462-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ltrlp\" (UID: \"ee8c198c-7c7f-4167-9d4c-4c36a7dbc462\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ltrlp"
Jul 16 11:56:55.966406 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:55.966295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8249f\" (UniqueName: \"kubernetes.io/projected/ee8c198c-7c7f-4167-9d4c-4c36a7dbc462-kube-api-access-8249f\") pod \"cert-manager-webhook-6486ffd997-ltrlp\" (UID: \"ee8c198c-7c7f-4167-9d4c-4c36a7dbc462\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ltrlp"
Jul 16 11:56:56.027354 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:56.027308    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ltrlp"]
Jul 16 11:56:56.067570 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:56.067536    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee8c198c-7c7f-4167-9d4c-4c36a7dbc462-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ltrlp\" (UID: \"ee8c198c-7c7f-4167-9d4c-4c36a7dbc462\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ltrlp"
Jul 16 11:56:56.067762 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:56.067591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8249f\" (UniqueName: \"kubernetes.io/projected/ee8c198c-7c7f-4167-9d4c-4c36a7dbc462-kube-api-access-8249f\") pod \"cert-manager-webhook-6486ffd997-ltrlp\" (UID: \"ee8c198c-7c7f-4167-9d4c-4c36a7dbc462\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ltrlp"
Jul 16 11:56:56.079567 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:56.079540    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8249f\" (UniqueName: \"kubernetes.io/projected/ee8c198c-7c7f-4167-9d4c-4c36a7dbc462-kube-api-access-8249f\") pod \"cert-manager-webhook-6486ffd997-ltrlp\" (UID: \"ee8c198c-7c7f-4167-9d4c-4c36a7dbc462\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ltrlp"
Jul 16 11:56:56.080012 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:56.079990    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee8c198c-7c7f-4167-9d4c-4c36a7dbc462-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ltrlp\" (UID: \"ee8c198c-7c7f-4167-9d4c-4c36a7dbc462\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ltrlp"
Jul 16 11:56:56.102421 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:56.102383    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn"]
Jul 16 11:56:56.105056 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:56:56.105024    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c370eaf_792f_472c_bb9a_2d25a975280e.slice/crio-9d5f6219083a1539a1cf3694c17ed2895b21b4efea269388caf8fb6f90cd73b5 WatchSource:0}: Error finding container 9d5f6219083a1539a1cf3694c17ed2895b21b4efea269388caf8fb6f90cd73b5: Status 404 returned error can't find the container with id 9d5f6219083a1539a1cf3694c17ed2895b21b4efea269388caf8fb6f90cd73b5
Jul 16 11:56:56.211476 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:56.211451    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ltrlp"
Jul 16 11:56:56.387406 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:56.387379    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ltrlp"]
Jul 16 11:56:56.389359 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:56:56.389302    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee8c198c_7c7f_4167_9d4c_4c36a7dbc462.slice/crio-d88af84f9f574e1d8d3c35937b5cbf2314d34ddbcdb61e073af570b6330bf2b2 WatchSource:0}: Error finding container d88af84f9f574e1d8d3c35937b5cbf2314d34ddbcdb61e073af570b6330bf2b2: Status 404 returned error can't find the container with id d88af84f9f574e1d8d3c35937b5cbf2314d34ddbcdb61e073af570b6330bf2b2
Jul 16 11:56:56.434127 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:56.434023    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ltrlp" event={"ID":"ee8c198c-7c7f-4167-9d4c-4c36a7dbc462","Type":"ContainerStarted","Data":"d88af84f9f574e1d8d3c35937b5cbf2314d34ddbcdb61e073af570b6330bf2b2"}
Jul 16 11:56:56.435516 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:56.435488    2564 generic.go:356] "Generic (PLEG): container finished" podID="5c370eaf-792f-472c-bb9a-2d25a975280e" containerID="f462c69025288e46c2fd0081f32f5d4e8dbb3315053194e5e2270d060c9aaf85" exitCode=0
Jul 16 11:56:56.435650 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:56.435517    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn" event={"ID":"5c370eaf-792f-472c-bb9a-2d25a975280e","Type":"ContainerDied","Data":"f462c69025288e46c2fd0081f32f5d4e8dbb3315053194e5e2270d060c9aaf85"}
Jul 16 11:56:56.435650 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:56:56.435566    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn" event={"ID":"5c370eaf-792f-472c-bb9a-2d25a975280e","Type":"ContainerStarted","Data":"9d5f6219083a1539a1cf3694c17ed2895b21b4efea269388caf8fb6f90cd73b5"}
Jul 16 11:57:00.459613 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:00.459579    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ltrlp" event={"ID":"ee8c198c-7c7f-4167-9d4c-4c36a7dbc462","Type":"ContainerStarted","Data":"438b33beac9038274a361a3439b7468e4fc9170d342f006a4a353bd2bb44bb11"}
Jul 16 11:57:00.460102 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:00.459655    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ltrlp"
Jul 16 11:57:00.461413 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:00.461381    2564 generic.go:356] "Generic (PLEG): container finished" podID="5c370eaf-792f-472c-bb9a-2d25a975280e" containerID="1aa3888da5ca2b945535552042638d44529376d07db88536fcc9c2aa28981d62" exitCode=0
Jul 16 11:57:00.461526 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:00.461446    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn" event={"ID":"5c370eaf-792f-472c-bb9a-2d25a975280e","Type":"ContainerDied","Data":"1aa3888da5ca2b945535552042638d44529376d07db88536fcc9c2aa28981d62"}
Jul 16 11:57:00.527965 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:00.527914    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-ltrlp" podStartSLOduration=2.464440796 podStartE2EDuration="5.527899547s" totalImagesPullingTime="3.063458751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:57:00.527632103 +0000 UTC m=+349.162426175" watchObservedRunningTime="2026-07-16 11:57:00.527899547 +0000 UTC m=+349.162693617"
Jul 16 11:57:01.468091 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:01.468057    2564 generic.go:356] "Generic (PLEG): container finished" podID="5c370eaf-792f-472c-bb9a-2d25a975280e" containerID="c5cf5e8d874526b6f55362943e345355979fb6e8c6ac5b0a814b3e1d305acc61" exitCode=0
Jul 16 11:57:01.468535 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:01.468153    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn" event={"ID":"5c370eaf-792f-472c-bb9a-2d25a975280e","Type":"ContainerDied","Data":"c5cf5e8d874526b6f55362943e345355979fb6e8c6ac5b0a814b3e1d305acc61"}
Jul 16 11:57:02.599156 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:02.599131    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn"
Jul 16 11:57:02.732137 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:02.732056    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcq4w\" (UniqueName: \"kubernetes.io/projected/5c370eaf-792f-472c-bb9a-2d25a975280e-kube-api-access-dcq4w\") pod \"5c370eaf-792f-472c-bb9a-2d25a975280e\" (UID: \"5c370eaf-792f-472c-bb9a-2d25a975280e\") "
Jul 16 11:57:02.732137 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:02.732110    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c370eaf-792f-472c-bb9a-2d25a975280e-bundle\") pod \"5c370eaf-792f-472c-bb9a-2d25a975280e\" (UID: \"5c370eaf-792f-472c-bb9a-2d25a975280e\") "
Jul 16 11:57:02.732315 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:02.732193    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c370eaf-792f-472c-bb9a-2d25a975280e-util\") pod \"5c370eaf-792f-472c-bb9a-2d25a975280e\" (UID: \"5c370eaf-792f-472c-bb9a-2d25a975280e\") "
Jul 16 11:57:02.732593 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:02.732547    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c370eaf-792f-472c-bb9a-2d25a975280e-bundle" (OuterVolumeSpecName: "bundle") pod "5c370eaf-792f-472c-bb9a-2d25a975280e" (UID: "5c370eaf-792f-472c-bb9a-2d25a975280e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:57:02.734293 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:02.734274    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c370eaf-792f-472c-bb9a-2d25a975280e-kube-api-access-dcq4w" (OuterVolumeSpecName: "kube-api-access-dcq4w") pod "5c370eaf-792f-472c-bb9a-2d25a975280e" (UID: "5c370eaf-792f-472c-bb9a-2d25a975280e"). InnerVolumeSpecName "kube-api-access-dcq4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:57:02.738406 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:02.738382    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c370eaf-792f-472c-bb9a-2d25a975280e-util" (OuterVolumeSpecName: "util") pod "5c370eaf-792f-472c-bb9a-2d25a975280e" (UID: "5c370eaf-792f-472c-bb9a-2d25a975280e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:57:02.832825 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:02.832788    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c370eaf-792f-472c-bb9a-2d25a975280e-util\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:57:02.832825 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:02.832818    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcq4w\" (UniqueName: \"kubernetes.io/projected/5c370eaf-792f-472c-bb9a-2d25a975280e-kube-api-access-dcq4w\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:57:02.832825 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:02.832829    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c370eaf-792f-472c-bb9a-2d25a975280e-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:57:03.478442 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:03.478411    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn" event={"ID":"5c370eaf-792f-472c-bb9a-2d25a975280e","Type":"ContainerDied","Data":"9d5f6219083a1539a1cf3694c17ed2895b21b4efea269388caf8fb6f90cd73b5"}
Jul 16 11:57:03.478604 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:03.478462    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d5f6219083a1539a1cf3694c17ed2895b21b4efea269388caf8fb6f90cd73b5"
Jul 16 11:57:03.478604 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:03.478422    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8bsn"
Jul 16 11:57:06.470609 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:06.470574    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ltrlp"
Jul 16 11:57:08.943720 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:08.943690    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bwxvt"]
Jul 16 11:57:08.944077 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:08.943967    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c370eaf-792f-472c-bb9a-2d25a975280e" containerName="pull"
Jul 16 11:57:08.944077 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:08.943977    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c370eaf-792f-472c-bb9a-2d25a975280e" containerName="pull"
Jul 16 11:57:08.944077 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:08.943987    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c370eaf-792f-472c-bb9a-2d25a975280e" containerName="extract"
Jul 16 11:57:08.944077 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:08.943993    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c370eaf-792f-472c-bb9a-2d25a975280e" containerName="extract"
Jul 16 11:57:08.944077 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:08.944000    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c370eaf-792f-472c-bb9a-2d25a975280e" containerName="util"
Jul 16 11:57:08.944077 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:08.944006    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c370eaf-792f-472c-bb9a-2d25a975280e" containerName="util"
Jul 16 11:57:08.944077 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:08.944054    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c370eaf-792f-472c-bb9a-2d25a975280e" containerName="extract"
Jul 16 11:57:08.951216 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:08.951197    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bwxvt"
Jul 16 11:57:08.953816 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:08.953790    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 16 11:57:08.953939 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:08.953924    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-l5g7c\""
Jul 16 11:57:08.954816 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:08.954802    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 16 11:57:08.958909 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:08.958887    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bwxvt"]
Jul 16 11:57:09.086229 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:09.086181    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk56b\" (UniqueName: \"kubernetes.io/projected/63e92515-7bce-44df-9050-3ee604acc2e3-kube-api-access-tk56b\") pod \"openshift-lws-operator-fd8ccff4c-bwxvt\" (UID: \"63e92515-7bce-44df-9050-3ee604acc2e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bwxvt"
Jul 16 11:57:09.086229 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:09.086232    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63e92515-7bce-44df-9050-3ee604acc2e3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bwxvt\" (UID: \"63e92515-7bce-44df-9050-3ee604acc2e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bwxvt"
Jul 16 11:57:09.186835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:09.186799    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk56b\" (UniqueName: \"kubernetes.io/projected/63e92515-7bce-44df-9050-3ee604acc2e3-kube-api-access-tk56b\") pod \"openshift-lws-operator-fd8ccff4c-bwxvt\" (UID: \"63e92515-7bce-44df-9050-3ee604acc2e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bwxvt"
Jul 16 11:57:09.186835 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:09.186839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63e92515-7bce-44df-9050-3ee604acc2e3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bwxvt\" (UID: \"63e92515-7bce-44df-9050-3ee604acc2e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bwxvt"
Jul 16 11:57:09.187255 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:09.187239    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63e92515-7bce-44df-9050-3ee604acc2e3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bwxvt\" (UID: \"63e92515-7bce-44df-9050-3ee604acc2e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bwxvt"
Jul 16 11:57:09.196496 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:09.196426    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk56b\" (UniqueName: \"kubernetes.io/projected/63e92515-7bce-44df-9050-3ee604acc2e3-kube-api-access-tk56b\") pod \"openshift-lws-operator-fd8ccff4c-bwxvt\" (UID: \"63e92515-7bce-44df-9050-3ee604acc2e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bwxvt"
Jul 16 11:57:09.261309 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:09.261269    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bwxvt"
Jul 16 11:57:09.401341 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:09.401303    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bwxvt"]
Jul 16 11:57:09.404040 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:57:09.404012    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63e92515_7bce_44df_9050_3ee604acc2e3.slice/crio-68c4ad838f04b150635f4ca8e51b99260b43885edb7ea5da965e7a64bb00241c WatchSource:0}: Error finding container 68c4ad838f04b150635f4ca8e51b99260b43885edb7ea5da965e7a64bb00241c: Status 404 returned error can't find the container with id 68c4ad838f04b150635f4ca8e51b99260b43885edb7ea5da965e7a64bb00241c
Jul 16 11:57:09.505397 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:09.505305    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bwxvt" event={"ID":"63e92515-7bce-44df-9050-3ee604acc2e3","Type":"ContainerStarted","Data":"68c4ad838f04b150635f4ca8e51b99260b43885edb7ea5da965e7a64bb00241c"}
Jul 16 11:57:11.516178 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:11.516139    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bwxvt" event={"ID":"63e92515-7bce-44df-9050-3ee604acc2e3","Type":"ContainerStarted","Data":"511e549d63e72eca67bf5389c39a5e6f770190b46e20b752fbc36e552bae2336"}
Jul 16 11:57:11.551121 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:11.551063    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bwxvt" podStartSLOduration=1.951989439 podStartE2EDuration="3.551042674s" totalImagesPullingTime="1.599053235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:57:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:57:11.548349458 +0000 UTC m=+360.183143538" watchObservedRunningTime="2026-07-16 11:57:11.551042674 +0000 UTC m=+360.185836749"
Jul 16 11:57:14.815676 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:14.815632    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92"]
Jul 16 11:57:14.840243 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:14.840217    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92"]
Jul 16 11:57:14.840415 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:14.840349    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92"
Jul 16 11:57:14.844235 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:14.844216    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 16 11:57:14.844359 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:14.844258    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 16 11:57:14.844806 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:14.844786    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-twtbb\""
Jul 16 11:57:14.929757 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:14.929714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37438178-7991-4b30-a116-256cecb1f870-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92\" (UID: \"37438178-7991-4b30-a116-256cecb1f870\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92"
Jul 16 11:57:14.929945 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:14.929789    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxjrx\" (UniqueName: \"kubernetes.io/projected/37438178-7991-4b30-a116-256cecb1f870-kube-api-access-hxjrx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92\" (UID: \"37438178-7991-4b30-a116-256cecb1f870\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92"
Jul 16 11:57:14.929945 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:14.929830    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37438178-7991-4b30-a116-256cecb1f870-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92\" (UID: \"37438178-7991-4b30-a116-256cecb1f870\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92"
Jul 16 11:57:15.030373 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:15.030320    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37438178-7991-4b30-a116-256cecb1f870-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92\" (UID: \"37438178-7991-4b30-a116-256cecb1f870\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92"
Jul 16 11:57:15.030529 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:15.030380    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxjrx\" (UniqueName: \"kubernetes.io/projected/37438178-7991-4b30-a116-256cecb1f870-kube-api-access-hxjrx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92\" (UID: \"37438178-7991-4b30-a116-256cecb1f870\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92"
Jul 16 11:57:15.030529 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:15.030483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37438178-7991-4b30-a116-256cecb1f870-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92\" (UID: \"37438178-7991-4b30-a116-256cecb1f870\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92"
Jul 16 11:57:15.030696 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:15.030678    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37438178-7991-4b30-a116-256cecb1f870-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92\" (UID: \"37438178-7991-4b30-a116-256cecb1f870\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92"
Jul 16 11:57:15.030754 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:15.030739    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37438178-7991-4b30-a116-256cecb1f870-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92\" (UID: \"37438178-7991-4b30-a116-256cecb1f870\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92"
Jul 16 11:57:15.043487 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:15.043460    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxjrx\" (UniqueName: \"kubernetes.io/projected/37438178-7991-4b30-a116-256cecb1f870-kube-api-access-hxjrx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92\" (UID: \"37438178-7991-4b30-a116-256cecb1f870\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92"
Jul 16 11:57:15.149147 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:15.149127    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92"
Jul 16 11:57:15.309068 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:15.309037    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92"]
Jul 16 11:57:15.312098 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:57:15.312074    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37438178_7991_4b30_a116_256cecb1f870.slice/crio-ccc878e3983731e32fa405abffe188ece31e1c8d2b65c46b5a9fc936c3068a90 WatchSource:0}: Error finding container ccc878e3983731e32fa405abffe188ece31e1c8d2b65c46b5a9fc936c3068a90: Status 404 returned error can't find the container with id ccc878e3983731e32fa405abffe188ece31e1c8d2b65c46b5a9fc936c3068a90
Jul 16 11:57:15.534738 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:15.534704    2564 generic.go:356] "Generic (PLEG): container finished" podID="37438178-7991-4b30-a116-256cecb1f870" containerID="4068c9e20ee285624e107969881619335fbb7d1eaa4553207a9d6995b8bba2ca" exitCode=0
Jul 16 11:57:15.534930 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:15.534797    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92" event={"ID":"37438178-7991-4b30-a116-256cecb1f870","Type":"ContainerDied","Data":"4068c9e20ee285624e107969881619335fbb7d1eaa4553207a9d6995b8bba2ca"}
Jul 16 11:57:15.534930 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:15.534876    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92" event={"ID":"37438178-7991-4b30-a116-256cecb1f870","Type":"ContainerStarted","Data":"ccc878e3983731e32fa405abffe188ece31e1c8d2b65c46b5a9fc936c3068a90"}
Jul 16 11:57:17.545030 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:17.544990    2564 generic.go:356] "Generic (PLEG): container finished" podID="37438178-7991-4b30-a116-256cecb1f870" containerID="3ab1fcf9077620c53416439897f999f89d6c6560410bdfec1def586fc3e559c5" exitCode=0
Jul 16 11:57:17.545537 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:17.545079    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92" event={"ID":"37438178-7991-4b30-a116-256cecb1f870","Type":"ContainerDied","Data":"3ab1fcf9077620c53416439897f999f89d6c6560410bdfec1def586fc3e559c5"}
Jul 16 11:57:18.551439 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:18.551405    2564 generic.go:356] "Generic (PLEG): container finished" podID="37438178-7991-4b30-a116-256cecb1f870" containerID="2958d2ffbdbba49d752b4590ffc6b56eeba21af34a433ff61abe73f417c2b538" exitCode=0
Jul 16 11:57:18.551860 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:18.551449    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92" event={"ID":"37438178-7991-4b30-a116-256cecb1f870","Type":"ContainerDied","Data":"2958d2ffbdbba49d752b4590ffc6b56eeba21af34a433ff61abe73f417c2b538"}
Jul 16 11:57:19.685059 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:19.685036    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92"
Jul 16 11:57:19.760208 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:19.760178    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37438178-7991-4b30-a116-256cecb1f870-bundle\") pod \"37438178-7991-4b30-a116-256cecb1f870\" (UID: \"37438178-7991-4b30-a116-256cecb1f870\") "
Jul 16 11:57:19.760369 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:19.760224    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxjrx\" (UniqueName: \"kubernetes.io/projected/37438178-7991-4b30-a116-256cecb1f870-kube-api-access-hxjrx\") pod \"37438178-7991-4b30-a116-256cecb1f870\" (UID: \"37438178-7991-4b30-a116-256cecb1f870\") "
Jul 16 11:57:19.760900 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:19.760875    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37438178-7991-4b30-a116-256cecb1f870-bundle" (OuterVolumeSpecName: "bundle") pod "37438178-7991-4b30-a116-256cecb1f870" (UID: "37438178-7991-4b30-a116-256cecb1f870"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:57:19.762514 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:19.762490    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37438178-7991-4b30-a116-256cecb1f870-kube-api-access-hxjrx" (OuterVolumeSpecName: "kube-api-access-hxjrx") pod "37438178-7991-4b30-a116-256cecb1f870" (UID: "37438178-7991-4b30-a116-256cecb1f870"). InnerVolumeSpecName "kube-api-access-hxjrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:57:19.860683 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:19.860611    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37438178-7991-4b30-a116-256cecb1f870-util\") pod \"37438178-7991-4b30-a116-256cecb1f870\" (UID: \"37438178-7991-4b30-a116-256cecb1f870\") "
Jul 16 11:57:19.860836 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:19.860741    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37438178-7991-4b30-a116-256cecb1f870-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:57:19.860836 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:19.860751    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxjrx\" (UniqueName: \"kubernetes.io/projected/37438178-7991-4b30-a116-256cecb1f870-kube-api-access-hxjrx\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:57:19.865973 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:19.865948    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37438178-7991-4b30-a116-256cecb1f870-util" (OuterVolumeSpecName: "util") pod "37438178-7991-4b30-a116-256cecb1f870" (UID: "37438178-7991-4b30-a116-256cecb1f870"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:57:19.961443 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:19.961418    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37438178-7991-4b30-a116-256cecb1f870-util\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:57:20.561896 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:20.561862    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92" event={"ID":"37438178-7991-4b30-a116-256cecb1f870","Type":"ContainerDied","Data":"ccc878e3983731e32fa405abffe188ece31e1c8d2b65c46b5a9fc936c3068a90"}
Jul 16 11:57:20.561896 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:20.561889    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9xx92"
Jul 16 11:57:20.561896 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:20.561906    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccc878e3983731e32fa405abffe188ece31e1c8d2b65c46b5a9fc936c3068a90"
Jul 16 11:57:31.371115 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.371082    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"]
Jul 16 11:57:31.371601 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.371381    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37438178-7991-4b30-a116-256cecb1f870" containerName="util"
Jul 16 11:57:31.371601 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.371391    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="37438178-7991-4b30-a116-256cecb1f870" containerName="util"
Jul 16 11:57:31.371601 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.371408    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37438178-7991-4b30-a116-256cecb1f870" containerName="pull"
Jul 16 11:57:31.371601 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.371413    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="37438178-7991-4b30-a116-256cecb1f870" containerName="pull"
Jul 16 11:57:31.371601 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.371425    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37438178-7991-4b30-a116-256cecb1f870" containerName="extract"
Jul 16 11:57:31.371601 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.371430    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="37438178-7991-4b30-a116-256cecb1f870" containerName="extract"
Jul 16 11:57:31.371601 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.371480    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="37438178-7991-4b30-a116-256cecb1f870" containerName="extract"
Jul 16 11:57:31.375656 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.375637    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:31.388616 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.388577    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 11:57:31.390096 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.390081    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 11:57:31.390786 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.390772    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zvkj4\""
Jul 16 11:57:31.405008 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.404984    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 11:57:31.406818 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.406800    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 11:57:31.438897 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.438866    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"]
Jul 16 11:57:31.448480 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.448455    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/221c55eb-d383-48f0-9521-d6c03a4ba52f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57d7447f8f-lvlfn\" (UID: \"221c55eb-d383-48f0-9521-d6c03a4ba52f\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:31.448585 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.448492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/221c55eb-d383-48f0-9521-d6c03a4ba52f-manifests\") pod \"opendatahub-operator-controller-manager-57d7447f8f-lvlfn\" (UID: \"221c55eb-d383-48f0-9521-d6c03a4ba52f\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:31.448585 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.448508    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/221c55eb-d383-48f0-9521-d6c03a4ba52f-webhook-cert\") pod \"opendatahub-operator-controller-manager-57d7447f8f-lvlfn\" (UID: \"221c55eb-d383-48f0-9521-d6c03a4ba52f\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:31.448585 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.448524    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-przv6\" (UniqueName: \"kubernetes.io/projected/221c55eb-d383-48f0-9521-d6c03a4ba52f-kube-api-access-przv6\") pod \"opendatahub-operator-controller-manager-57d7447f8f-lvlfn\" (UID: \"221c55eb-d383-48f0-9521-d6c03a4ba52f\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:31.448769 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.448659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/221c55eb-d383-48f0-9521-d6c03a4ba52f-tmp\") pod \"opendatahub-operator-controller-manager-57d7447f8f-lvlfn\" (UID: \"221c55eb-d383-48f0-9521-d6c03a4ba52f\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:31.550070 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.550032    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/221c55eb-d383-48f0-9521-d6c03a4ba52f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57d7447f8f-lvlfn\" (UID: \"221c55eb-d383-48f0-9521-d6c03a4ba52f\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:31.550254 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.550078    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/221c55eb-d383-48f0-9521-d6c03a4ba52f-manifests\") pod \"opendatahub-operator-controller-manager-57d7447f8f-lvlfn\" (UID: \"221c55eb-d383-48f0-9521-d6c03a4ba52f\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:31.550254 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.550100    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/221c55eb-d383-48f0-9521-d6c03a4ba52f-webhook-cert\") pod \"opendatahub-operator-controller-manager-57d7447f8f-lvlfn\" (UID: \"221c55eb-d383-48f0-9521-d6c03a4ba52f\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:31.550254 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.550123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-przv6\" (UniqueName: \"kubernetes.io/projected/221c55eb-d383-48f0-9521-d6c03a4ba52f-kube-api-access-przv6\") pod \"opendatahub-operator-controller-manager-57d7447f8f-lvlfn\" (UID: \"221c55eb-d383-48f0-9521-d6c03a4ba52f\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:31.550254 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.550206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/221c55eb-d383-48f0-9521-d6c03a4ba52f-tmp\") pod \"opendatahub-operator-controller-manager-57d7447f8f-lvlfn\" (UID: \"221c55eb-d383-48f0-9521-d6c03a4ba52f\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:31.550523 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.550499    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/221c55eb-d383-48f0-9521-d6c03a4ba52f-manifests\") pod \"opendatahub-operator-controller-manager-57d7447f8f-lvlfn\" (UID: \"221c55eb-d383-48f0-9521-d6c03a4ba52f\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:31.552535 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.552504    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/221c55eb-d383-48f0-9521-d6c03a4ba52f-tmp\") pod \"opendatahub-operator-controller-manager-57d7447f8f-lvlfn\" (UID: \"221c55eb-d383-48f0-9521-d6c03a4ba52f\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:31.552813 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.552787    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/221c55eb-d383-48f0-9521-d6c03a4ba52f-webhook-cert\") pod \"opendatahub-operator-controller-manager-57d7447f8f-lvlfn\" (UID: \"221c55eb-d383-48f0-9521-d6c03a4ba52f\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:31.552932 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.552893    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/221c55eb-d383-48f0-9521-d6c03a4ba52f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57d7447f8f-lvlfn\" (UID: \"221c55eb-d383-48f0-9521-d6c03a4ba52f\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:31.571995 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.571969    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-przv6\" (UniqueName: \"kubernetes.io/projected/221c55eb-d383-48f0-9521-d6c03a4ba52f-kube-api-access-przv6\") pod \"opendatahub-operator-controller-manager-57d7447f8f-lvlfn\" (UID: \"221c55eb-d383-48f0-9521-d6c03a4ba52f\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:31.686178 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.686085    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:31.847932 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:31.847900    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"]
Jul 16 11:57:31.851531 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:57:31.851505    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod221c55eb_d383_48f0_9521_d6c03a4ba52f.slice/crio-050e2858049bf7de062029ec0a583b68d35c54d814740c1821140124a44210e6 WatchSource:0}: Error finding container 050e2858049bf7de062029ec0a583b68d35c54d814740c1821140124a44210e6: Status 404 returned error can't find the container with id 050e2858049bf7de062029ec0a583b68d35c54d814740c1821140124a44210e6
Jul 16 11:57:32.620935 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:32.620895    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn" event={"ID":"221c55eb-d383-48f0-9521-d6c03a4ba52f","Type":"ContainerStarted","Data":"050e2858049bf7de062029ec0a583b68d35c54d814740c1821140124a44210e6"}
Jul 16 11:57:35.638122 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:35.638082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn" event={"ID":"221c55eb-d383-48f0-9521-d6c03a4ba52f","Type":"ContainerStarted","Data":"5d33516ba98e58bf5773d92107fc7a985c23d0fc383fe69207ba4e138e6976d9"}
Jul 16 11:57:36.643588 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:36.643551    2564 generic.go:356] "Generic (PLEG): container finished" podID="221c55eb-d383-48f0-9521-d6c03a4ba52f" containerID="5d33516ba98e58bf5773d92107fc7a985c23d0fc383fe69207ba4e138e6976d9" exitCode=0
Jul 16 11:57:36.644014 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:36.643638    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn" event={"ID":"221c55eb-d383-48f0-9521-d6c03a4ba52f","Type":"ContainerDied","Data":"5d33516ba98e58bf5773d92107fc7a985c23d0fc383fe69207ba4e138e6976d9"}
Jul 16 11:57:37.651019 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:37.650982    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn" event={"ID":"221c55eb-d383-48f0-9521-d6c03a4ba52f","Type":"ContainerStarted","Data":"6770af6b85ed3b8455a72a5546466dbc987a18a2244589f7ddf170c3af2e7d42"}
Jul 16 11:57:37.651413 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:37.651097    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:48.658496 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:48.658459    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn"
Jul 16 11:57:48.682219 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:48.682165    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-lvlfn" podStartSLOduration=13.134993027 podStartE2EDuration="17.682151165s" totalImagesPullingTime="3.492311103s" totalInitContainerRuntime="1.054847035s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:57:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:57:37.68905956 +0000 UTC m=+386.323853695" watchObservedRunningTime="2026-07-16 11:57:48.682151165 +0000 UTC m=+397.316945242"
Jul 16 11:57:52.254680 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.254642    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-69fc9c4ddf-7c878"]
Jul 16 11:57:52.263224 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.263199    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69fc9c4ddf-7c878"
Jul 16 11:57:52.276390 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.276355    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 11:57:52.276694 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.276674    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jw98v\""
Jul 16 11:57:52.279294 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.279278    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 11:57:52.282062 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.282040    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69fc9c4ddf-7c878"]
Jul 16 11:57:52.282342 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.282313    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 11:57:52.284680 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.284667    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 11:57:52.319737 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.319707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8b8b732-e65f-4754-982a-5aea00a87561-tmp\") pod \"kube-auth-proxy-69fc9c4ddf-7c878\" (UID: \"c8b8b732-e65f-4754-982a-5aea00a87561\") " pod="openshift-ingress/kube-auth-proxy-69fc9c4ddf-7c878"
Jul 16 11:57:52.319919 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.319809    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k47vn\" (UniqueName: \"kubernetes.io/projected/c8b8b732-e65f-4754-982a-5aea00a87561-kube-api-access-k47vn\") pod \"kube-auth-proxy-69fc9c4ddf-7c878\" (UID: \"c8b8b732-e65f-4754-982a-5aea00a87561\") " pod="openshift-ingress/kube-auth-proxy-69fc9c4ddf-7c878"
Jul 16 11:57:52.319919 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.319896    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8b8b732-e65f-4754-982a-5aea00a87561-tls-certs\") pod \"kube-auth-proxy-69fc9c4ddf-7c878\" (UID: \"c8b8b732-e65f-4754-982a-5aea00a87561\") " pod="openshift-ingress/kube-auth-proxy-69fc9c4ddf-7c878"
Jul 16 11:57:52.420544 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.420511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k47vn\" (UniqueName: \"kubernetes.io/projected/c8b8b732-e65f-4754-982a-5aea00a87561-kube-api-access-k47vn\") pod \"kube-auth-proxy-69fc9c4ddf-7c878\" (UID: \"c8b8b732-e65f-4754-982a-5aea00a87561\") " pod="openshift-ingress/kube-auth-proxy-69fc9c4ddf-7c878"
Jul 16 11:57:52.420753 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.420582    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8b8b732-e65f-4754-982a-5aea00a87561-tls-certs\") pod \"kube-auth-proxy-69fc9c4ddf-7c878\" (UID: \"c8b8b732-e65f-4754-982a-5aea00a87561\") " pod="openshift-ingress/kube-auth-proxy-69fc9c4ddf-7c878"
Jul 16 11:57:52.420753 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.420618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8b8b732-e65f-4754-982a-5aea00a87561-tmp\") pod \"kube-auth-proxy-69fc9c4ddf-7c878\" (UID: \"c8b8b732-e65f-4754-982a-5aea00a87561\") " pod="openshift-ingress/kube-auth-proxy-69fc9c4ddf-7c878"
Jul 16 11:57:52.423450 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.423410    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8b8b732-e65f-4754-982a-5aea00a87561-tmp\") pod \"kube-auth-proxy-69fc9c4ddf-7c878\" (UID: \"c8b8b732-e65f-4754-982a-5aea00a87561\") " pod="openshift-ingress/kube-auth-proxy-69fc9c4ddf-7c878"
Jul 16 11:57:52.424521 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.424495    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8b8b732-e65f-4754-982a-5aea00a87561-tls-certs\") pod \"kube-auth-proxy-69fc9c4ddf-7c878\" (UID: \"c8b8b732-e65f-4754-982a-5aea00a87561\") " pod="openshift-ingress/kube-auth-proxy-69fc9c4ddf-7c878"
Jul 16 11:57:52.468971 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.468937    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k47vn\" (UniqueName: \"kubernetes.io/projected/c8b8b732-e65f-4754-982a-5aea00a87561-kube-api-access-k47vn\") pod \"kube-auth-proxy-69fc9c4ddf-7c878\" (UID: \"c8b8b732-e65f-4754-982a-5aea00a87561\") " pod="openshift-ingress/kube-auth-proxy-69fc9c4ddf-7c878"
Jul 16 11:57:52.573744 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.573661    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69fc9c4ddf-7c878"
Jul 16 11:57:52.735885 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:52.735855    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69fc9c4ddf-7c878"]
Jul 16 11:57:52.740049 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:57:52.739996    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b8b732_e65f_4754_982a_5aea00a87561.slice/crio-9e25395adaf58e029b9449bc7c292a5fb528676bc4d6cbbee4522e03a001924b WatchSource:0}: Error finding container 9e25395adaf58e029b9449bc7c292a5fb528676bc4d6cbbee4522e03a001924b: Status 404 returned error can't find the container with id 9e25395adaf58e029b9449bc7c292a5fb528676bc4d6cbbee4522e03a001924b
Jul 16 11:57:53.647486 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:53.647449    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dvg4x"]
Jul 16 11:57:53.651297 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:53.651273    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dvg4x"
Jul 16 11:57:53.655203 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:53.655179    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 16 11:57:53.680035 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:53.680008    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dvg4x"]
Jul 16 11:57:53.726011 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:53.725973    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69fc9c4ddf-7c878" event={"ID":"c8b8b732-e65f-4754-982a-5aea00a87561","Type":"ContainerStarted","Data":"9e25395adaf58e029b9449bc7c292a5fb528676bc4d6cbbee4522e03a001924b"}
Jul 16 11:57:53.733650 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:53.733616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d106636a-4bfc-4af0-a287-975598e759ea-tls-certs\") pod \"model-serving-api-54d89bd5fc-dvg4x\" (UID: \"d106636a-4bfc-4af0-a287-975598e759ea\") " pod="opendatahub/model-serving-api-54d89bd5fc-dvg4x"
Jul 16 11:57:53.733784 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:53.733656    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f87c9\" (UniqueName: \"kubernetes.io/projected/d106636a-4bfc-4af0-a287-975598e759ea-kube-api-access-f87c9\") pod \"model-serving-api-54d89bd5fc-dvg4x\" (UID: \"d106636a-4bfc-4af0-a287-975598e759ea\") " pod="opendatahub/model-serving-api-54d89bd5fc-dvg4x"
Jul 16 11:57:53.835068 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:53.835034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d106636a-4bfc-4af0-a287-975598e759ea-tls-certs\") pod \"model-serving-api-54d89bd5fc-dvg4x\" (UID: \"d106636a-4bfc-4af0-a287-975598e759ea\") " pod="opendatahub/model-serving-api-54d89bd5fc-dvg4x"
Jul 16 11:57:53.835255 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:53.835085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f87c9\" (UniqueName: \"kubernetes.io/projected/d106636a-4bfc-4af0-a287-975598e759ea-kube-api-access-f87c9\") pod \"model-serving-api-54d89bd5fc-dvg4x\" (UID: \"d106636a-4bfc-4af0-a287-975598e759ea\") " pod="opendatahub/model-serving-api-54d89bd5fc-dvg4x"
Jul 16 11:57:53.835487 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:57:53.835457    2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 16 11:57:53.835635 ip-10-0-129-78 kubenswrapper[2564]: E0716 11:57:53.835541    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d106636a-4bfc-4af0-a287-975598e759ea-tls-certs podName:d106636a-4bfc-4af0-a287-975598e759ea nodeName:}" failed. No retries permitted until 2026-07-16 11:57:54.335518578 +0000 UTC m=+402.970312645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d106636a-4bfc-4af0-a287-975598e759ea-tls-certs") pod "model-serving-api-54d89bd5fc-dvg4x" (UID: "d106636a-4bfc-4af0-a287-975598e759ea") : secret "model-serving-api-tls" not found
Jul 16 11:57:53.857570 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:53.857496    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f87c9\" (UniqueName: \"kubernetes.io/projected/d106636a-4bfc-4af0-a287-975598e759ea-kube-api-access-f87c9\") pod \"model-serving-api-54d89bd5fc-dvg4x\" (UID: \"d106636a-4bfc-4af0-a287-975598e759ea\") " pod="opendatahub/model-serving-api-54d89bd5fc-dvg4x"
Jul 16 11:57:54.340141 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:54.340100    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d106636a-4bfc-4af0-a287-975598e759ea-tls-certs\") pod \"model-serving-api-54d89bd5fc-dvg4x\" (UID: \"d106636a-4bfc-4af0-a287-975598e759ea\") " pod="opendatahub/model-serving-api-54d89bd5fc-dvg4x"
Jul 16 11:57:54.343016 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:54.342989    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d106636a-4bfc-4af0-a287-975598e759ea-tls-certs\") pod \"model-serving-api-54d89bd5fc-dvg4x\" (UID: \"d106636a-4bfc-4af0-a287-975598e759ea\") " pod="opendatahub/model-serving-api-54d89bd5fc-dvg4x"
Jul 16 11:57:54.565864 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:54.565828    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dvg4x"
Jul 16 11:57:54.732887 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:54.732862    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dvg4x"]
Jul 16 11:57:55.329123 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:57:55.329092    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd106636a_4bfc_4af0_a287_975598e759ea.slice/crio-a29cd3e53cced40285beeee436e1130619eaba17e99a37c42f16cbfbca84afe6 WatchSource:0}: Error finding container a29cd3e53cced40285beeee436e1130619eaba17e99a37c42f16cbfbca84afe6: Status 404 returned error can't find the container with id a29cd3e53cced40285beeee436e1130619eaba17e99a37c42f16cbfbca84afe6
Jul 16 11:57:55.741704 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:55.741640    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69fc9c4ddf-7c878" event={"ID":"c8b8b732-e65f-4754-982a-5aea00a87561","Type":"ContainerStarted","Data":"b5c28d8f975f3f5638cc857813576873c3ba09bb56837b00a549050cf433c358"}
Jul 16 11:57:55.743071 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:55.743045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dvg4x" event={"ID":"d106636a-4bfc-4af0-a287-975598e759ea","Type":"ContainerStarted","Data":"a29cd3e53cced40285beeee436e1130619eaba17e99a37c42f16cbfbca84afe6"}
Jul 16 11:57:55.769066 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:55.768980    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-69fc9c4ddf-7c878" podStartSLOduration=1.132585252 podStartE2EDuration="3.768957317s" totalImagesPullingTime="2.636372065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:57:55.768059464 +0000 UTC m=+404.402853537" watchObservedRunningTime="2026-07-16 11:57:55.768957317 +0000 UTC m=+404.403751389"
Jul 16 11:57:57.757392 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:57.757354    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dvg4x" event={"ID":"d106636a-4bfc-4af0-a287-975598e759ea","Type":"ContainerStarted","Data":"9eb45729ba59dca4200babe44f2d46e44232a74798e133ace427b51fbbc382ad"}
Jul 16 11:57:57.757775 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:57.757484    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-dvg4x"
Jul 16 11:57:57.781552 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:57:57.781504    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-dvg4x" podStartSLOduration=3.293247302 podStartE2EDuration="4.781490187s" totalImagesPullingTime="1.488242885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:57:57.779857302 +0000 UTC m=+406.414651372" watchObservedRunningTime="2026-07-16 11:57:57.781490187 +0000 UTC m=+406.416284257"
Jul 16 11:58:00.994554 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:00.994524    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"]
Jul 16 11:58:00.997956 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:00.997937    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"
Jul 16 11:58:01.001115 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.001093    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 16 11:58:01.002157 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.002138    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 16 11:58:01.002319 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.002303    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bp976\""
Jul 16 11:58:01.002417 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.002307    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 16 11:58:01.023448 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.023425    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"]
Jul 16 11:58:01.099244 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.099213    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1-cert\") pod \"lws-controller-manager-86477779b7-n94ql\" (UID: \"20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"
Jul 16 11:58:01.099395 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.099266    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1-manager-config\") pod \"lws-controller-manager-86477779b7-n94ql\" (UID: \"20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"
Jul 16 11:58:01.099395 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.099299    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9tvv\" (UniqueName: \"kubernetes.io/projected/20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1-kube-api-access-v9tvv\") pod \"lws-controller-manager-86477779b7-n94ql\" (UID: \"20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"
Jul 16 11:58:01.099395 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.099378    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1-metrics-cert\") pod \"lws-controller-manager-86477779b7-n94ql\" (UID: \"20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"
Jul 16 11:58:01.200366 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.200313    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1-metrics-cert\") pod \"lws-controller-manager-86477779b7-n94ql\" (UID: \"20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"
Jul 16 11:58:01.200518 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.200457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1-cert\") pod \"lws-controller-manager-86477779b7-n94ql\" (UID: \"20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"
Jul 16 11:58:01.200518 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.200496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1-manager-config\") pod \"lws-controller-manager-86477779b7-n94ql\" (UID: \"20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"
Jul 16 11:58:01.200625 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.200528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9tvv\" (UniqueName: \"kubernetes.io/projected/20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1-kube-api-access-v9tvv\") pod \"lws-controller-manager-86477779b7-n94ql\" (UID: \"20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"
Jul 16 11:58:01.201276 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.201181    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1-manager-config\") pod \"lws-controller-manager-86477779b7-n94ql\" (UID: \"20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"
Jul 16 11:58:01.203140 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.203089    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1-metrics-cert\") pod \"lws-controller-manager-86477779b7-n94ql\" (UID: \"20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"
Jul 16 11:58:01.203351 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.203318    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1-cert\") pod \"lws-controller-manager-86477779b7-n94ql\" (UID: \"20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"
Jul 16 11:58:01.215471 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.215450    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9tvv\" (UniqueName: \"kubernetes.io/projected/20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1-kube-api-access-v9tvv\") pod \"lws-controller-manager-86477779b7-n94ql\" (UID: \"20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"
Jul 16 11:58:01.307039 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.306958    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"
Jul 16 11:58:01.503720 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:58:01.503684    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20f79fb9_dfe2_4356_b705_3fcd6e4cbaa1.slice/crio-c284f6b28b190db08138ad1a1c71ff0a4bcbff263faacb4323dbe731fde511b8 WatchSource:0}: Error finding container c284f6b28b190db08138ad1a1c71ff0a4bcbff263faacb4323dbe731fde511b8: Status 404 returned error can't find the container with id c284f6b28b190db08138ad1a1c71ff0a4bcbff263faacb4323dbe731fde511b8
Jul 16 11:58:01.507197 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.507174    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"]
Jul 16 11:58:01.777077 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:01.777047    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql" event={"ID":"20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1","Type":"ContainerStarted","Data":"c284f6b28b190db08138ad1a1c71ff0a4bcbff263faacb4323dbe731fde511b8"}
Jul 16 11:58:03.788350 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:03.788289    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql" event={"ID":"20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1","Type":"ContainerStarted","Data":"b49d44a1991c6bfe192192284f16c257b7768c2a27e05714db8fbc2349af858a"}
Jul 16 11:58:03.788767 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:03.788452    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"
Jul 16 11:58:03.813275 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:03.813225    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql" podStartSLOduration=2.566097338 podStartE2EDuration="3.813209139s" totalImagesPullingTime="1.247111801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:58:03.811303339 +0000 UTC m=+412.446097410" watchObservedRunningTime="2026-07-16 11:58:03.813209139 +0000 UTC m=+412.448003254"
Jul 16 11:58:08.766715 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:08.766685    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-dvg4x"
Jul 16 11:58:14.796217 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:58:14.796183    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-86477779b7-n94ql"
Jul 16 11:59:08.556412 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:08.556381    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76"]
Jul 16 11:59:08.559894 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:08.559875    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76"
Jul 16 11:59:08.566104 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:08.566078    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 11:59:08.566246 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:08.566077    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 11:59:08.566968 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:08.566953    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xm2kv\""
Jul 16 11:59:08.577170 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:08.577146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qhvw\" (UniqueName: \"kubernetes.io/projected/90b8c1bc-8179-48af-abde-791e9e86a979-kube-api-access-2qhvw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76\" (UID: \"90b8c1bc-8179-48af-abde-791e9e86a979\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76"
Jul 16 11:59:08.577265 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:08.577209    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90b8c1bc-8179-48af-abde-791e9e86a979-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76\" (UID: \"90b8c1bc-8179-48af-abde-791e9e86a979\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76"
Jul 16 11:59:08.577265 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:08.577244    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90b8c1bc-8179-48af-abde-791e9e86a979-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76\" (UID: \"90b8c1bc-8179-48af-abde-791e9e86a979\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76"
Jul 16 11:59:08.584551 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:08.584529    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76"]
Jul 16 11:59:08.678196 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:08.678154    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90b8c1bc-8179-48af-abde-791e9e86a979-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76\" (UID: \"90b8c1bc-8179-48af-abde-791e9e86a979\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76"
Jul 16 11:59:08.678420 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:08.678238    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90b8c1bc-8179-48af-abde-791e9e86a979-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76\" (UID: \"90b8c1bc-8179-48af-abde-791e9e86a979\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76"
Jul 16 11:59:08.678420 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:08.678283    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qhvw\" (UniqueName: \"kubernetes.io/projected/90b8c1bc-8179-48af-abde-791e9e86a979-kube-api-access-2qhvw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76\" (UID: \"90b8c1bc-8179-48af-abde-791e9e86a979\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76"
Jul 16 11:59:08.678622 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:08.678600    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90b8c1bc-8179-48af-abde-791e9e86a979-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76\" (UID: \"90b8c1bc-8179-48af-abde-791e9e86a979\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76"
Jul 16 11:59:08.678622 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:08.678615    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90b8c1bc-8179-48af-abde-791e9e86a979-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76\" (UID: \"90b8c1bc-8179-48af-abde-791e9e86a979\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76"
Jul 16 11:59:08.690647 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:08.690623    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qhvw\" (UniqueName: \"kubernetes.io/projected/90b8c1bc-8179-48af-abde-791e9e86a979-kube-api-access-2qhvw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76\" (UID: \"90b8c1bc-8179-48af-abde-791e9e86a979\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76"
Jul 16 11:59:08.869360 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:08.869321    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76"
Jul 16 11:59:09.008747 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.008685    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76"]
Jul 16 11:59:09.010923 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:59:09.010896    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b8c1bc_8179_48af_abde_791e9e86a979.slice/crio-9ed95c914939f2d9de9c61d10169c490dd1854ab0f1101efcdc2176ec06772aa WatchSource:0}: Error finding container 9ed95c914939f2d9de9c61d10169c490dd1854ab0f1101efcdc2176ec06772aa: Status 404 returned error can't find the container with id 9ed95c914939f2d9de9c61d10169c490dd1854ab0f1101efcdc2176ec06772aa
Jul 16 11:59:09.078796 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.078769    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76" event={"ID":"90b8c1bc-8179-48af-abde-791e9e86a979","Type":"ContainerStarted","Data":"20d54c13b1f52aebe946e9c929eac71bb37d62b907f79fe7a5d6905271cdb9b3"}
Jul 16 11:59:09.078919 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.078824    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76" event={"ID":"90b8c1bc-8179-48af-abde-791e9e86a979","Type":"ContainerStarted","Data":"9ed95c914939f2d9de9c61d10169c490dd1854ab0f1101efcdc2176ec06772aa"}
Jul 16 11:59:09.121064 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.121010    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2"]
Jul 16 11:59:09.124286 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.124269    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2"
Jul 16 11:59:09.136844 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.136821    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2"]
Jul 16 11:59:09.182387 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.182363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9272f491-ef17-45d3-bc56-fc9b760d3648-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2\" (UID: \"9272f491-ef17-45d3-bc56-fc9b760d3648\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2"
Jul 16 11:59:09.182489 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.182397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9272f491-ef17-45d3-bc56-fc9b760d3648-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2\" (UID: \"9272f491-ef17-45d3-bc56-fc9b760d3648\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2"
Jul 16 11:59:09.182489 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.182475    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd2b8\" (UniqueName: \"kubernetes.io/projected/9272f491-ef17-45d3-bc56-fc9b760d3648-kube-api-access-vd2b8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2\" (UID: \"9272f491-ef17-45d3-bc56-fc9b760d3648\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2"
Jul 16 11:59:09.283060 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.283024    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9272f491-ef17-45d3-bc56-fc9b760d3648-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2\" (UID: \"9272f491-ef17-45d3-bc56-fc9b760d3648\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2"
Jul 16 11:59:09.283216 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.283092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd2b8\" (UniqueName: \"kubernetes.io/projected/9272f491-ef17-45d3-bc56-fc9b760d3648-kube-api-access-vd2b8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2\" (UID: \"9272f491-ef17-45d3-bc56-fc9b760d3648\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2"
Jul 16 11:59:09.283216 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.283138    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9272f491-ef17-45d3-bc56-fc9b760d3648-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2\" (UID: \"9272f491-ef17-45d3-bc56-fc9b760d3648\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2"
Jul 16 11:59:09.283462 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.283440    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9272f491-ef17-45d3-bc56-fc9b760d3648-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2\" (UID: \"9272f491-ef17-45d3-bc56-fc9b760d3648\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2"
Jul 16 11:59:09.283504 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.283465    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9272f491-ef17-45d3-bc56-fc9b760d3648-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2\" (UID: \"9272f491-ef17-45d3-bc56-fc9b760d3648\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2"
Jul 16 11:59:09.293611 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.293583    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd2b8\" (UniqueName: \"kubernetes.io/projected/9272f491-ef17-45d3-bc56-fc9b760d3648-kube-api-access-vd2b8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2\" (UID: \"9272f491-ef17-45d3-bc56-fc9b760d3648\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2"
Jul 16 11:59:09.480396 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.480300    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2"
Jul 16 11:59:09.499458 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.499434    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc"]
Jul 16 11:59:09.502968 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.502948    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc"
Jul 16 11:59:09.517795 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.517764    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc"]
Jul 16 11:59:09.585269 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.585233    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28383a56-3f32-43d0-95ca-7b2aa1ec3427-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc\" (UID: \"28383a56-3f32-43d0-95ca-7b2aa1ec3427\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc"
Jul 16 11:59:09.585663 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.585292    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr2mj\" (UniqueName: \"kubernetes.io/projected/28383a56-3f32-43d0-95ca-7b2aa1ec3427-kube-api-access-wr2mj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc\" (UID: \"28383a56-3f32-43d0-95ca-7b2aa1ec3427\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc"
Jul 16 11:59:09.585663 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.585313    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28383a56-3f32-43d0-95ca-7b2aa1ec3427-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc\" (UID: \"28383a56-3f32-43d0-95ca-7b2aa1ec3427\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc"
Jul 16 11:59:09.656966 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.656934    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2"]
Jul 16 11:59:09.685798 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.685772    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28383a56-3f32-43d0-95ca-7b2aa1ec3427-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc\" (UID: \"28383a56-3f32-43d0-95ca-7b2aa1ec3427\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc"
Jul 16 11:59:09.685905 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.685818    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr2mj\" (UniqueName: \"kubernetes.io/projected/28383a56-3f32-43d0-95ca-7b2aa1ec3427-kube-api-access-wr2mj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc\" (UID: \"28383a56-3f32-43d0-95ca-7b2aa1ec3427\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc"
Jul 16 11:59:09.685966 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.685942    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28383a56-3f32-43d0-95ca-7b2aa1ec3427-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc\" (UID: \"28383a56-3f32-43d0-95ca-7b2aa1ec3427\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc"
Jul 16 11:59:09.686153 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.686139    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28383a56-3f32-43d0-95ca-7b2aa1ec3427-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc\" (UID: \"28383a56-3f32-43d0-95ca-7b2aa1ec3427\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc"
Jul 16 11:59:09.686215 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.686200    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28383a56-3f32-43d0-95ca-7b2aa1ec3427-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc\" (UID: \"28383a56-3f32-43d0-95ca-7b2aa1ec3427\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc"
Jul 16 11:59:09.728447 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.728424    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr2mj\" (UniqueName: \"kubernetes.io/projected/28383a56-3f32-43d0-95ca-7b2aa1ec3427-kube-api-access-wr2mj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc\" (UID: \"28383a56-3f32-43d0-95ca-7b2aa1ec3427\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc"
Jul 16 11:59:09.814727 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.814689    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc"
Jul 16 11:59:09.951734 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:09.951708    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc"]
Jul 16 11:59:09.953615 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:59:09.953571    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28383a56_3f32_43d0_95ca_7b2aa1ec3427.slice/crio-95565ab3e11a6909129cf6ebc2636c9aed7b4996606bc99587c45ae5bb9f0376 WatchSource:0}: Error finding container 95565ab3e11a6909129cf6ebc2636c9aed7b4996606bc99587c45ae5bb9f0376: Status 404 returned error can't find the container with id 95565ab3e11a6909129cf6ebc2636c9aed7b4996606bc99587c45ae5bb9f0376
Jul 16 11:59:10.084836 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.084806    2564 generic.go:356] "Generic (PLEG): container finished" podID="9272f491-ef17-45d3-bc56-fc9b760d3648" containerID="261fbedfd74b8003fa19cc4b799f654afe3c7f51ab9237676d4fdd166298b222" exitCode=0
Jul 16 11:59:10.085018 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.084892    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2" event={"ID":"9272f491-ef17-45d3-bc56-fc9b760d3648","Type":"ContainerDied","Data":"261fbedfd74b8003fa19cc4b799f654afe3c7f51ab9237676d4fdd166298b222"}
Jul 16 11:59:10.085018 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.084939    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2" event={"ID":"9272f491-ef17-45d3-bc56-fc9b760d3648","Type":"ContainerStarted","Data":"ea1ac8cb19664a8f5c86c3fc9a8a099815410f2f8963efd552c412ff51c588f6"}
Jul 16 11:59:10.086470 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.086443    2564 generic.go:356] "Generic (PLEG): container finished" podID="28383a56-3f32-43d0-95ca-7b2aa1ec3427" containerID="ddd8c367a11db83aa55f61fee29064352628b4c858c4844a4f7bb608d9c61335" exitCode=0
Jul 16 11:59:10.086553 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.086535    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc" event={"ID":"28383a56-3f32-43d0-95ca-7b2aa1ec3427","Type":"ContainerDied","Data":"ddd8c367a11db83aa55f61fee29064352628b4c858c4844a4f7bb608d9c61335"}
Jul 16 11:59:10.086613 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.086581    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc" event={"ID":"28383a56-3f32-43d0-95ca-7b2aa1ec3427","Type":"ContainerStarted","Data":"95565ab3e11a6909129cf6ebc2636c9aed7b4996606bc99587c45ae5bb9f0376"}
Jul 16 11:59:10.088235 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.088144    2564 generic.go:356] "Generic (PLEG): container finished" podID="90b8c1bc-8179-48af-abde-791e9e86a979" containerID="20d54c13b1f52aebe946e9c929eac71bb37d62b907f79fe7a5d6905271cdb9b3" exitCode=0
Jul 16 11:59:10.088235 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.088189    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76" event={"ID":"90b8c1bc-8179-48af-abde-791e9e86a979","Type":"ContainerDied","Data":"20d54c13b1f52aebe946e9c929eac71bb37d62b907f79fe7a5d6905271cdb9b3"}
Jul 16 11:59:10.103657 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.103636    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t"]
Jul 16 11:59:10.107264 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.107248    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t"
Jul 16 11:59:10.119797 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.119775    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t"]
Jul 16 11:59:10.290748 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.290668    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45a0611a-315a-47a4-aa28-68ef6f90dc7d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t\" (UID: \"45a0611a-315a-47a4-aa28-68ef6f90dc7d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t"
Jul 16 11:59:10.290748 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.290707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45a0611a-315a-47a4-aa28-68ef6f90dc7d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t\" (UID: \"45a0611a-315a-47a4-aa28-68ef6f90dc7d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t"
Jul 16 11:59:10.290748 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.290727    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f59zv\" (UniqueName: \"kubernetes.io/projected/45a0611a-315a-47a4-aa28-68ef6f90dc7d-kube-api-access-f59zv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t\" (UID: \"45a0611a-315a-47a4-aa28-68ef6f90dc7d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t"
Jul 16 11:59:10.391422 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.391389    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45a0611a-315a-47a4-aa28-68ef6f90dc7d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t\" (UID: \"45a0611a-315a-47a4-aa28-68ef6f90dc7d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t"
Jul 16 11:59:10.391422 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.391425    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45a0611a-315a-47a4-aa28-68ef6f90dc7d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t\" (UID: \"45a0611a-315a-47a4-aa28-68ef6f90dc7d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t"
Jul 16 11:59:10.391660 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.391443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f59zv\" (UniqueName: \"kubernetes.io/projected/45a0611a-315a-47a4-aa28-68ef6f90dc7d-kube-api-access-f59zv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t\" (UID: \"45a0611a-315a-47a4-aa28-68ef6f90dc7d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t"
Jul 16 11:59:10.391765 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.391744    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45a0611a-315a-47a4-aa28-68ef6f90dc7d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t\" (UID: \"45a0611a-315a-47a4-aa28-68ef6f90dc7d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t"
Jul 16 11:59:10.391830 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.391800    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45a0611a-315a-47a4-aa28-68ef6f90dc7d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t\" (UID: \"45a0611a-315a-47a4-aa28-68ef6f90dc7d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t"
Jul 16 11:59:10.415004 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.414976    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f59zv\" (UniqueName: \"kubernetes.io/projected/45a0611a-315a-47a4-aa28-68ef6f90dc7d-kube-api-access-f59zv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t\" (UID: \"45a0611a-315a-47a4-aa28-68ef6f90dc7d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t"
Jul 16 11:59:10.416822 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.416806    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t"
Jul 16 11:59:10.552155 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:10.552113    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t"]
Jul 16 11:59:10.554394 ip-10-0-129-78 kubenswrapper[2564]: W0716 11:59:10.554371    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45a0611a_315a_47a4_aa28_68ef6f90dc7d.slice/crio-3ac25a79ca00259fabf3c79feb741061abcff8767194698aab56a306ebaa6f58 WatchSource:0}: Error finding container 3ac25a79ca00259fabf3c79feb741061abcff8767194698aab56a306ebaa6f58: Status 404 returned error can't find the container with id 3ac25a79ca00259fabf3c79feb741061abcff8767194698aab56a306ebaa6f58
Jul 16 11:59:11.096492 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:11.096464    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76" event={"ID":"90b8c1bc-8179-48af-abde-791e9e86a979","Type":"ContainerStarted","Data":"c3d1f9c4edbfeeb3e34b30055f5531a22a9393bf8033221f8b36b25b59870ffb"}
Jul 16 11:59:11.098345 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:11.098301    2564 generic.go:356] "Generic (PLEG): container finished" podID="45a0611a-315a-47a4-aa28-68ef6f90dc7d" containerID="b51f8289b01e1e52ed55d222850c9a92425a16dc4634976e6eb5668302dcaf1f" exitCode=0
Jul 16 11:59:11.098559 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:11.098530    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t" event={"ID":"45a0611a-315a-47a4-aa28-68ef6f90dc7d","Type":"ContainerDied","Data":"b51f8289b01e1e52ed55d222850c9a92425a16dc4634976e6eb5668302dcaf1f"}
Jul 16 11:59:11.098665 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:11.098583    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t" event={"ID":"45a0611a-315a-47a4-aa28-68ef6f90dc7d","Type":"ContainerStarted","Data":"3ac25a79ca00259fabf3c79feb741061abcff8767194698aab56a306ebaa6f58"}
Jul 16 11:59:11.100597 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:11.100577    2564 generic.go:356] "Generic (PLEG): container finished" podID="9272f491-ef17-45d3-bc56-fc9b760d3648" containerID="e2e106a8dfdbcc2c95d30d9ed8460ef5ca00a27dad9cf49f8fe56086e721c3c9" exitCode=0
Jul 16 11:59:11.100702 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:11.100655    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2" event={"ID":"9272f491-ef17-45d3-bc56-fc9b760d3648","Type":"ContainerDied","Data":"e2e106a8dfdbcc2c95d30d9ed8460ef5ca00a27dad9cf49f8fe56086e721c3c9"}
Jul 16 11:59:12.109035 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:12.109005    2564 generic.go:356] "Generic (PLEG): container finished" podID="28383a56-3f32-43d0-95ca-7b2aa1ec3427" containerID="dd5db8a9af1f2200dc61e27e0ecdc5ead6617603235d19080d4873b60d35da9d" exitCode=0
Jul 16 11:59:12.109455 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:12.109119    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc" event={"ID":"28383a56-3f32-43d0-95ca-7b2aa1ec3427","Type":"ContainerDied","Data":"dd5db8a9af1f2200dc61e27e0ecdc5ead6617603235d19080d4873b60d35da9d"}
Jul 16 11:59:12.111457 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:12.111435    2564 generic.go:356] "Generic (PLEG): container finished" podID="90b8c1bc-8179-48af-abde-791e9e86a979" containerID="c3d1f9c4edbfeeb3e34b30055f5531a22a9393bf8033221f8b36b25b59870ffb" exitCode=0
Jul 16 11:59:12.111532 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:12.111500    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76" event={"ID":"90b8c1bc-8179-48af-abde-791e9e86a979","Type":"ContainerDied","Data":"c3d1f9c4edbfeeb3e34b30055f5531a22a9393bf8033221f8b36b25b59870ffb"}
Jul 16 11:59:12.113470 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:12.113445    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t" event={"ID":"45a0611a-315a-47a4-aa28-68ef6f90dc7d","Type":"ContainerStarted","Data":"93be19fd17b1f70ba68db08aa581424e8423dd7eece79d830b1ab86ac3e86d10"}
Jul 16 11:59:12.123173 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:12.123103    2564 generic.go:356] "Generic (PLEG): container finished" podID="9272f491-ef17-45d3-bc56-fc9b760d3648" containerID="900a62edda5fe4e10f18cc84f8bedccfecb25fefe17406a32799f175162f051d" exitCode=0
Jul 16 11:59:12.123173 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:12.123174    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2" event={"ID":"9272f491-ef17-45d3-bc56-fc9b760d3648","Type":"ContainerDied","Data":"900a62edda5fe4e10f18cc84f8bedccfecb25fefe17406a32799f175162f051d"}
Jul 16 11:59:13.130615 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:13.130580    2564 generic.go:356] "Generic (PLEG): container finished" podID="90b8c1bc-8179-48af-abde-791e9e86a979" containerID="e36448f3a9afde5da80936277513b0ed628129c290596d79ea6874b00295fe0b" exitCode=0
Jul 16 11:59:13.131009 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:13.130665    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76" event={"ID":"90b8c1bc-8179-48af-abde-791e9e86a979","Type":"ContainerDied","Data":"e36448f3a9afde5da80936277513b0ed628129c290596d79ea6874b00295fe0b"}
Jul 16 11:59:13.132373 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:13.132344    2564 generic.go:356] "Generic (PLEG): container finished" podID="45a0611a-315a-47a4-aa28-68ef6f90dc7d" containerID="93be19fd17b1f70ba68db08aa581424e8423dd7eece79d830b1ab86ac3e86d10" exitCode=0
Jul 16 11:59:13.132497 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:13.132432    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t" event={"ID":"45a0611a-315a-47a4-aa28-68ef6f90dc7d","Type":"ContainerDied","Data":"93be19fd17b1f70ba68db08aa581424e8423dd7eece79d830b1ab86ac3e86d10"}
Jul 16 11:59:13.134778 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:13.134755    2564 generic.go:356] "Generic (PLEG): container finished" podID="28383a56-3f32-43d0-95ca-7b2aa1ec3427" containerID="9be13d05da9771c6c68b8c54babf64de81b2ee9b4eb96e3c04b405a30222624e" exitCode=0
Jul 16 11:59:13.134860 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:13.134843    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc" event={"ID":"28383a56-3f32-43d0-95ca-7b2aa1ec3427","Type":"ContainerDied","Data":"9be13d05da9771c6c68b8c54babf64de81b2ee9b4eb96e3c04b405a30222624e"}
Jul 16 11:59:13.274942 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:13.274918    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2"
Jul 16 11:59:13.315847 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:13.315815    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9272f491-ef17-45d3-bc56-fc9b760d3648-util\") pod \"9272f491-ef17-45d3-bc56-fc9b760d3648\" (UID: \"9272f491-ef17-45d3-bc56-fc9b760d3648\") "
Jul 16 11:59:13.315972 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:13.315895    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9272f491-ef17-45d3-bc56-fc9b760d3648-bundle\") pod \"9272f491-ef17-45d3-bc56-fc9b760d3648\" (UID: \"9272f491-ef17-45d3-bc56-fc9b760d3648\") "
Jul 16 11:59:13.315972 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:13.315923    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vd2b8\" (UniqueName: \"kubernetes.io/projected/9272f491-ef17-45d3-bc56-fc9b760d3648-kube-api-access-vd2b8\") pod \"9272f491-ef17-45d3-bc56-fc9b760d3648\" (UID: \"9272f491-ef17-45d3-bc56-fc9b760d3648\") "
Jul 16 11:59:13.316468 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:13.316390    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9272f491-ef17-45d3-bc56-fc9b760d3648-bundle" (OuterVolumeSpecName: "bundle") pod "9272f491-ef17-45d3-bc56-fc9b760d3648" (UID: "9272f491-ef17-45d3-bc56-fc9b760d3648"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:59:13.318139 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:13.318105    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9272f491-ef17-45d3-bc56-fc9b760d3648-kube-api-access-vd2b8" (OuterVolumeSpecName: "kube-api-access-vd2b8") pod "9272f491-ef17-45d3-bc56-fc9b760d3648" (UID: "9272f491-ef17-45d3-bc56-fc9b760d3648"). InnerVolumeSpecName "kube-api-access-vd2b8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:59:13.321477 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:13.321445    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9272f491-ef17-45d3-bc56-fc9b760d3648-util" (OuterVolumeSpecName: "util") pod "9272f491-ef17-45d3-bc56-fc9b760d3648" (UID: "9272f491-ef17-45d3-bc56-fc9b760d3648"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:59:13.417313 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:13.417245    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9272f491-ef17-45d3-bc56-fc9b760d3648-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:59:13.417313 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:13.417269    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd2b8\" (UniqueName: \"kubernetes.io/projected/9272f491-ef17-45d3-bc56-fc9b760d3648-kube-api-access-vd2b8\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:59:13.417313 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:13.417278    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9272f491-ef17-45d3-bc56-fc9b760d3648-util\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:59:14.142050 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.142024    2564 generic.go:356] "Generic (PLEG): container finished" podID="45a0611a-315a-47a4-aa28-68ef6f90dc7d" containerID="1b8652333f5befe1ea90c82d3641c98670f34566b0e08f8505bb2cc74cc28b8a" exitCode=0
Jul 16 11:59:14.142536 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.142100    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t" event={"ID":"45a0611a-315a-47a4-aa28-68ef6f90dc7d","Type":"ContainerDied","Data":"1b8652333f5befe1ea90c82d3641c98670f34566b0e08f8505bb2cc74cc28b8a"}
Jul 16 11:59:14.143845 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.143826    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2"
Jul 16 11:59:14.143972 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.143860    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2" event={"ID":"9272f491-ef17-45d3-bc56-fc9b760d3648","Type":"ContainerDied","Data":"ea1ac8cb19664a8f5c86c3fc9a8a099815410f2f8963efd552c412ff51c588f6"}
Jul 16 11:59:14.143972 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.143894    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea1ac8cb19664a8f5c86c3fc9a8a099815410f2f8963efd552c412ff51c588f6"
Jul 16 11:59:14.278551 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.278526    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc"
Jul 16 11:59:14.306256 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.306235    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76"
Jul 16 11:59:14.325410 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.325383    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28383a56-3f32-43d0-95ca-7b2aa1ec3427-util\") pod \"28383a56-3f32-43d0-95ca-7b2aa1ec3427\" (UID: \"28383a56-3f32-43d0-95ca-7b2aa1ec3427\") "
Jul 16 11:59:14.325530 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.325417    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr2mj\" (UniqueName: \"kubernetes.io/projected/28383a56-3f32-43d0-95ca-7b2aa1ec3427-kube-api-access-wr2mj\") pod \"28383a56-3f32-43d0-95ca-7b2aa1ec3427\" (UID: \"28383a56-3f32-43d0-95ca-7b2aa1ec3427\") "
Jul 16 11:59:14.325530 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.325452    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28383a56-3f32-43d0-95ca-7b2aa1ec3427-bundle\") pod \"28383a56-3f32-43d0-95ca-7b2aa1ec3427\" (UID: \"28383a56-3f32-43d0-95ca-7b2aa1ec3427\") "
Jul 16 11:59:14.325530 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.325497    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90b8c1bc-8179-48af-abde-791e9e86a979-util\") pod \"90b8c1bc-8179-48af-abde-791e9e86a979\" (UID: \"90b8c1bc-8179-48af-abde-791e9e86a979\") "
Jul 16 11:59:14.326075 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.325547    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qhvw\" (UniqueName: \"kubernetes.io/projected/90b8c1bc-8179-48af-abde-791e9e86a979-kube-api-access-2qhvw\") pod \"90b8c1bc-8179-48af-abde-791e9e86a979\" (UID: \"90b8c1bc-8179-48af-abde-791e9e86a979\") "
Jul 16 11:59:14.326075 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.325611    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90b8c1bc-8179-48af-abde-791e9e86a979-bundle\") pod \"90b8c1bc-8179-48af-abde-791e9e86a979\" (UID: \"90b8c1bc-8179-48af-abde-791e9e86a979\") "
Jul 16 11:59:14.326475 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.326416    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28383a56-3f32-43d0-95ca-7b2aa1ec3427-bundle" (OuterVolumeSpecName: "bundle") pod "28383a56-3f32-43d0-95ca-7b2aa1ec3427" (UID: "28383a56-3f32-43d0-95ca-7b2aa1ec3427"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:59:14.326475 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.326426    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90b8c1bc-8179-48af-abde-791e9e86a979-bundle" (OuterVolumeSpecName: "bundle") pod "90b8c1bc-8179-48af-abde-791e9e86a979" (UID: "90b8c1bc-8179-48af-abde-791e9e86a979"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:59:14.328594 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.328568    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90b8c1bc-8179-48af-abde-791e9e86a979-kube-api-access-2qhvw" (OuterVolumeSpecName: "kube-api-access-2qhvw") pod "90b8c1bc-8179-48af-abde-791e9e86a979" (UID: "90b8c1bc-8179-48af-abde-791e9e86a979"). InnerVolumeSpecName "kube-api-access-2qhvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:59:14.328705 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.328593    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28383a56-3f32-43d0-95ca-7b2aa1ec3427-kube-api-access-wr2mj" (OuterVolumeSpecName: "kube-api-access-wr2mj") pod "28383a56-3f32-43d0-95ca-7b2aa1ec3427" (UID: "28383a56-3f32-43d0-95ca-7b2aa1ec3427"). InnerVolumeSpecName "kube-api-access-wr2mj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:59:14.332378 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.332342    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90b8c1bc-8179-48af-abde-791e9e86a979-util" (OuterVolumeSpecName: "util") pod "90b8c1bc-8179-48af-abde-791e9e86a979" (UID: "90b8c1bc-8179-48af-abde-791e9e86a979"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:59:14.332708 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.332690    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28383a56-3f32-43d0-95ca-7b2aa1ec3427-util" (OuterVolumeSpecName: "util") pod "28383a56-3f32-43d0-95ca-7b2aa1ec3427" (UID: "28383a56-3f32-43d0-95ca-7b2aa1ec3427"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:59:14.427398 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.427285    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90b8c1bc-8179-48af-abde-791e9e86a979-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:59:14.427398 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.427316    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28383a56-3f32-43d0-95ca-7b2aa1ec3427-util\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:59:14.427398 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.427353    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr2mj\" (UniqueName: \"kubernetes.io/projected/28383a56-3f32-43d0-95ca-7b2aa1ec3427-kube-api-access-wr2mj\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:59:14.427398 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.427363    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28383a56-3f32-43d0-95ca-7b2aa1ec3427-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:59:14.427398 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.427371    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90b8c1bc-8179-48af-abde-791e9e86a979-util\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:59:14.427398 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:14.427379    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qhvw\" (UniqueName: \"kubernetes.io/projected/90b8c1bc-8179-48af-abde-791e9e86a979-kube-api-access-2qhvw\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:59:15.150727 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:15.150697    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76"
Jul 16 11:59:15.150727 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:15.150717    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76" event={"ID":"90b8c1bc-8179-48af-abde-791e9e86a979","Type":"ContainerDied","Data":"9ed95c914939f2d9de9c61d10169c490dd1854ab0f1101efcdc2176ec06772aa"}
Jul 16 11:59:15.151144 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:15.150768    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ed95c914939f2d9de9c61d10169c490dd1854ab0f1101efcdc2176ec06772aa"
Jul 16 11:59:15.152623 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:15.152590    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc" event={"ID":"28383a56-3f32-43d0-95ca-7b2aa1ec3427","Type":"ContainerDied","Data":"95565ab3e11a6909129cf6ebc2636c9aed7b4996606bc99587c45ae5bb9f0376"}
Jul 16 11:59:15.152623 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:15.152617    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc"
Jul 16 11:59:15.152775 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:15.152647    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95565ab3e11a6909129cf6ebc2636c9aed7b4996606bc99587c45ae5bb9f0376"
Jul 16 11:59:15.281429 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:15.281408    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t"
Jul 16 11:59:15.336550 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:15.336516    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45a0611a-315a-47a4-aa28-68ef6f90dc7d-util\") pod \"45a0611a-315a-47a4-aa28-68ef6f90dc7d\" (UID: \"45a0611a-315a-47a4-aa28-68ef6f90dc7d\") "
Jul 16 11:59:15.336738 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:15.336581    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f59zv\" (UniqueName: \"kubernetes.io/projected/45a0611a-315a-47a4-aa28-68ef6f90dc7d-kube-api-access-f59zv\") pod \"45a0611a-315a-47a4-aa28-68ef6f90dc7d\" (UID: \"45a0611a-315a-47a4-aa28-68ef6f90dc7d\") "
Jul 16 11:59:15.336738 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:15.336658    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45a0611a-315a-47a4-aa28-68ef6f90dc7d-bundle\") pod \"45a0611a-315a-47a4-aa28-68ef6f90dc7d\" (UID: \"45a0611a-315a-47a4-aa28-68ef6f90dc7d\") "
Jul 16 11:59:15.337229 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:15.337203    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45a0611a-315a-47a4-aa28-68ef6f90dc7d-bundle" (OuterVolumeSpecName: "bundle") pod "45a0611a-315a-47a4-aa28-68ef6f90dc7d" (UID: "45a0611a-315a-47a4-aa28-68ef6f90dc7d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:59:15.338802 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:15.338777    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45a0611a-315a-47a4-aa28-68ef6f90dc7d-kube-api-access-f59zv" (OuterVolumeSpecName: "kube-api-access-f59zv") pod "45a0611a-315a-47a4-aa28-68ef6f90dc7d" (UID: "45a0611a-315a-47a4-aa28-68ef6f90dc7d"). InnerVolumeSpecName "kube-api-access-f59zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:59:15.341815 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:15.341789    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45a0611a-315a-47a4-aa28-68ef6f90dc7d-util" (OuterVolumeSpecName: "util") pod "45a0611a-315a-47a4-aa28-68ef6f90dc7d" (UID: "45a0611a-315a-47a4-aa28-68ef6f90dc7d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:59:15.437643 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:15.437552    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45a0611a-315a-47a4-aa28-68ef6f90dc7d-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:59:15.437643 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:15.437584    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45a0611a-315a-47a4-aa28-68ef6f90dc7d-util\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:59:15.437643 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:15.437594    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f59zv\" (UniqueName: \"kubernetes.io/projected/45a0611a-315a-47a4-aa28-68ef6f90dc7d-kube-api-access-f59zv\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 11:59:16.159216 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:16.159191    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t"
Jul 16 11:59:16.159610 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:16.159219    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t" event={"ID":"45a0611a-315a-47a4-aa28-68ef6f90dc7d","Type":"ContainerDied","Data":"3ac25a79ca00259fabf3c79feb741061abcff8767194698aab56a306ebaa6f58"}
Jul 16 11:59:16.159610 ip-10-0-129-78 kubenswrapper[2564]: I0716 11:59:16.159259    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ac25a79ca00259fabf3c79feb741061abcff8767194698aab56a306ebaa6f58"
Jul 16 12:00:30.353006 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.352973    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353310    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9272f491-ef17-45d3-bc56-fc9b760d3648" containerName="extract"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353322    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9272f491-ef17-45d3-bc56-fc9b760d3648" containerName="extract"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353347    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28383a56-3f32-43d0-95ca-7b2aa1ec3427" containerName="extract"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353353    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="28383a56-3f32-43d0-95ca-7b2aa1ec3427" containerName="extract"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353363    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28383a56-3f32-43d0-95ca-7b2aa1ec3427" containerName="pull"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353369    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="28383a56-3f32-43d0-95ca-7b2aa1ec3427" containerName="pull"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353378    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a0611a-315a-47a4-aa28-68ef6f90dc7d" containerName="util"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353383    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a0611a-315a-47a4-aa28-68ef6f90dc7d" containerName="util"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353390    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9272f491-ef17-45d3-bc56-fc9b760d3648" containerName="util"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353394    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9272f491-ef17-45d3-bc56-fc9b760d3648" containerName="util"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353400    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28383a56-3f32-43d0-95ca-7b2aa1ec3427" containerName="util"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353405    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="28383a56-3f32-43d0-95ca-7b2aa1ec3427" containerName="util"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353411    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90b8c1bc-8179-48af-abde-791e9e86a979" containerName="pull"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353415    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="90b8c1bc-8179-48af-abde-791e9e86a979" containerName="pull"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353423    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90b8c1bc-8179-48af-abde-791e9e86a979" containerName="util"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353428    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="90b8c1bc-8179-48af-abde-791e9e86a979" containerName="util"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353433    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9272f491-ef17-45d3-bc56-fc9b760d3648" containerName="pull"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353437    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9272f491-ef17-45d3-bc56-fc9b760d3648" containerName="pull"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353441    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a0611a-315a-47a4-aa28-68ef6f90dc7d" containerName="pull"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353446    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a0611a-315a-47a4-aa28-68ef6f90dc7d" containerName="pull"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353452    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90b8c1bc-8179-48af-abde-791e9e86a979" containerName="extract"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353457    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="90b8c1bc-8179-48af-abde-791e9e86a979" containerName="extract"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353463    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a0611a-315a-47a4-aa28-68ef6f90dc7d" containerName="extract"
Jul 16 12:00:30.353491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353467    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a0611a-315a-47a4-aa28-68ef6f90dc7d" containerName="extract"
Jul 16 12:00:30.354228 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353515    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="28383a56-3f32-43d0-95ca-7b2aa1ec3427" containerName="extract"
Jul 16 12:00:30.354228 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353523    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9272f491-ef17-45d3-bc56-fc9b760d3648" containerName="extract"
Jul 16 12:00:30.354228 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353530    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="90b8c1bc-8179-48af-abde-791e9e86a979" containerName="extract"
Jul 16 12:00:30.354228 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.353535    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="45a0611a-315a-47a4-aa28-68ef6f90dc7d" containerName="extract"
Jul 16 12:00:30.356726 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.356708    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7brcb"
Jul 16 12:00:30.370041 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.370017    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 12:00:30.370297 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.370275    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/32da4eec-08f5-40e2-b357-e77c2154ece7-config-file\") pod \"limitador-limitador-54d6d988d5-7brcb\" (UID: \"32da4eec-08f5-40e2-b357-e77c2154ece7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7brcb"
Jul 16 12:00:30.370413 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.370377    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2lv4\" (UniqueName: \"kubernetes.io/projected/32da4eec-08f5-40e2-b357-e77c2154ece7-kube-api-access-x2lv4\") pod \"limitador-limitador-54d6d988d5-7brcb\" (UID: \"32da4eec-08f5-40e2-b357-e77c2154ece7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7brcb"
Jul 16 12:00:30.370923 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.370898    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xm2kv\""
Jul 16 12:00:30.371171 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.371152    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 12:00:30.373955 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.373934    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:00:30.377889 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.377870    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 12:00:30.400711 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.400677    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:00:30.471654 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.471618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/32da4eec-08f5-40e2-b357-e77c2154ece7-config-file\") pod \"limitador-limitador-54d6d988d5-7brcb\" (UID: \"32da4eec-08f5-40e2-b357-e77c2154ece7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7brcb"
Jul 16 12:00:30.471830 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.471689    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2lv4\" (UniqueName: \"kubernetes.io/projected/32da4eec-08f5-40e2-b357-e77c2154ece7-kube-api-access-x2lv4\") pod \"limitador-limitador-54d6d988d5-7brcb\" (UID: \"32da4eec-08f5-40e2-b357-e77c2154ece7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7brcb"
Jul 16 12:00:30.472246 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.472226    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/32da4eec-08f5-40e2-b357-e77c2154ece7-config-file\") pod \"limitador-limitador-54d6d988d5-7brcb\" (UID: \"32da4eec-08f5-40e2-b357-e77c2154ece7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7brcb"
Jul 16 12:00:30.502277 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.502245    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2lv4\" (UniqueName: \"kubernetes.io/projected/32da4eec-08f5-40e2-b357-e77c2154ece7-kube-api-access-x2lv4\") pod \"limitador-limitador-54d6d988d5-7brcb\" (UID: \"32da4eec-08f5-40e2-b357-e77c2154ece7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7brcb"
Jul 16 12:00:30.666879 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.666843    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7brcb"
Jul 16 12:00:30.803731 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:30.803705    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:00:30.805763 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:00:30.805734    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32da4eec_08f5_40e2_b357_e77c2154ece7.slice/crio-4e778f2002b4630279b63f1b5ba5173f253380897bba3f30469224543296ab5f WatchSource:0}: Error finding container 4e778f2002b4630279b63f1b5ba5173f253380897bba3f30469224543296ab5f: Status 404 returned error can't find the container with id 4e778f2002b4630279b63f1b5ba5173f253380897bba3f30469224543296ab5f
Jul 16 12:00:31.258731 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:31.258698    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-tf9md"]
Jul 16 12:00:31.263020 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:31.263002    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tf9md"
Jul 16 12:00:31.268063 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:31.268044    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vjwgt\""
Jul 16 12:00:31.278840 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:31.278813    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfrdx\" (UniqueName: \"kubernetes.io/projected/cba24122-78f5-4d81-9ab8-014d8ebda95e-kube-api-access-bfrdx\") pod \"authorino-75d556bd77-tf9md\" (UID: \"cba24122-78f5-4d81-9ab8-014d8ebda95e\") " pod="kuadrant-system/authorino-75d556bd77-tf9md"
Jul 16 12:00:31.288503 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:31.288480    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tf9md"]
Jul 16 12:00:31.379461 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:31.379426    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfrdx\" (UniqueName: \"kubernetes.io/projected/cba24122-78f5-4d81-9ab8-014d8ebda95e-kube-api-access-bfrdx\") pod \"authorino-75d556bd77-tf9md\" (UID: \"cba24122-78f5-4d81-9ab8-014d8ebda95e\") " pod="kuadrant-system/authorino-75d556bd77-tf9md"
Jul 16 12:00:31.389798 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:31.389766    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfrdx\" (UniqueName: \"kubernetes.io/projected/cba24122-78f5-4d81-9ab8-014d8ebda95e-kube-api-access-bfrdx\") pod \"authorino-75d556bd77-tf9md\" (UID: \"cba24122-78f5-4d81-9ab8-014d8ebda95e\") " pod="kuadrant-system/authorino-75d556bd77-tf9md"
Jul 16 12:00:31.555463 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:31.555380    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7brcb" event={"ID":"32da4eec-08f5-40e2-b357-e77c2154ece7","Type":"ContainerStarted","Data":"4e778f2002b4630279b63f1b5ba5173f253380897bba3f30469224543296ab5f"}
Jul 16 12:00:31.572639 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:31.572608    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tf9md"
Jul 16 12:00:31.706993 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:31.706875    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tf9md"]
Jul 16 12:00:31.709167 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:00:31.709143    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcba24122_78f5_4d81_9ab8_014d8ebda95e.slice/crio-92b6d6be431b1abb1d74e961796b574a68bf9b043dc3dea800627a53490b7a12 WatchSource:0}: Error finding container 92b6d6be431b1abb1d74e961796b574a68bf9b043dc3dea800627a53490b7a12: Status 404 returned error can't find the container with id 92b6d6be431b1abb1d74e961796b574a68bf9b043dc3dea800627a53490b7a12
Jul 16 12:00:32.563850 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:32.563318    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tf9md" event={"ID":"cba24122-78f5-4d81-9ab8-014d8ebda95e","Type":"ContainerStarted","Data":"92b6d6be431b1abb1d74e961796b574a68bf9b043dc3dea800627a53490b7a12"}
Jul 16 12:00:37.594965 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:37.594926    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7brcb" event={"ID":"32da4eec-08f5-40e2-b357-e77c2154ece7","Type":"ContainerStarted","Data":"e89f4d365240abb8a86f9f58a924b1196eae50279d9816610a92581c6d236968"}
Jul 16 12:00:37.595494 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:37.595029    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7brcb"
Jul 16 12:00:37.596611 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:37.596589    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tf9md" event={"ID":"cba24122-78f5-4d81-9ab8-014d8ebda95e","Type":"ContainerStarted","Data":"c5463b0d681431cf3e382ef39f692eafbdc70e61fe1475b706b64ec7033ef884"}
Jul 16 12:00:37.615223 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:37.615170    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-7brcb" podStartSLOduration=1.709618876 podStartE2EDuration="7.615156554s" totalImagesPullingTime="5.905537678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:00:37.613120382 +0000 UTC m=+566.247914466" watchObservedRunningTime="2026-07-16 12:00:37.615156554 +0000 UTC m=+566.249950668"
Jul 16 12:00:37.635289 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:37.635235    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-tf9md" podStartSLOduration=1.625394294 podStartE2EDuration="6.635219696s" totalImagesPullingTime="5.009825402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:00:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:00:37.633701226 +0000 UTC m=+566.268495297" watchObservedRunningTime="2026-07-16 12:00:37.635219696 +0000 UTC m=+566.270013822"
Jul 16 12:00:48.604835 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:00:48.604803    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7brcb"
Jul 16 12:01:06.884350 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:06.884301    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tf9md"]
Jul 16 12:01:06.884764 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:06.884509    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-tf9md" podUID="cba24122-78f5-4d81-9ab8-014d8ebda95e" containerName="authorino" containerID="cri-o://c5463b0d681431cf3e382ef39f692eafbdc70e61fe1475b706b64ec7033ef884" gracePeriod=30
Jul 16 12:01:07.165042 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:07.165010    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tf9md"
Jul 16 12:01:07.304697 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:07.304657    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfrdx\" (UniqueName: \"kubernetes.io/projected/cba24122-78f5-4d81-9ab8-014d8ebda95e-kube-api-access-bfrdx\") pod \"cba24122-78f5-4d81-9ab8-014d8ebda95e\" (UID: \"cba24122-78f5-4d81-9ab8-014d8ebda95e\") "
Jul 16 12:01:07.306919 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:07.306886    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cba24122-78f5-4d81-9ab8-014d8ebda95e-kube-api-access-bfrdx" (OuterVolumeSpecName: "kube-api-access-bfrdx") pod "cba24122-78f5-4d81-9ab8-014d8ebda95e" (UID: "cba24122-78f5-4d81-9ab8-014d8ebda95e"). InnerVolumeSpecName "kube-api-access-bfrdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:01:07.406225 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:07.406133    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfrdx\" (UniqueName: \"kubernetes.io/projected/cba24122-78f5-4d81-9ab8-014d8ebda95e-kube-api-access-bfrdx\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:01:07.745240 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:07.745153    2564 generic.go:356] "Generic (PLEG): container finished" podID="cba24122-78f5-4d81-9ab8-014d8ebda95e" containerID="c5463b0d681431cf3e382ef39f692eafbdc70e61fe1475b706b64ec7033ef884" exitCode=0
Jul 16 12:01:07.745240 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:07.745199    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tf9md"
Jul 16 12:01:07.745453 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:07.745246    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tf9md" event={"ID":"cba24122-78f5-4d81-9ab8-014d8ebda95e","Type":"ContainerDied","Data":"c5463b0d681431cf3e382ef39f692eafbdc70e61fe1475b706b64ec7033ef884"}
Jul 16 12:01:07.745453 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:07.745297    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tf9md" event={"ID":"cba24122-78f5-4d81-9ab8-014d8ebda95e","Type":"ContainerDied","Data":"92b6d6be431b1abb1d74e961796b574a68bf9b043dc3dea800627a53490b7a12"}
Jul 16 12:01:07.745453 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:07.745320    2564 scope.go:117] "RemoveContainer" containerID="c5463b0d681431cf3e382ef39f692eafbdc70e61fe1475b706b64ec7033ef884"
Jul 16 12:01:07.754582 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:07.754566    2564 scope.go:117] "RemoveContainer" containerID="c5463b0d681431cf3e382ef39f692eafbdc70e61fe1475b706b64ec7033ef884"
Jul 16 12:01:07.754828 ip-10-0-129-78 kubenswrapper[2564]: E0716 12:01:07.754806    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5463b0d681431cf3e382ef39f692eafbdc70e61fe1475b706b64ec7033ef884\": container with ID starting with c5463b0d681431cf3e382ef39f692eafbdc70e61fe1475b706b64ec7033ef884 not found: ID does not exist" containerID="c5463b0d681431cf3e382ef39f692eafbdc70e61fe1475b706b64ec7033ef884"
Jul 16 12:01:07.754928 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:07.754837    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5463b0d681431cf3e382ef39f692eafbdc70e61fe1475b706b64ec7033ef884"} err="failed to get container status \"c5463b0d681431cf3e382ef39f692eafbdc70e61fe1475b706b64ec7033ef884\": rpc error: code = NotFound desc = could not find container \"c5463b0d681431cf3e382ef39f692eafbdc70e61fe1475b706b64ec7033ef884\": container with ID starting with c5463b0d681431cf3e382ef39f692eafbdc70e61fe1475b706b64ec7033ef884 not found: ID does not exist"
Jul 16 12:01:07.777109 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:07.777077    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tf9md"]
Jul 16 12:01:07.792393 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:07.792361    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tf9md"]
Jul 16 12:01:07.854992 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:07.854960    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cba24122-78f5-4d81-9ab8-014d8ebda95e" path="/var/lib/kubelet/pods/cba24122-78f5-4d81-9ab8-014d8ebda95e/volumes"
Jul 16 12:01:11.751134 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:11.751108    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 12:01:11.754465 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:11.754444    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 12:01:50.762284 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:01:50.762202    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:02:25.247411 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:02:25.247376    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:02:47.155820 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:02:47.155783    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:03:01.996926 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:01.996841    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:03:17.676594 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:17.676559    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:03:26.819176 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:26.819140    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:03:29.990406 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:29.990373    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"]
Jul 16 12:03:29.990777 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:29.990692    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cba24122-78f5-4d81-9ab8-014d8ebda95e" containerName="authorino"
Jul 16 12:03:29.990777 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:29.990702    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cba24122-78f5-4d81-9ab8-014d8ebda95e" containerName="authorino"
Jul 16 12:03:29.990777 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:29.990757    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cba24122-78f5-4d81-9ab8-014d8ebda95e" containerName="authorino"
Jul 16 12:03:29.992747 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:29.992731    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:29.996503 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:29.996476    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 12:03:29.997003 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:29.996989    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6577m\""
Jul 16 12:03:29.997720 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:29.997702    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 12:03:29.997772 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:29.997718    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 16 12:03:30.005818 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.005792    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"]
Jul 16 12:03:30.167913 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.167879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04ab4861-d25c-486a-a250-f57f58507438-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.167913 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.167916    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04ab4861-d25c-486a-a250-f57f58507438-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.168139 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.167948    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz5xp\" (UniqueName: \"kubernetes.io/projected/04ab4861-d25c-486a-a250-f57f58507438-kube-api-access-dz5xp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.168139 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.168030    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04ab4861-d25c-486a-a250-f57f58507438-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.168139 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.168065    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04ab4861-d25c-486a-a250-f57f58507438-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.168139 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.168102    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04ab4861-d25c-486a-a250-f57f58507438-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.268766 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.268676    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04ab4861-d25c-486a-a250-f57f58507438-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.268766 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.268723    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04ab4861-d25c-486a-a250-f57f58507438-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.268766 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.268757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz5xp\" (UniqueName: \"kubernetes.io/projected/04ab4861-d25c-486a-a250-f57f58507438-kube-api-access-dz5xp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.269011 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.268783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04ab4861-d25c-486a-a250-f57f58507438-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.269011 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.268813    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04ab4861-d25c-486a-a250-f57f58507438-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.269011 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.268856    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04ab4861-d25c-486a-a250-f57f58507438-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.269180 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.269129    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04ab4861-d25c-486a-a250-f57f58507438-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.269228 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.269192    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04ab4861-d25c-486a-a250-f57f58507438-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.269290 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.269260    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04ab4861-d25c-486a-a250-f57f58507438-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.271094 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.271075    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04ab4861-d25c-486a-a250-f57f58507438-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.271481 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.271462    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04ab4861-d25c-486a-a250-f57f58507438-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.278390 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.278364    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz5xp\" (UniqueName: \"kubernetes.io/projected/04ab4861-d25c-486a-a250-f57f58507438-kube-api-access-dz5xp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4\" (UID: \"04ab4861-d25c-486a-a250-f57f58507438\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.302387 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.302347    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:30.445769 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.445738    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"]
Jul 16 12:03:30.447137 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:03:30.447114    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04ab4861_d25c_486a_a250_f57f58507438.slice/crio-35bf608c554cec4da8f371c78cc9cc7e6e1c9772c2820a4ebd94e4190985e520 WatchSource:0}: Error finding container 35bf608c554cec4da8f371c78cc9cc7e6e1c9772c2820a4ebd94e4190985e520: Status 404 returned error can't find the container with id 35bf608c554cec4da8f371c78cc9cc7e6e1c9772c2820a4ebd94e4190985e520
Jul 16 12:03:30.448555 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.448536    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 12:03:30.466823 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:30.466793    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4" event={"ID":"04ab4861-d25c-486a-a250-f57f58507438","Type":"ContainerStarted","Data":"35bf608c554cec4da8f371c78cc9cc7e6e1c9772c2820a4ebd94e4190985e520"}
Jul 16 12:03:38.820911 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:38.820873    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:03:44.538617 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:44.538557    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4" event={"ID":"04ab4861-d25c-486a-a250-f57f58507438","Type":"ContainerStarted","Data":"f8d76b14fff3f6f01ab7dec423ad57ff385e159647c4b1d50c180b2184e934ac"}
Jul 16 12:03:44.570744 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:44.570688    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4" podStartSLOduration=2.259543324 podStartE2EDuration="15.570673079s" totalImagesPullingTime="13.311129755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:03:44.570245717 +0000 UTC m=+753.205039787" watchObservedRunningTime="2026-07-16 12:03:44.570673079 +0000 UTC m=+753.205467185"
Jul 16 12:03:50.302576 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:50.302531    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:50.303028 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:50.302591    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:50.314933 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:50.314902    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:03:50.582098 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:03:50.582016    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4"
Jul 16 12:04:21.552896 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:21.552863    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76b955f8f8-zp75h"]
Jul 16 12:04:21.555104 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:21.555088    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76b955f8f8-zp75h"
Jul 16 12:04:21.559139 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:21.559112    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 16 12:04:21.560157 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:21.560139    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vjwgt\""
Jul 16 12:04:21.568571 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:21.568553    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76b955f8f8-zp75h"]
Jul 16 12:04:21.673352 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:21.673310    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5s62\" (UniqueName: \"kubernetes.io/projected/61dd6670-0366-4d6d-94be-6b0d455e6d5a-kube-api-access-g5s62\") pod \"authorino-76b955f8f8-zp75h\" (UID: \"61dd6670-0366-4d6d-94be-6b0d455e6d5a\") " pod="kuadrant-system/authorino-76b955f8f8-zp75h"
Jul 16 12:04:21.673506 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:21.673393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/61dd6670-0366-4d6d-94be-6b0d455e6d5a-tls-cert\") pod \"authorino-76b955f8f8-zp75h\" (UID: \"61dd6670-0366-4d6d-94be-6b0d455e6d5a\") " pod="kuadrant-system/authorino-76b955f8f8-zp75h"
Jul 16 12:04:21.773991 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:21.773958    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5s62\" (UniqueName: \"kubernetes.io/projected/61dd6670-0366-4d6d-94be-6b0d455e6d5a-kube-api-access-g5s62\") pod \"authorino-76b955f8f8-zp75h\" (UID: \"61dd6670-0366-4d6d-94be-6b0d455e6d5a\") " pod="kuadrant-system/authorino-76b955f8f8-zp75h"
Jul 16 12:04:21.774133 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:21.774030    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/61dd6670-0366-4d6d-94be-6b0d455e6d5a-tls-cert\") pod \"authorino-76b955f8f8-zp75h\" (UID: \"61dd6670-0366-4d6d-94be-6b0d455e6d5a\") " pod="kuadrant-system/authorino-76b955f8f8-zp75h"
Jul 16 12:04:21.776522 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:21.776503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/61dd6670-0366-4d6d-94be-6b0d455e6d5a-tls-cert\") pod \"authorino-76b955f8f8-zp75h\" (UID: \"61dd6670-0366-4d6d-94be-6b0d455e6d5a\") " pod="kuadrant-system/authorino-76b955f8f8-zp75h"
Jul 16 12:04:21.796593 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:21.796568    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5s62\" (UniqueName: \"kubernetes.io/projected/61dd6670-0366-4d6d-94be-6b0d455e6d5a-kube-api-access-g5s62\") pod \"authorino-76b955f8f8-zp75h\" (UID: \"61dd6670-0366-4d6d-94be-6b0d455e6d5a\") " pod="kuadrant-system/authorino-76b955f8f8-zp75h"
Jul 16 12:04:21.863842 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:21.863747    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76b955f8f8-zp75h"
Jul 16 12:04:22.004781 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.004639    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76b955f8f8-zp75h"]
Jul 16 12:04:22.007428 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:04:22.007396    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61dd6670_0366_4d6d_94be_6b0d455e6d5a.slice/crio-3bf585af588682eb39b422e8105045b0ceeddad4fc9898a1627e4c4438b8ae9c WatchSource:0}: Error finding container 3bf585af588682eb39b422e8105045b0ceeddad4fc9898a1627e4c4438b8ae9c: Status 404 returned error can't find the container with id 3bf585af588682eb39b422e8105045b0ceeddad4fc9898a1627e4c4438b8ae9c
Jul 16 12:04:22.727622 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.727534    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76b955f8f8-zp75h" event={"ID":"61dd6670-0366-4d6d-94be-6b0d455e6d5a","Type":"ContainerStarted","Data":"8b985e26d43e7e124b7958106bada06b36ab01d6d48f5c1376338f8aa0351388"}
Jul 16 12:04:22.727622 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.727582    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76b955f8f8-zp75h" event={"ID":"61dd6670-0366-4d6d-94be-6b0d455e6d5a","Type":"ContainerStarted","Data":"3bf585af588682eb39b422e8105045b0ceeddad4fc9898a1627e4c4438b8ae9c"}
Jul 16 12:04:22.750737 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.750712    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d474f4484-drzd9"]
Jul 16 12:04:22.752965 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.752950    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.776179 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.776117    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76b955f8f8-zp75h" podStartSLOduration=1.323778859 podStartE2EDuration="1.776101336s" totalImagesPullingTime="452.322477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:04:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:04:22.774474939 +0000 UTC m=+791.409269045" watchObservedRunningTime="2026-07-16 12:04:22.776101336 +0000 UTC m=+791.410895406"
Jul 16 12:04:22.782042 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.782012    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d474f4484-drzd9"]
Jul 16 12:04:22.883098 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.883065    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c39ca538-c0b0-4f17-af3e-6bc175714ee3-console-config\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.883098 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.883100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c39ca538-c0b0-4f17-af3e-6bc175714ee3-oauth-serving-cert\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.883417 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.883137    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c39ca538-c0b0-4f17-af3e-6bc175714ee3-console-oauth-config\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.883417 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.883154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr6kk\" (UniqueName: \"kubernetes.io/projected/c39ca538-c0b0-4f17-af3e-6bc175714ee3-kube-api-access-kr6kk\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.883417 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.883286    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c39ca538-c0b0-4f17-af3e-6bc175714ee3-service-ca\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.883417 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.883371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c39ca538-c0b0-4f17-af3e-6bc175714ee3-console-serving-cert\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.883417 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.883400    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c39ca538-c0b0-4f17-af3e-6bc175714ee3-trusted-ca-bundle\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.984487 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.984413    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c39ca538-c0b0-4f17-af3e-6bc175714ee3-console-config\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.984487 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.984447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c39ca538-c0b0-4f17-af3e-6bc175714ee3-oauth-serving-cert\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.984487 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.984485    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c39ca538-c0b0-4f17-af3e-6bc175714ee3-console-oauth-config\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.984721 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.984615    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr6kk\" (UniqueName: \"kubernetes.io/projected/c39ca538-c0b0-4f17-af3e-6bc175714ee3-kube-api-access-kr6kk\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.984761 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.984718    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c39ca538-c0b0-4f17-af3e-6bc175714ee3-service-ca\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.984819 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.984758    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c39ca538-c0b0-4f17-af3e-6bc175714ee3-console-serving-cert\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.984819 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.984785    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c39ca538-c0b0-4f17-af3e-6bc175714ee3-trusted-ca-bundle\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.985404 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.985372    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c39ca538-c0b0-4f17-af3e-6bc175714ee3-console-config\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.985531 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.985420    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c39ca538-c0b0-4f17-af3e-6bc175714ee3-oauth-serving-cert\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.985531 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.985433    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c39ca538-c0b0-4f17-af3e-6bc175714ee3-service-ca\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.985820 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.985563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c39ca538-c0b0-4f17-af3e-6bc175714ee3-trusted-ca-bundle\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.987145 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.987118    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c39ca538-c0b0-4f17-af3e-6bc175714ee3-console-oauth-config\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:22.987550 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:22.987530    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c39ca538-c0b0-4f17-af3e-6bc175714ee3-console-serving-cert\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:23.016270 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:23.016248    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr6kk\" (UniqueName: \"kubernetes.io/projected/c39ca538-c0b0-4f17-af3e-6bc175714ee3-kube-api-access-kr6kk\") pod \"console-7d474f4484-drzd9\" (UID: \"c39ca538-c0b0-4f17-af3e-6bc175714ee3\") " pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:23.063412 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:23.063376    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:23.218919 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:04:23.218009    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39ca538_c0b0_4f17_af3e_6bc175714ee3.slice/crio-fe989318787194f735f273311fa3281c11be9d5ba53a778569771f62a3c35c80 WatchSource:0}: Error finding container fe989318787194f735f273311fa3281c11be9d5ba53a778569771f62a3c35c80: Status 404 returned error can't find the container with id fe989318787194f735f273311fa3281c11be9d5ba53a778569771f62a3c35c80
Jul 16 12:04:23.218919 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:23.218213    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d474f4484-drzd9"]
Jul 16 12:04:23.734761 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:23.734720    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d474f4484-drzd9" event={"ID":"c39ca538-c0b0-4f17-af3e-6bc175714ee3","Type":"ContainerStarted","Data":"fcf178e6728d98a384955e987c2392914958bcf7e75684246b25ecc269a2b43c"}
Jul 16 12:04:23.735151 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:23.734825    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d474f4484-drzd9" event={"ID":"c39ca538-c0b0-4f17-af3e-6bc175714ee3","Type":"ContainerStarted","Data":"fe989318787194f735f273311fa3281c11be9d5ba53a778569771f62a3c35c80"}
Jul 16 12:04:23.787241 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:23.787184    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d474f4484-drzd9" podStartSLOduration=1.787162759 podStartE2EDuration="1.787162759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:04:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:04:23.785267828 +0000 UTC m=+792.420061910" watchObservedRunningTime="2026-07-16 12:04:23.787162759 +0000 UTC m=+792.421956831"
Jul 16 12:04:33.063927 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:33.063846    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:33.063927 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:33.063915    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:33.068411 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:33.068390    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:33.795139 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:33.795103    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d474f4484-drzd9"
Jul 16 12:04:33.859954 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:33.859917    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79f9bf858b-lhr7g"]
Jul 16 12:04:53.796697 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:53.796666    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:04:58.881195 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:58.881148    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79f9bf858b-lhr7g" podUID="1fda5593-856d-4c30-a9b4-3eefb959d8d6" containerName="console" containerID="cri-o://b97b61d67e57c16f32673f4b1d97afb63f0c449e5469697d7bec702f879e3981" gracePeriod=15
Jul 16 12:04:59.131186 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.131156    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 12:04:59.208361 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.208254    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-oauth-serving-cert\") pod \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") "
Jul 16 12:04:59.208361 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.208298    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-oauth-config\") pod \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") "
Jul 16 12:04:59.208361 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.208360    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-trusted-ca-bundle\") pod \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") "
Jul 16 12:04:59.208631 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.208465    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fvjs\" (UniqueName: \"kubernetes.io/projected/1fda5593-856d-4c30-a9b4-3eefb959d8d6-kube-api-access-6fvjs\") pod \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") "
Jul 16 12:04:59.208631 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.208534    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-serving-cert\") pod \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") "
Jul 16 12:04:59.208631 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.208568    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-config\") pod \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") "
Jul 16 12:04:59.208631 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.208606    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-service-ca\") pod \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\" (UID: \"1fda5593-856d-4c30-a9b4-3eefb959d8d6\") "
Jul 16 12:04:59.208837 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.208679    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1fda5593-856d-4c30-a9b4-3eefb959d8d6" (UID: "1fda5593-856d-4c30-a9b4-3eefb959d8d6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:04:59.208837 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.208713    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1fda5593-856d-4c30-a9b4-3eefb959d8d6" (UID: "1fda5593-856d-4c30-a9b4-3eefb959d8d6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:04:59.208935 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.208888    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-oauth-serving-cert\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:04:59.208935 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.208908    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-trusted-ca-bundle\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:04:59.209023 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.208934    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-config" (OuterVolumeSpecName: "console-config") pod "1fda5593-856d-4c30-a9b4-3eefb959d8d6" (UID: "1fda5593-856d-4c30-a9b4-3eefb959d8d6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:04:59.209074 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.209033    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-service-ca" (OuterVolumeSpecName: "service-ca") pod "1fda5593-856d-4c30-a9b4-3eefb959d8d6" (UID: "1fda5593-856d-4c30-a9b4-3eefb959d8d6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:04:59.210718 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.210692    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1fda5593-856d-4c30-a9b4-3eefb959d8d6" (UID: "1fda5593-856d-4c30-a9b4-3eefb959d8d6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:04:59.211228 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.211206    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1fda5593-856d-4c30-a9b4-3eefb959d8d6" (UID: "1fda5593-856d-4c30-a9b4-3eefb959d8d6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:04:59.211228 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.211218    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fda5593-856d-4c30-a9b4-3eefb959d8d6-kube-api-access-6fvjs" (OuterVolumeSpecName: "kube-api-access-6fvjs") pod "1fda5593-856d-4c30-a9b4-3eefb959d8d6" (UID: "1fda5593-856d-4c30-a9b4-3eefb959d8d6"). InnerVolumeSpecName "kube-api-access-6fvjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:04:59.309513 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.309482    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-oauth-config\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:04:59.309513 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.309511    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fvjs\" (UniqueName: \"kubernetes.io/projected/1fda5593-856d-4c30-a9b4-3eefb959d8d6-kube-api-access-6fvjs\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:04:59.309705 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.309526    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-serving-cert\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:04:59.309705 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.309539    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-console-config\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:04:59.309705 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.309551    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fda5593-856d-4c30-a9b4-3eefb959d8d6-service-ca\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:04:59.917495 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.917459    2564 generic.go:356] "Generic (PLEG): container finished" podID="1fda5593-856d-4c30-a9b4-3eefb959d8d6" containerID="b97b61d67e57c16f32673f4b1d97afb63f0c449e5469697d7bec702f879e3981" exitCode=0
Jul 16 12:04:59.917866 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.917503    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f9bf858b-lhr7g"
Jul 16 12:04:59.917866 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.917537    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f9bf858b-lhr7g" event={"ID":"1fda5593-856d-4c30-a9b4-3eefb959d8d6","Type":"ContainerDied","Data":"b97b61d67e57c16f32673f4b1d97afb63f0c449e5469697d7bec702f879e3981"}
Jul 16 12:04:59.917866 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.917587    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f9bf858b-lhr7g" event={"ID":"1fda5593-856d-4c30-a9b4-3eefb959d8d6","Type":"ContainerDied","Data":"187e71b66b1c3e9adeeaa1eb464b4a308acd0d69b99eb2e1c1e4ae1e8bff5e79"}
Jul 16 12:04:59.917866 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.917614    2564 scope.go:117] "RemoveContainer" containerID="b97b61d67e57c16f32673f4b1d97afb63f0c449e5469697d7bec702f879e3981"
Jul 16 12:04:59.926286 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.926270    2564 scope.go:117] "RemoveContainer" containerID="b97b61d67e57c16f32673f4b1d97afb63f0c449e5469697d7bec702f879e3981"
Jul 16 12:04:59.926584 ip-10-0-129-78 kubenswrapper[2564]: E0716 12:04:59.926564    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b97b61d67e57c16f32673f4b1d97afb63f0c449e5469697d7bec702f879e3981\": container with ID starting with b97b61d67e57c16f32673f4b1d97afb63f0c449e5469697d7bec702f879e3981 not found: ID does not exist" containerID="b97b61d67e57c16f32673f4b1d97afb63f0c449e5469697d7bec702f879e3981"
Jul 16 12:04:59.926672 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.926592    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b97b61d67e57c16f32673f4b1d97afb63f0c449e5469697d7bec702f879e3981"} err="failed to get container status \"b97b61d67e57c16f32673f4b1d97afb63f0c449e5469697d7bec702f879e3981\": rpc error: code = NotFound desc = could not find container \"b97b61d67e57c16f32673f4b1d97afb63f0c449e5469697d7bec702f879e3981\": container with ID starting with b97b61d67e57c16f32673f4b1d97afb63f0c449e5469697d7bec702f879e3981 not found: ID does not exist"
Jul 16 12:04:59.941698 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.941669    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79f9bf858b-lhr7g"]
Jul 16 12:04:59.946334 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:04:59.946295    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79f9bf858b-lhr7g"]
Jul 16 12:05:01.857274 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:05:01.857239    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fda5593-856d-4c30-a9b4-3eefb959d8d6" path="/var/lib/kubelet/pods/1fda5593-856d-4c30-a9b4-3eefb959d8d6/volumes"
Jul 16 12:05:03.101257 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:05:03.101219    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:05:14.900204 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:05:14.900169    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:05:23.788030 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:05:23.788000    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:05:36.520452 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:05:36.520414    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:06:03.680096 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:06:03.680013    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:06:11.787969 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:06:11.787939    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 12:06:11.790347 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:06:11.790310    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 12:06:15.627428 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:06:15.627392    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:06:56.721358 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:06:56.721315    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:07:09.413077 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:07:09.413039    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:07:25.798387 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:07:25.798349    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:07:37.131222 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:07:37.131140    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:07:49.702511 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:07:49.702467    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:08:02.953864 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:08:02.953827    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:08:14.036534 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:08:14.036500    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:08:24.115982 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:08:24.115946    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:08:49.325716 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:08:49.325678    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:09:01.395756 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:09:01.395723    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:09:25.007274 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:09:25.007244    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:09:34.994864 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:09:34.994829    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:09:50.805366 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:09:50.805315    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:10:03.008789 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:10:03.008746    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:10:12.933814 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:10:12.933776    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:10:25.409748 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:10:25.409711    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:11:11.822885 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:11:11.822855    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 12:11:11.823356 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:11:11.823025    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 12:12:19.911045 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:12:19.911009    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:12:32.297123 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:12:32.297090    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:12:41.464096 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:12:41.464045    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:12:53.167426 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:12:53.167388    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:13:04.707861 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:13:04.707828    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:13:14.197580 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:13:14.197549    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:13:21.911050 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:13:21.911010    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:13:30.950672 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:13:30.950637    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:13:39.140806 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:13:39.140596    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:13:49.122883 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:13:49.122844    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:13:56.893052 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:13:56.893007    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:14:07.094591 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:14:07.094551    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:14:30.121518 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:14:30.121485    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:14:40.028950 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:14:40.028909    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:14:49.314653 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:14:49.314617    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:14:59.897071 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:14:59.897033    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:15:16.816421 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:15:16.816346    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:15:26.225559 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:15:26.225523    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:15:36.316828 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:15:36.316792    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:15:43.919337 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:15:43.919295    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:15:53.870419 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:15:53.870380    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:16:03.333767 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:16:03.333729    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:16:11.854180 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:16:11.854151    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 12:16:11.856179 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:16:11.856160    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 12:16:16.097844 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:16:16.097806    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:16:26.054694 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:16:26.054659    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:16:44.696763 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:16:44.696679    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:16:59.595541 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:16:59.595505    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:17:07.816492 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:17:07.816451    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:17:20.812618 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:17:20.812577    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:17:33.654823 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:17:33.654786    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:17:43.098510 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:17:43.098476    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:17:51.400395 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:17:51.400354    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:18:00.196457 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:18:00.196423    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:18:21.737241 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:18:21.737204    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:18:38.502387 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:18:38.502345    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:19:48.411679 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:19:48.411644    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:20:09.096179 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:20:09.096144    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:21:09.587820 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:21:09.587788    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:21:11.885668 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:21:11.885641    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 12:21:11.888245 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:21:11.888225    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 12:21:29.424404 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:21:29.424370    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:22:39.393155 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:22:39.393110    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:23:01.709785 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:23:01.709752    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:24:01.592775 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:24:01.587747    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:25:37.795037 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:25:37.794957    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:25:46.888145 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:25:46.888102    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:26:02.486948 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:26:02.486915    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:26:11.916958 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:26:11.916928    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 12:26:11.922709 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:26:11.922688    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 12:26:21.087544 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:26:21.087507    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:27:04.696964 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:04.696883    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:27:15.562362 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.562314    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"]
Jul 16 12:27:15.562714 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.562650    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fda5593-856d-4c30-a9b4-3eefb959d8d6" containerName="console"
Jul 16 12:27:15.562714 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.562661    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fda5593-856d-4c30-a9b4-3eefb959d8d6" containerName="console"
Jul 16 12:27:15.562784 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.562729    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fda5593-856d-4c30-a9b4-3eefb959d8d6" containerName="console"
Jul 16 12:27:15.565512 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.565489    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.569787 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.569764    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4a07820d\"/\"kube-root-ca.crt\""
Jul 16 12:27:15.570078 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.570041    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4a07820d\"/\"openshift-service-ca.crt\""
Jul 16 12:27:15.570078 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.570058    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4a07820d\"/\"default-dockercfg-26mkc\""
Jul 16 12:27:15.570078 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.570058    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4a07820d\"/\"e2e-lifecycle-model-4a07820d-kserve-self-signed-certs\""
Jul 16 12:27:15.586910 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.586879    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"]
Jul 16 12:27:15.598922 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.598889    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-home\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.599084 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.598929    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-model-cache\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.599084 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.598951    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-dshm\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.599084 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.598966    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-tmp-dir\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.599084 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.599007    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-tls-certs\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.599084 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.599043    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkn8r\" (UniqueName: \"kubernetes.io/projected/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-kube-api-access-rkn8r\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.699510 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.699469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-model-cache\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.699695 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.699517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-dshm\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.699695 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.699543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-tmp-dir\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.699695 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.699569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-tls-certs\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.699695 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.699591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkn8r\" (UniqueName: \"kubernetes.io/projected/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-kube-api-access-rkn8r\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.699875 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.699725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-home\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.699945 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.699924    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-model-cache\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.700070 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.700046    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-home\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.700070 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.700044    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-tmp-dir\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.702145 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.702094    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-dshm\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.702378 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.702358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-tls-certs\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.712256 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.712225    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkn8r\" (UniqueName: \"kubernetes.io/projected/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-kube-api-access-rkn8r\") pod \"e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") " pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:15.874861 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:15.874831    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:16.010770 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:16.010744    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"]
Jul 16 12:27:16.012542 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:27:16.012516    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ec2ec3e_692e_4b69_b670_d2e9c9e7c696.slice/crio-86dcf10afc395623687ff9e69841c8176e02263070444935581841351e6af13d WatchSource:0}: Error finding container 86dcf10afc395623687ff9e69841c8176e02263070444935581841351e6af13d: Status 404 returned error can't find the container with id 86dcf10afc395623687ff9e69841c8176e02263070444935581841351e6af13d
Jul 16 12:27:16.671943 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:16.671903    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl" event={"ID":"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696","Type":"ContainerStarted","Data":"63e74b012b498bb43ffd5f2b0f3d3b68a130ca2475ba66a0c692958e2036d605"}
Jul 16 12:27:16.672313 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:16.671952    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl" event={"ID":"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696","Type":"ContainerStarted","Data":"86dcf10afc395623687ff9e69841c8176e02263070444935581841351e6af13d"}
Jul 16 12:27:16.689844 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:16.689790    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl" podStartSLOduration=1.689766193 podStartE2EDuration="1.689766193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:27:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:27:16.689520494 +0000 UTC m=+2165.324314567" watchObservedRunningTime="2026-07-16 12:27:16.689766193 +0000 UTC m=+2165.324560265"
Jul 16 12:27:19.919122 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:19.919083    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:27:25.875402 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:25.875353    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:25.875840 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:25.875650    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:25.888749 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:25.888715    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:26.734777 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:26.734743    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:27:32.890236 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:32.890198    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:27:50.796743 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:50.796711    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:27:56.210433 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:27:56.210392    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"]
Jul 16 12:28:11.232114 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.232050    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl" podUID="4ec2ec3e-692e-4b69-b670-d2e9c9e7c696" containerName="main" containerID="cri-o://63e74b012b498bb43ffd5f2b0f3d3b68a130ca2475ba66a0c692958e2036d605" gracePeriod=45
Jul 16 12:28:11.481120 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.481086    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:28:11.578874 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.578778    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-dshm\") pod \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") "
Jul 16 12:28:11.578874 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.578828    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-tmp-dir\") pod \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") "
Jul 16 12:28:11.578874 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.578851    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-home\") pod \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") "
Jul 16 12:28:11.579189 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.578885    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-tls-certs\") pod \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") "
Jul 16 12:28:11.579189 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.578902    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkn8r\" (UniqueName: \"kubernetes.io/projected/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-kube-api-access-rkn8r\") pod \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") "
Jul 16 12:28:11.579189 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.578953    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-model-cache\") pod \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\" (UID: \"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696\") "
Jul 16 12:28:11.579189 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.579166    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4ec2ec3e-692e-4b69-b670-d2e9c9e7c696" (UID: "4ec2ec3e-692e-4b69-b670-d2e9c9e7c696"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:28:11.579189 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.579178    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-home" (OuterVolumeSpecName: "home") pod "4ec2ec3e-692e-4b69-b670-d2e9c9e7c696" (UID: "4ec2ec3e-692e-4b69-b670-d2e9c9e7c696"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:28:11.579423 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.579278    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-model-cache" (OuterVolumeSpecName: "model-cache") pod "4ec2ec3e-692e-4b69-b670-d2e9c9e7c696" (UID: "4ec2ec3e-692e-4b69-b670-d2e9c9e7c696"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:28:11.581247 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.581221    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-dshm" (OuterVolumeSpecName: "dshm") pod "4ec2ec3e-692e-4b69-b670-d2e9c9e7c696" (UID: "4ec2ec3e-692e-4b69-b670-d2e9c9e7c696"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:28:11.581378 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.581316    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-kube-api-access-rkn8r" (OuterVolumeSpecName: "kube-api-access-rkn8r") pod "4ec2ec3e-692e-4b69-b670-d2e9c9e7c696" (UID: "4ec2ec3e-692e-4b69-b670-d2e9c9e7c696"). InnerVolumeSpecName "kube-api-access-rkn8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:28:11.581378 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.581348    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4ec2ec3e-692e-4b69-b670-d2e9c9e7c696" (UID: "4ec2ec3e-692e-4b69-b670-d2e9c9e7c696"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:28:11.679595 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.679559    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-model-cache\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:28:11.679595 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.679587    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-dshm\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:28:11.679595 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.679595    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-tmp-dir\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:28:11.679595 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.679603    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-home\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:28:11.679847 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.679611    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-tls-certs\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:28:11.679847 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.679618    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkn8r\" (UniqueName: \"kubernetes.io/projected/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696-kube-api-access-rkn8r\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:28:11.961201 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.961168    2564 generic.go:356] "Generic (PLEG): container finished" podID="4ec2ec3e-692e-4b69-b670-d2e9c9e7c696" containerID="63e74b012b498bb43ffd5f2b0f3d3b68a130ca2475ba66a0c692958e2036d605" exitCode=0
Jul 16 12:28:11.961372 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.961208    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"
Jul 16 12:28:11.961372 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.961246    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl" event={"ID":"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696","Type":"ContainerDied","Data":"63e74b012b498bb43ffd5f2b0f3d3b68a130ca2475ba66a0c692958e2036d605"}
Jul 16 12:28:11.961372 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.961287    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl" event={"ID":"4ec2ec3e-692e-4b69-b670-d2e9c9e7c696","Type":"ContainerDied","Data":"86dcf10afc395623687ff9e69841c8176e02263070444935581841351e6af13d"}
Jul 16 12:28:11.961372 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.961304    2564 scope.go:117] "RemoveContainer" containerID="63e74b012b498bb43ffd5f2b0f3d3b68a130ca2475ba66a0c692958e2036d605"
Jul 16 12:28:11.970978 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.970956    2564 scope.go:117] "RemoveContainer" containerID="63e74b012b498bb43ffd5f2b0f3d3b68a130ca2475ba66a0c692958e2036d605"
Jul 16 12:28:11.971234 ip-10-0-129-78 kubenswrapper[2564]: E0716 12:28:11.971213    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63e74b012b498bb43ffd5f2b0f3d3b68a130ca2475ba66a0c692958e2036d605\": container with ID starting with 63e74b012b498bb43ffd5f2b0f3d3b68a130ca2475ba66a0c692958e2036d605 not found: ID does not exist" containerID="63e74b012b498bb43ffd5f2b0f3d3b68a130ca2475ba66a0c692958e2036d605"
Jul 16 12:28:11.971281 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.971242    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63e74b012b498bb43ffd5f2b0f3d3b68a130ca2475ba66a0c692958e2036d605"} err="failed to get container status \"63e74b012b498bb43ffd5f2b0f3d3b68a130ca2475ba66a0c692958e2036d605\": rpc error: code = NotFound desc = could not find container \"63e74b012b498bb43ffd5f2b0f3d3b68a130ca2475ba66a0c692958e2036d605\": container with ID starting with 63e74b012b498bb43ffd5f2b0f3d3b68a130ca2475ba66a0c692958e2036d605 not found: ID does not exist"
Jul 16 12:28:11.980955 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.980926    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"]
Jul 16 12:28:11.986713 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:11.986689    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-4a07820d/e2e-lifecycle-model-4a07820d-kserve-7dfc56776c-8k7kl"]
Jul 16 12:28:13.854899 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:13.854870    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ec2ec3e-692e-4b69-b670-d2e9c9e7c696" path="/var/lib/kubelet/pods/4ec2ec3e-692e-4b69-b670-d2e9c9e7c696/volumes"
Jul 16 12:28:50.097724 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:28:50.097686    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:29:03.215108 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:29:03.215074    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:29:53.436703 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:29:53.436665    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:30:00.174874 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:00.174837    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e41619-29736750-p9p7h"]
Jul 16 12:30:00.175441 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:00.175269    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec2ec3e-692e-4b69-b670-d2e9c9e7c696" containerName="main"
Jul 16 12:30:00.175441 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:00.175283    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec2ec3e-692e-4b69-b670-d2e9c9e7c696" containerName="main"
Jul 16 12:30:00.175441 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:00.175367    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ec2ec3e-692e-4b69-b670-d2e9c9e7c696" containerName="main"
Jul 16 12:30:00.178474 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:00.178459    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e41619-29736750-p9p7h"
Jul 16 12:30:00.199515 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:00.199488    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:30:00.203477 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:00.203457    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e41619-29736750-p9p7h"]
Jul 16 12:30:00.208716 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:00.208696    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e41619-29736750-p9p7h"
Jul 16 12:30:00.357947 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:00.357915    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e41619-29736750-p9p7h"]
Jul 16 12:30:00.359515 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:30:00.359486    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6adeb4c9_e99b_4ba3_9d9f_34da63d1a6f6.slice/crio-d0a5ce21af23b6379be2ae05dea5069202aae5ab685e5281f302a0391a520747 WatchSource:0}: Error finding container d0a5ce21af23b6379be2ae05dea5069202aae5ab685e5281f302a0391a520747: Status 404 returned error can't find the container with id d0a5ce21af23b6379be2ae05dea5069202aae5ab685e5281f302a0391a520747
Jul 16 12:30:00.361934 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:00.361915    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 12:30:00.522593 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:00.522508    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e41619-29736750-p9p7h" event={"ID":"6adeb4c9-e99b-4ba3-9d9f-34da63d1a6f6","Type":"ContainerStarted","Data":"d0a5ce21af23b6379be2ae05dea5069202aae5ab685e5281f302a0391a520747"}
Jul 16 12:30:03.543434 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:03.543396    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e41619-29736750-p9p7h" event={"ID":"6adeb4c9-e99b-4ba3-9d9f-34da63d1a6f6","Type":"ContainerStarted","Data":"99ed40506e0e805892c0a616ab3376305197d24ccaacf909297d7ad7e39b8985"}
Jul 16 12:30:03.564774 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:03.564714    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e41619-29736750-p9p7h" podStartSLOduration=1.175882938 podStartE2EDuration="3.564693868s" totalImagesPullingTime="2.38881093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:30:03.563884475 +0000 UTC m=+2332.198678546" watchObservedRunningTime="2026-07-16 12:30:03.564693868 +0000 UTC m=+2332.199487940"
Jul 16 12:30:04.550436 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:04.550400    2564 generic.go:356] "Generic (PLEG): container finished" podID="6adeb4c9-e99b-4ba3-9d9f-34da63d1a6f6" containerID="99ed40506e0e805892c0a616ab3376305197d24ccaacf909297d7ad7e39b8985" exitCode=0
Jul 16 12:30:04.550804 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:04.550494    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e41619-29736750-p9p7h" event={"ID":"6adeb4c9-e99b-4ba3-9d9f-34da63d1a6f6","Type":"ContainerDied","Data":"99ed40506e0e805892c0a616ab3376305197d24ccaacf909297d7ad7e39b8985"}
Jul 16 12:30:05.686919 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:05.686886    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e41619-29736750-p9p7h"
Jul 16 12:30:06.561689 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:06.561662    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e41619-29736750-p9p7h"
Jul 16 12:30:06.561859 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:06.561709    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e41619-29736750-p9p7h" event={"ID":"6adeb4c9-e99b-4ba3-9d9f-34da63d1a6f6","Type":"ContainerDied","Data":"d0a5ce21af23b6379be2ae05dea5069202aae5ab685e5281f302a0391a520747"}
Jul 16 12:30:06.561859 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:06.561752    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0a5ce21af23b6379be2ae05dea5069202aae5ab685e5281f302a0391a520747"
Jul 16 12:30:08.335723 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:08.335690    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:30:14.407571 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.407536    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"]
Jul 16 12:30:14.407988 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.407871    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6adeb4c9-e99b-4ba3-9d9f-34da63d1a6f6" containerName="cleanup"
Jul 16 12:30:14.407988 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.407882    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6adeb4c9-e99b-4ba3-9d9f-34da63d1a6f6" containerName="cleanup"
Jul 16 12:30:14.407988 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.407944    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6adeb4c9-e99b-4ba3-9d9f-34da63d1a6f6" containerName="cleanup"
Jul 16 12:30:14.410958 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.410942    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.413619 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.413596    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e86929\"/\"default-dockercfg-9kmv8\""
Jul 16 12:30:14.414922 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.414900    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e86929\"/\"openshift-service-ca.crt\""
Jul 16 12:30:14.415039 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.414962    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e86929\"/\"kube-root-ca.crt\""
Jul 16 12:30:14.415039 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.414974    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e86929\"/\"test-model-e86929-kserve-self-signed-certs\""
Jul 16 12:30:14.432939 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.432905    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"]
Jul 16 12:30:14.460751 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.460724    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-tmp-dir\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.460928 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.460770    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-dshm\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.460928 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.460868    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk4dk\" (UniqueName: \"kubernetes.io/projected/360c344d-77ba-4ea2-a440-69c2e19ac6a7-kube-api-access-rk4dk\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.460928 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.460909    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/360c344d-77ba-4ea2-a440-69c2e19ac6a7-tls-certs\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.461312 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.460934    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-home\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.461312 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.460998    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-model-cache\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.561898 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.561858    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk4dk\" (UniqueName: \"kubernetes.io/projected/360c344d-77ba-4ea2-a440-69c2e19ac6a7-kube-api-access-rk4dk\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.561898 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.561902    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/360c344d-77ba-4ea2-a440-69c2e19ac6a7-tls-certs\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.562101 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.561922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-home\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.562101 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.561945    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-model-cache\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.562101 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.561968    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-tmp-dir\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.562101 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.561989    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-dshm\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.562415 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.562391    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-model-cache\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.562506 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.562464    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-tmp-dir\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.562557 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.562501    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-home\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.564302 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.564281    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-dshm\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.564545 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.564526    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/360c344d-77ba-4ea2-a440-69c2e19ac6a7-tls-certs\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.572049 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.572016    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk4dk\" (UniqueName: \"kubernetes.io/projected/360c344d-77ba-4ea2-a440-69c2e19ac6a7-kube-api-access-rk4dk\") pod \"test-model-e86929-kserve-c646cfd8c-tzxkp\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") " pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.720158 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.720070    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:14.860029 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:14.859919    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"]
Jul 16 12:30:14.862150 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:30:14.862122    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod360c344d_77ba_4ea2_a440_69c2e19ac6a7.slice/crio-c57bf0745ee2689de6f8938fa9bc9c7384c6dbcd27447261ffb1335c95d396a7 WatchSource:0}: Error finding container c57bf0745ee2689de6f8938fa9bc9c7384c6dbcd27447261ffb1335c95d396a7: Status 404 returned error can't find the container with id c57bf0745ee2689de6f8938fa9bc9c7384c6dbcd27447261ffb1335c95d396a7
Jul 16 12:30:15.608055 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:15.608024    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp" event={"ID":"360c344d-77ba-4ea2-a440-69c2e19ac6a7","Type":"ContainerStarted","Data":"0e07ff29e5fd8db050be7b5a0e559735c831d62f60e0f09cf111b9ba9015fe9a"}
Jul 16 12:30:15.608479 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:15.608064    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp" event={"ID":"360c344d-77ba-4ea2-a440-69c2e19ac6a7","Type":"ContainerStarted","Data":"c57bf0745ee2689de6f8938fa9bc9c7384c6dbcd27447261ffb1335c95d396a7"}
Jul 16 12:30:15.631593 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:15.631510    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp" podStartSLOduration=1.631490555 podStartE2EDuration="1.631490555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:30:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:30:15.631089062 +0000 UTC m=+2344.265883133" watchObservedRunningTime="2026-07-16 12:30:15.631490555 +0000 UTC m=+2344.266284627"
Jul 16 12:30:18.819504 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:18.819469    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:30:24.721241 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:24.721197    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:24.721644 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:24.721267    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:24.733854 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:24.733818    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:25.676022 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:25.675990    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:30:30.415053 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:30.415010    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:30:46.014724 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:46.014690    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:30:59.820247 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:30:59.820214    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:31:02.010343 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:02.006141    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"]
Jul 16 12:31:03.110983 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:03.110952    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx"]
Jul 16 12:31:03.113552 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:03.113535    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx"
Jul 16 12:31:03.122500 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:03.122480    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 12:31:03.123726 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:03.123706    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:31:03.129413 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:03.129392    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx"]
Jul 16 12:31:03.181837 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:03.181805    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3510e684-19d6-4e3f-a67e-ef3bb1628337-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx\" (UID: \"3510e684-19d6-4e3f-a67e-ef3bb1628337\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx"
Jul 16 12:31:03.283218 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:03.283188    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3510e684-19d6-4e3f-a67e-ef3bb1628337-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx\" (UID: \"3510e684-19d6-4e3f-a67e-ef3bb1628337\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx"
Jul 16 12:31:03.283824 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:03.283804    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3510e684-19d6-4e3f-a67e-ef3bb1628337-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx\" (UID: \"3510e684-19d6-4e3f-a67e-ef3bb1628337\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx"
Jul 16 12:31:03.424136 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:03.424100    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx"
Jul 16 12:31:03.565712 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:03.565688    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx"]
Jul 16 12:31:03.567641 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:31:03.567613    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3510e684_19d6_4e3f_a67e_ef3bb1628337.slice/crio-0a4bc5dedc4048fb7b21e82a654166fba1d7e9b1f68843513b2d4842be432831 WatchSource:0}: Error finding container 0a4bc5dedc4048fb7b21e82a654166fba1d7e9b1f68843513b2d4842be432831: Status 404 returned error can't find the container with id 0a4bc5dedc4048fb7b21e82a654166fba1d7e9b1f68843513b2d4842be432831
Jul 16 12:31:03.856557 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:03.856516    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx" event={"ID":"3510e684-19d6-4e3f-a67e-ef3bb1628337","Type":"ContainerStarted","Data":"7a015790ed923ef9ec89b458f53bf9c90e45983ff63c9481f846b1224b0d9896"}
Jul 16 12:31:03.856725 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:03.856575    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx" event={"ID":"3510e684-19d6-4e3f-a67e-ef3bb1628337","Type":"ContainerStarted","Data":"0a4bc5dedc4048fb7b21e82a654166fba1d7e9b1f68843513b2d4842be432831"}
Jul 16 12:31:03.881729 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:03.881666    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx" podStartSLOduration=0.881648473 podStartE2EDuration="881.648473ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:31:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:31:03.881354833 +0000 UTC m=+2392.516148901" watchObservedRunningTime="2026-07-16 12:31:03.881648473 +0000 UTC m=+2392.516442573"
Jul 16 12:31:04.863478 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:04.863439    2564 generic.go:356] "Generic (PLEG): container finished" podID="3510e684-19d6-4e3f-a67e-ef3bb1628337" containerID="7a015790ed923ef9ec89b458f53bf9c90e45983ff63c9481f846b1224b0d9896" exitCode=0
Jul 16 12:31:04.863916 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:04.863480    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx" event={"ID":"3510e684-19d6-4e3f-a67e-ef3bb1628337","Type":"ContainerDied","Data":"7a015790ed923ef9ec89b458f53bf9c90e45983ff63c9481f846b1224b0d9896"}
Jul 16 12:31:06.014232 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:06.014208    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx"
Jul 16 12:31:06.110499 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:06.110466    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3510e684-19d6-4e3f-a67e-ef3bb1628337-maas-api-service-ca\") pod \"3510e684-19d6-4e3f-a67e-ef3bb1628337\" (UID: \"3510e684-19d6-4e3f-a67e-ef3bb1628337\") "
Jul 16 12:31:06.110849 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:06.110825    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3510e684-19d6-4e3f-a67e-ef3bb1628337-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3510e684-19d6-4e3f-a67e-ef3bb1628337" (UID: "3510e684-19d6-4e3f-a67e-ef3bb1628337"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:31:06.211100 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:06.211015    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3510e684-19d6-4e3f-a67e-ef3bb1628337-maas-api-service-ca\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:31:06.875554 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:06.875520    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx"
Jul 16 12:31:06.875554 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:06.875526    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx" event={"ID":"3510e684-19d6-4e3f-a67e-ef3bb1628337","Type":"ContainerDied","Data":"0a4bc5dedc4048fb7b21e82a654166fba1d7e9b1f68843513b2d4842be432831"}
Jul 16 12:31:06.875820 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:06.875572    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a4bc5dedc4048fb7b21e82a654166fba1d7e9b1f68843513b2d4842be432831"
Jul 16 12:31:11.955238 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:11.955212    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 12:31:11.963045 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:11.963020    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 12:31:16.142779 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:16.142745    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:31:17.030048 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.029986    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp" podUID="360c344d-77ba-4ea2-a440-69c2e19ac6a7" containerName="main" containerID="cri-o://0e07ff29e5fd8db050be7b5a0e559735c831d62f60e0f09cf111b9ba9015fe9a" gracePeriod=45
Jul 16 12:31:17.285752 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.285675    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:31:17.414855 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.414820    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/360c344d-77ba-4ea2-a440-69c2e19ac6a7-tls-certs\") pod \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") "
Jul 16 12:31:17.415023 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.414865    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-home\") pod \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") "
Jul 16 12:31:17.415023 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.414900    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-dshm\") pod \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") "
Jul 16 12:31:17.415023 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.414920    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-model-cache\") pod \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") "
Jul 16 12:31:17.415023 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.414966    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-tmp-dir\") pod \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") "
Jul 16 12:31:17.415202 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.415048    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rk4dk\" (UniqueName: \"kubernetes.io/projected/360c344d-77ba-4ea2-a440-69c2e19ac6a7-kube-api-access-rk4dk\") pod \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\" (UID: \"360c344d-77ba-4ea2-a440-69c2e19ac6a7\") "
Jul 16 12:31:17.415202 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.415173    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-home" (OuterVolumeSpecName: "home") pod "360c344d-77ba-4ea2-a440-69c2e19ac6a7" (UID: "360c344d-77ba-4ea2-a440-69c2e19ac6a7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:31:17.415315 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.415194    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-model-cache" (OuterVolumeSpecName: "model-cache") pod "360c344d-77ba-4ea2-a440-69c2e19ac6a7" (UID: "360c344d-77ba-4ea2-a440-69c2e19ac6a7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:31:17.415315 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.415272    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "360c344d-77ba-4ea2-a440-69c2e19ac6a7" (UID: "360c344d-77ba-4ea2-a440-69c2e19ac6a7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:31:17.415448 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.415379    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-home\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:31:17.415448 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.415399    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-model-cache\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:31:17.415448 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.415413    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-tmp-dir\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:31:17.417367 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.417344    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-dshm" (OuterVolumeSpecName: "dshm") pod "360c344d-77ba-4ea2-a440-69c2e19ac6a7" (UID: "360c344d-77ba-4ea2-a440-69c2e19ac6a7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:31:17.417470 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.417448    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/360c344d-77ba-4ea2-a440-69c2e19ac6a7-kube-api-access-rk4dk" (OuterVolumeSpecName: "kube-api-access-rk4dk") pod "360c344d-77ba-4ea2-a440-69c2e19ac6a7" (UID: "360c344d-77ba-4ea2-a440-69c2e19ac6a7"). InnerVolumeSpecName "kube-api-access-rk4dk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:31:17.417531 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.417487    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/360c344d-77ba-4ea2-a440-69c2e19ac6a7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "360c344d-77ba-4ea2-a440-69c2e19ac6a7" (UID: "360c344d-77ba-4ea2-a440-69c2e19ac6a7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:31:17.516397 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.516360    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rk4dk\" (UniqueName: \"kubernetes.io/projected/360c344d-77ba-4ea2-a440-69c2e19ac6a7-kube-api-access-rk4dk\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:31:17.516397 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.516391    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/360c344d-77ba-4ea2-a440-69c2e19ac6a7-tls-certs\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:31:17.516397 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.516403    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/360c344d-77ba-4ea2-a440-69c2e19ac6a7-dshm\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:31:17.935538 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.935388    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp" event={"ID":"360c344d-77ba-4ea2-a440-69c2e19ac6a7","Type":"ContainerDied","Data":"0e07ff29e5fd8db050be7b5a0e559735c831d62f60e0f09cf111b9ba9015fe9a"}
Jul 16 12:31:17.935538 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.935455    2564 scope.go:117] "RemoveContainer" containerID="0e07ff29e5fd8db050be7b5a0e559735c831d62f60e0f09cf111b9ba9015fe9a"
Jul 16 12:31:17.935538 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.935503    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"
Jul 16 12:31:17.935837 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.935403    2564 generic.go:356] "Generic (PLEG): container finished" podID="360c344d-77ba-4ea2-a440-69c2e19ac6a7" containerID="0e07ff29e5fd8db050be7b5a0e559735c831d62f60e0f09cf111b9ba9015fe9a" exitCode=0
Jul 16 12:31:17.935837 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.935697    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp" event={"ID":"360c344d-77ba-4ea2-a440-69c2e19ac6a7","Type":"ContainerDied","Data":"c57bf0745ee2689de6f8938fa9bc9c7384c6dbcd27447261ffb1335c95d396a7"}
Jul 16 12:31:17.950421 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.950400    2564 scope.go:117] "RemoveContainer" containerID="0e07ff29e5fd8db050be7b5a0e559735c831d62f60e0f09cf111b9ba9015fe9a"
Jul 16 12:31:17.950732 ip-10-0-129-78 kubenswrapper[2564]: E0716 12:31:17.950698    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e07ff29e5fd8db050be7b5a0e559735c831d62f60e0f09cf111b9ba9015fe9a\": container with ID starting with 0e07ff29e5fd8db050be7b5a0e559735c831d62f60e0f09cf111b9ba9015fe9a not found: ID does not exist" containerID="0e07ff29e5fd8db050be7b5a0e559735c831d62f60e0f09cf111b9ba9015fe9a"
Jul 16 12:31:17.950788 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.950742    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e07ff29e5fd8db050be7b5a0e559735c831d62f60e0f09cf111b9ba9015fe9a"} err="failed to get container status \"0e07ff29e5fd8db050be7b5a0e559735c831d62f60e0f09cf111b9ba9015fe9a\": rpc error: code = NotFound desc = could not find container \"0e07ff29e5fd8db050be7b5a0e559735c831d62f60e0f09cf111b9ba9015fe9a\": container with ID starting with 0e07ff29e5fd8db050be7b5a0e559735c831d62f60e0f09cf111b9ba9015fe9a not found: ID does not exist"
Jul 16 12:31:17.995221 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:17.995187    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"]
Jul 16 12:31:18.001705 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:18.001674    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-e86929/test-model-e86929-kserve-c646cfd8c-tzxkp"]
Jul 16 12:31:19.854819 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:19.854786    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="360c344d-77ba-4ea2-a440-69c2e19ac6a7" path="/var/lib/kubelet/pods/360c344d-77ba-4ea2-a440-69c2e19ac6a7/volumes"
Jul 16 12:31:25.200612 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:25.200566    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:31:40.031632 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:40.031596    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e41619-29736750-p9p7h"]
Jul 16 12:31:40.036275 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:40.036252    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e41619-29736750-p9p7h"]
Jul 16 12:31:41.854970 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:41.854936    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6adeb4c9-e99b-4ba3-9d9f-34da63d1a6f6" path="/var/lib/kubelet/pods/6adeb4c9-e99b-4ba3-9d9f-34da63d1a6f6/volumes"
Jul 16 12:31:43.109898 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:31:43.109856    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:32:04.093063 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:04.093016    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:32:21.867964 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:21.867931    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f272c-bv9vf"]
Jul 16 12:32:21.868431 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:21.868233    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3510e684-19d6-4e3f-a67e-ef3bb1628337" containerName="revoke-keys"
Jul 16 12:32:21.868431 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:21.868243    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3510e684-19d6-4e3f-a67e-ef3bb1628337" containerName="revoke-keys"
Jul 16 12:32:21.868431 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:21.868253    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="360c344d-77ba-4ea2-a440-69c2e19ac6a7" containerName="main"
Jul 16 12:32:21.868431 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:21.868258    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="360c344d-77ba-4ea2-a440-69c2e19ac6a7" containerName="main"
Jul 16 12:32:21.868431 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:21.868339    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="360c344d-77ba-4ea2-a440-69c2e19ac6a7" containerName="main"
Jul 16 12:32:21.868431 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:21.868350    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3510e684-19d6-4e3f-a67e-ef3bb1628337" containerName="revoke-keys"
Jul 16 12:32:21.871237 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:21.871220    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f272c-bv9vf"
Jul 16 12:32:21.874430 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:21.874410    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:32:21.874530 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:21.874433    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 12:32:21.881236 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:21.881211    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f272c-bv9vf"]
Jul 16 12:32:21.952900 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:21.952864    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fc25d2e-588a-418b-8419-d6094e5610b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2f272c-bv9vf\" (UID: \"4fc25d2e-588a-418b-8419-d6094e5610b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f272c-bv9vf"
Jul 16 12:32:22.054228 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:22.054186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fc25d2e-588a-418b-8419-d6094e5610b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2f272c-bv9vf\" (UID: \"4fc25d2e-588a-418b-8419-d6094e5610b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f272c-bv9vf"
Jul 16 12:32:22.054829 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:22.054802    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fc25d2e-588a-418b-8419-d6094e5610b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2f272c-bv9vf\" (UID: \"4fc25d2e-588a-418b-8419-d6094e5610b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f272c-bv9vf"
Jul 16 12:32:22.182573 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:22.182489    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f272c-bv9vf"
Jul 16 12:32:22.320762 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:22.320737    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f272c-bv9vf"]
Jul 16 12:32:22.322419 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:32:22.322380    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc25d2e_588a_418b_8419_d6094e5610b0.slice/crio-534207b70d171a3a4da86b2bfe1b86f3a49adbde23bcbbddc97d8c42f147ca7b WatchSource:0}: Error finding container 534207b70d171a3a4da86b2bfe1b86f3a49adbde23bcbbddc97d8c42f147ca7b: Status 404 returned error can't find the container with id 534207b70d171a3a4da86b2bfe1b86f3a49adbde23bcbbddc97d8c42f147ca7b
Jul 16 12:32:23.289651 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:23.289563    2564 generic.go:356] "Generic (PLEG): container finished" podID="4fc25d2e-588a-418b-8419-d6094e5610b0" containerID="d621f7be1eced2a05ba15d95e951f0b4415e06d7b65d5831bdfeb295030c0ff2" exitCode=0
Jul 16 12:32:23.289996 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:23.289658    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f272c-bv9vf" event={"ID":"4fc25d2e-588a-418b-8419-d6094e5610b0","Type":"ContainerDied","Data":"d621f7be1eced2a05ba15d95e951f0b4415e06d7b65d5831bdfeb295030c0ff2"}
Jul 16 12:32:23.289996 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:23.289729    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f272c-bv9vf" event={"ID":"4fc25d2e-588a-418b-8419-d6094e5610b0","Type":"ContainerStarted","Data":"534207b70d171a3a4da86b2bfe1b86f3a49adbde23bcbbddc97d8c42f147ca7b"}
Jul 16 12:32:23.920019 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:23.919971    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:32:24.423748 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:24.423723    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f272c-bv9vf"
Jul 16 12:32:24.575945 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:24.575856    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fc25d2e-588a-418b-8419-d6094e5610b0-maas-api-service-ca\") pod \"4fc25d2e-588a-418b-8419-d6094e5610b0\" (UID: \"4fc25d2e-588a-418b-8419-d6094e5610b0\") "
Jul 16 12:32:24.576203 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:24.576182    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fc25d2e-588a-418b-8419-d6094e5610b0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4fc25d2e-588a-418b-8419-d6094e5610b0" (UID: "4fc25d2e-588a-418b-8419-d6094e5610b0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:32:24.676405 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:24.676368    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fc25d2e-588a-418b-8419-d6094e5610b0-maas-api-service-ca\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:32:25.301663 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:25.301628    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f272c-bv9vf"
Jul 16 12:32:25.301838 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:25.301676    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f272c-bv9vf" event={"ID":"4fc25d2e-588a-418b-8419-d6094e5610b0","Type":"ContainerDied","Data":"534207b70d171a3a4da86b2bfe1b86f3a49adbde23bcbbddc97d8c42f147ca7b"}
Jul 16 12:32:25.301838 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:25.301719    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="534207b70d171a3a4da86b2bfe1b86f3a49adbde23bcbbddc97d8c42f147ca7b"
Jul 16 12:32:35.591186 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:32:35.591146    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:33:01.446646 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:33:01.446611    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:33:23.263185 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:33:23.263151    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:33:40.495346 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:33:40.495295    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:33:51.688745 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:33:51.688706    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:34:11.592782 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:34:11.592747    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:34:27.703638 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:34:27.703591    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:34:46.690029 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:34:46.689991    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:35:02.492506 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:35:02.492470    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:35:20.295275 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:35:20.295243    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:35:36.589594 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:35:36.589556    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:35:53.084863 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:35:53.084829    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:36:09.406447 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:09.406368    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:36:11.995445 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:11.995418    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 12:36:12.002601 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:12.002578    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd6t8_1b471a05-b0ca-44b6-ae9b-2f2c73863615/ovn-acl-logging/0.log"
Jul 16 12:36:12.064615 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:12.064582    2564 scope.go:117] "RemoveContainer" containerID="99ed40506e0e805892c0a616ab3376305197d24ccaacf909297d7ad7e39b8985"
Jul 16 12:36:25.482865 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:25.482829    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:36:37.996611 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:37.996576    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:36:54.785931 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.785894    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"]
Jul 16 12:36:54.786446 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.786428    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fc25d2e-588a-418b-8419-d6094e5610b0" containerName="revoke-keys"
Jul 16 12:36:54.786536 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.786449    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc25d2e-588a-418b-8419-d6094e5610b0" containerName="revoke-keys"
Jul 16 12:36:54.786591 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.786538    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fc25d2e-588a-418b-8419-d6094e5610b0" containerName="revoke-keys"
Jul 16 12:36:54.789462 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.789442    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.796443 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.796414    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-66e9a3\"/\"sub-test-model-66e9a3-kserve-self-signed-certs\""
Jul 16 12:36:54.796574 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.796465    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-66e9a3\"/\"kube-root-ca.crt\""
Jul 16 12:36:54.796574 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.796548    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-66e9a3\"/\"openshift-service-ca.crt\""
Jul 16 12:36:54.796698 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.796599    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-66e9a3\"/\"default-dockercfg-vcxsr\""
Jul 16 12:36:54.805731 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.805705    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"]
Jul 16 12:36:54.878475 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.878420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-tmp-dir\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.878667 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.878493    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-dshm\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.878667 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.878529    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-home\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.878667 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.878549    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-model-cache\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.878667 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.878641    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htqcx\" (UniqueName: \"kubernetes.io/projected/a938ed34-c5ae-410e-b537-b38a6e5a4641-kube-api-access-htqcx\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.878811 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.878694    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a938ed34-c5ae-410e-b537-b38a6e5a4641-tls-certs\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.979156 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.979116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-dshm\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.979379 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.979165    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-home\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.979379 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.979183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-model-cache\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.979379 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.979207    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htqcx\" (UniqueName: \"kubernetes.io/projected/a938ed34-c5ae-410e-b537-b38a6e5a4641-kube-api-access-htqcx\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.979379 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.979234    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a938ed34-c5ae-410e-b537-b38a6e5a4641-tls-certs\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.979379 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.979281    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-tmp-dir\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.979672 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.979635    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-model-cache\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.979716 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.979672    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-home\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.979716 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.979697    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-tmp-dir\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.981753 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.981728    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-dshm\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.981860 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.981844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a938ed34-c5ae-410e-b537-b38a6e5a4641-tls-certs\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:54.989122 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:54.989099    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htqcx\" (UniqueName: \"kubernetes.io/projected/a938ed34-c5ae-410e-b537-b38a6e5a4641-kube-api-access-htqcx\") pod \"sub-test-model-66e9a3-kserve-79454c555f-9qlhv\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") " pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:55.098702 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:55.098617    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:36:55.243913 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:55.243882    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"]
Jul 16 12:36:55.245974 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:36:55.245939    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda938ed34_c5ae_410e_b537_b38a6e5a4641.slice/crio-b0c7e0d813831ef519689b24f388ee66c064f49228cb86df1647eab7b4e56aae WatchSource:0}: Error finding container b0c7e0d813831ef519689b24f388ee66c064f49228cb86df1647eab7b4e56aae: Status 404 returned error can't find the container with id b0c7e0d813831ef519689b24f388ee66c064f49228cb86df1647eab7b4e56aae
Jul 16 12:36:55.711017 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:55.710973    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv" event={"ID":"a938ed34-c5ae-410e-b537-b38a6e5a4641","Type":"ContainerStarted","Data":"bd5a78f8385e3e7f985c668ed92ec92fffd22bd1a176c54907553bfeea56bb47"}
Jul 16 12:36:55.711230 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:55.711027    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv" event={"ID":"a938ed34-c5ae-410e-b537-b38a6e5a4641","Type":"ContainerStarted","Data":"b0c7e0d813831ef519689b24f388ee66c064f49228cb86df1647eab7b4e56aae"}
Jul 16 12:36:55.733674 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:55.733618    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv" podStartSLOduration=1.7336019070000002 podStartE2EDuration="1.733601907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:36:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:36:55.731388771 +0000 UTC m=+2744.366182864" watchObservedRunningTime="2026-07-16 12:36:55.733601907 +0000 UTC m=+2744.368395977"
Jul 16 12:36:59.274309 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:36:59.274270    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:37:05.099274 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:05.099223    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:37:05.099813 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:05.099586    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:37:05.112125 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:05.112095    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:37:05.772131 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:05.772105    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:37:14.586301 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:14.586255    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:37:33.497695 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:33.497615    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:37:41.186080 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:41.186040    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"]
Jul 16 12:37:53.298793 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:53.298753    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:37:56.206538 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.206492    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv" podUID="a938ed34-c5ae-410e-b537-b38a6e5a4641" containerName="main" containerID="cri-o://bd5a78f8385e3e7f985c668ed92ec92fffd22bd1a176c54907553bfeea56bb47" gracePeriod=45
Jul 16 12:37:56.453617 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.453594    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:37:56.634096 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.634064    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-model-cache\") pod \"a938ed34-c5ae-410e-b537-b38a6e5a4641\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") "
Jul 16 12:37:56.634305 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.634124    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a938ed34-c5ae-410e-b537-b38a6e5a4641-tls-certs\") pod \"a938ed34-c5ae-410e-b537-b38a6e5a4641\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") "
Jul 16 12:37:56.634305 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.634185    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-dshm\") pod \"a938ed34-c5ae-410e-b537-b38a6e5a4641\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") "
Jul 16 12:37:56.634305 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.634210    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htqcx\" (UniqueName: \"kubernetes.io/projected/a938ed34-c5ae-410e-b537-b38a6e5a4641-kube-api-access-htqcx\") pod \"a938ed34-c5ae-410e-b537-b38a6e5a4641\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") "
Jul 16 12:37:56.634305 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.634251    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-home\") pod \"a938ed34-c5ae-410e-b537-b38a6e5a4641\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") "
Jul 16 12:37:56.634567 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.634353    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-tmp-dir\") pod \"a938ed34-c5ae-410e-b537-b38a6e5a4641\" (UID: \"a938ed34-c5ae-410e-b537-b38a6e5a4641\") "
Jul 16 12:37:56.634567 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.634444    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-model-cache" (OuterVolumeSpecName: "model-cache") pod "a938ed34-c5ae-410e-b537-b38a6e5a4641" (UID: "a938ed34-c5ae-410e-b537-b38a6e5a4641"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:37:56.634668 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.634613    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-home" (OuterVolumeSpecName: "home") pod "a938ed34-c5ae-410e-b537-b38a6e5a4641" (UID: "a938ed34-c5ae-410e-b537-b38a6e5a4641"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:37:56.634668 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.634651    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a938ed34-c5ae-410e-b537-b38a6e5a4641" (UID: "a938ed34-c5ae-410e-b537-b38a6e5a4641"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:37:56.634780 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.634721    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-tmp-dir\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:37:56.634780 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.634741    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-model-cache\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:37:56.634780 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.634756    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-home\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:37:56.636765 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.636738    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a938ed34-c5ae-410e-b537-b38a6e5a4641-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a938ed34-c5ae-410e-b537-b38a6e5a4641" (UID: "a938ed34-c5ae-410e-b537-b38a6e5a4641"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:37:56.636765 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.636751    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-dshm" (OuterVolumeSpecName: "dshm") pod "a938ed34-c5ae-410e-b537-b38a6e5a4641" (UID: "a938ed34-c5ae-410e-b537-b38a6e5a4641"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:37:56.636914 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.636747    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a938ed34-c5ae-410e-b537-b38a6e5a4641-kube-api-access-htqcx" (OuterVolumeSpecName: "kube-api-access-htqcx") pod "a938ed34-c5ae-410e-b537-b38a6e5a4641" (UID: "a938ed34-c5ae-410e-b537-b38a6e5a4641"). InnerVolumeSpecName "kube-api-access-htqcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:37:56.735652 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.735617    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a938ed34-c5ae-410e-b537-b38a6e5a4641-tls-certs\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:37:56.735652 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.735645    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a938ed34-c5ae-410e-b537-b38a6e5a4641-dshm\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:37:56.735652 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:56.735654    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htqcx\" (UniqueName: \"kubernetes.io/projected/a938ed34-c5ae-410e-b537-b38a6e5a4641-kube-api-access-htqcx\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:37:57.028602 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:57.028504    2564 generic.go:356] "Generic (PLEG): container finished" podID="a938ed34-c5ae-410e-b537-b38a6e5a4641" containerID="bd5a78f8385e3e7f985c668ed92ec92fffd22bd1a176c54907553bfeea56bb47" exitCode=0
Jul 16 12:37:57.028602 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:57.028549    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"
Jul 16 12:37:57.028792 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:57.028549    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv" event={"ID":"a938ed34-c5ae-410e-b537-b38a6e5a4641","Type":"ContainerDied","Data":"bd5a78f8385e3e7f985c668ed92ec92fffd22bd1a176c54907553bfeea56bb47"}
Jul 16 12:37:57.028792 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:57.028673    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv" event={"ID":"a938ed34-c5ae-410e-b537-b38a6e5a4641","Type":"ContainerDied","Data":"b0c7e0d813831ef519689b24f388ee66c064f49228cb86df1647eab7b4e56aae"}
Jul 16 12:37:57.028792 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:57.028693    2564 scope.go:117] "RemoveContainer" containerID="bd5a78f8385e3e7f985c668ed92ec92fffd22bd1a176c54907553bfeea56bb47"
Jul 16 12:37:57.038288 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:57.038264    2564 scope.go:117] "RemoveContainer" containerID="bd5a78f8385e3e7f985c668ed92ec92fffd22bd1a176c54907553bfeea56bb47"
Jul 16 12:37:57.038625 ip-10-0-129-78 kubenswrapper[2564]: E0716 12:37:57.038604    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd5a78f8385e3e7f985c668ed92ec92fffd22bd1a176c54907553bfeea56bb47\": container with ID starting with bd5a78f8385e3e7f985c668ed92ec92fffd22bd1a176c54907553bfeea56bb47 not found: ID does not exist" containerID="bd5a78f8385e3e7f985c668ed92ec92fffd22bd1a176c54907553bfeea56bb47"
Jul 16 12:37:57.038704 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:57.038633    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd5a78f8385e3e7f985c668ed92ec92fffd22bd1a176c54907553bfeea56bb47"} err="failed to get container status \"bd5a78f8385e3e7f985c668ed92ec92fffd22bd1a176c54907553bfeea56bb47\": rpc error: code = NotFound desc = could not find container \"bd5a78f8385e3e7f985c668ed92ec92fffd22bd1a176c54907553bfeea56bb47\": container with ID starting with bd5a78f8385e3e7f985c668ed92ec92fffd22bd1a176c54907553bfeea56bb47 not found: ID does not exist"
Jul 16 12:37:57.050783 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:57.050760    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"]
Jul 16 12:37:57.054417 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:57.054395    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-66e9a3/sub-test-model-66e9a3-kserve-79454c555f-9qlhv"]
Jul 16 12:37:57.854886 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:37:57.854852    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a938ed34-c5ae-410e-b537-b38a6e5a4641" path="/var/lib/kubelet/pods/a938ed34-c5ae-410e-b537-b38a6e5a4641/volumes"
Jul 16 12:38:12.294097 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:12.294050    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:38:32.620857 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:32.620814    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:38:47.795706 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:47.795673    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:38:57.612692 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:57.612654    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7350-140560019495344"]
Jul 16 12:38:57.613067 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:57.613015    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a938ed34-c5ae-410e-b537-b38a6e5a4641" containerName="main"
Jul 16 12:38:57.613067 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:57.613027    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a938ed34-c5ae-410e-b537-b38a6e5a4641" containerName="main"
Jul 16 12:38:57.613138 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:57.613090    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a938ed34-c5ae-410e-b537-b38a6e5a4641" containerName="main"
Jul 16 12:38:57.616145 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:57.616127    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019495344"
Jul 16 12:38:57.619226 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:57.619200    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-g65cb\""
Jul 16 12:38:57.625983 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:57.625957    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140560019495344"]
Jul 16 12:38:57.662458 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:57.662409    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-475lr\" (UniqueName: \"kubernetes.io/projected/0343588e-198d-48da-b9d8-74d4923d0700-kube-api-access-475lr\") pod \"test-curl-7350-140560019495344\" (UID: \"0343588e-198d-48da-b9d8-74d4923d0700\") " pod="opendatahub/test-curl-7350-140560019495344"
Jul 16 12:38:57.763691 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:57.763657    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-475lr\" (UniqueName: \"kubernetes.io/projected/0343588e-198d-48da-b9d8-74d4923d0700-kube-api-access-475lr\") pod \"test-curl-7350-140560019495344\" (UID: \"0343588e-198d-48da-b9d8-74d4923d0700\") " pod="opendatahub/test-curl-7350-140560019495344"
Jul 16 12:38:57.776051 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:57.776023    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-475lr\" (UniqueName: \"kubernetes.io/projected/0343588e-198d-48da-b9d8-74d4923d0700-kube-api-access-475lr\") pod \"test-curl-7350-140560019495344\" (UID: \"0343588e-198d-48da-b9d8-74d4923d0700\") " pod="opendatahub/test-curl-7350-140560019495344"
Jul 16 12:38:57.926132 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:57.926080    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019495344"
Jul 16 12:38:58.067350 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:58.067307    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140560019495344"]
Jul 16 12:38:58.069572 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:38:58.069547    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0343588e_198d_48da_b9d8_74d4923d0700.slice/crio-4538df1fdbb55d731424389d8d18f106052df9173b5998a382dd4cdd7e4a7c40 WatchSource:0}: Error finding container 4538df1fdbb55d731424389d8d18f106052df9173b5998a382dd4cdd7e4a7c40: Status 404 returned error can't find the container with id 4538df1fdbb55d731424389d8d18f106052df9173b5998a382dd4cdd7e4a7c40
Jul 16 12:38:58.070915 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:58.070898    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 12:38:58.350187 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:58.350100    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140560019495344" event={"ID":"0343588e-198d-48da-b9d8-74d4923d0700","Type":"ContainerStarted","Data":"4538df1fdbb55d731424389d8d18f106052df9173b5998a382dd4cdd7e4a7c40"}
Jul 16 12:38:59.357630 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:59.357590    2564 generic.go:356] "Generic (PLEG): container finished" podID="0343588e-198d-48da-b9d8-74d4923d0700" containerID="281fc697f1f1e9286b80811db3dfca55e087507bac8b9e963b84deba69191a4e" exitCode=0
Jul 16 12:38:59.358026 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:38:59.357684    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140560019495344" event={"ID":"0343588e-198d-48da-b9d8-74d4923d0700","Type":"ContainerDied","Data":"281fc697f1f1e9286b80811db3dfca55e087507bac8b9e963b84deba69191a4e"}
Jul 16 12:39:00.500727 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:00.500704    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019495344"
Jul 16 12:39:00.540019 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:00.539986    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7350-140560019495344_0343588e-198d-48da-b9d8-74d4923d0700/test-curl-7350-140560019495344/0.log"
Jul 16 12:39:00.567287 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:00.567257    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7350-140560019495344"]
Jul 16 12:39:00.572093 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:00.572069    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7350-140560019495344"]
Jul 16 12:39:00.588405 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:00.588378    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-475lr\" (UniqueName: \"kubernetes.io/projected/0343588e-198d-48da-b9d8-74d4923d0700-kube-api-access-475lr\") pod \"0343588e-198d-48da-b9d8-74d4923d0700\" (UID: \"0343588e-198d-48da-b9d8-74d4923d0700\") "
Jul 16 12:39:00.590744 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:00.590709    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0343588e-198d-48da-b9d8-74d4923d0700-kube-api-access-475lr" (OuterVolumeSpecName: "kube-api-access-475lr") pod "0343588e-198d-48da-b9d8-74d4923d0700" (UID: "0343588e-198d-48da-b9d8-74d4923d0700"). InnerVolumeSpecName "kube-api-access-475lr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:39:00.689156 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:00.689124    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-475lr\" (UniqueName: \"kubernetes.io/projected/0343588e-198d-48da-b9d8-74d4923d0700-kube-api-access-475lr\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:39:00.702112 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:00.702079    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7350-140560019493680"]
Jul 16 12:39:00.702424 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:00.702411    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0343588e-198d-48da-b9d8-74d4923d0700" containerName="test-curl-7350-140560019495344"
Jul 16 12:39:00.702471 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:00.702426    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0343588e-198d-48da-b9d8-74d4923d0700" containerName="test-curl-7350-140560019495344"
Jul 16 12:39:00.702512 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:00.702502    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0343588e-198d-48da-b9d8-74d4923d0700" containerName="test-curl-7350-140560019495344"
Jul 16 12:39:00.705390 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:00.705374    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019493680"
Jul 16 12:39:00.713777 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:00.713745    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140560019493680"]
Jul 16 12:39:00.790070 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:00.790016    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kh2q\" (UniqueName: \"kubernetes.io/projected/360e376c-35ba-4622-ba88-11dfff9adc25-kube-api-access-2kh2q\") pod \"test-curl-7350-140560019493680\" (UID: \"360e376c-35ba-4622-ba88-11dfff9adc25\") " pod="opendatahub/test-curl-7350-140560019493680"
Jul 16 12:39:00.890891 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:00.890846    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kh2q\" (UniqueName: \"kubernetes.io/projected/360e376c-35ba-4622-ba88-11dfff9adc25-kube-api-access-2kh2q\") pod \"test-curl-7350-140560019493680\" (UID: \"360e376c-35ba-4622-ba88-11dfff9adc25\") " pod="opendatahub/test-curl-7350-140560019493680"
Jul 16 12:39:00.900107 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:00.900069    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kh2q\" (UniqueName: \"kubernetes.io/projected/360e376c-35ba-4622-ba88-11dfff9adc25-kube-api-access-2kh2q\") pod \"test-curl-7350-140560019493680\" (UID: \"360e376c-35ba-4622-ba88-11dfff9adc25\") " pod="opendatahub/test-curl-7350-140560019493680"
Jul 16 12:39:01.015502 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:01.015407    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019493680"
Jul 16 12:39:01.160889 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:01.157390    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140560019493680"]
Jul 16 12:39:01.369707 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:01.369681    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019495344"
Jul 16 12:39:01.369889 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:01.369731    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4538df1fdbb55d731424389d8d18f106052df9173b5998a382dd4cdd7e4a7c40"
Jul 16 12:39:01.370998 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:01.370969    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140560019493680" event={"ID":"360e376c-35ba-4622-ba88-11dfff9adc25","Type":"ContainerStarted","Data":"e2a39370d8afd774333da671d3fac2aa49c2ba4e7a0588805d9760b532896261"}
Jul 16 12:39:01.380112 ip-10-0-129-78 kubenswrapper[2564]: E0716 12:39:01.380084    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7350-140560019495344\" is forbidden: User \"system:node:ip-10-0-129-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-78.ec2.internal' and this object" podUID="0343588e-198d-48da-b9d8-74d4923d0700" pod="opendatahub/test-curl-7350-140560019495344"
Jul 16 12:39:01.853765 ip-10-0-129-78 kubenswrapper[2564]: E0716 12:39:01.853669    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7350-140560019495344\" is forbidden: User \"system:node:ip-10-0-129-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-78.ec2.internal' and this object" podUID="0343588e-198d-48da-b9d8-74d4923d0700" pod="opendatahub/test-curl-7350-140560019495344"
Jul 16 12:39:01.854740 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:01.854719    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0343588e-198d-48da-b9d8-74d4923d0700" path="/var/lib/kubelet/pods/0343588e-198d-48da-b9d8-74d4923d0700/volumes"
Jul 16 12:39:01.885822 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:01.885781    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:39:02.377201 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:02.377158    2564 generic.go:356] "Generic (PLEG): container finished" podID="360e376c-35ba-4622-ba88-11dfff9adc25" containerID="158e9840ba1e49e1544776d38dcd90ab2930a8409c9dc9359079946bf1e01468" exitCode=0
Jul 16 12:39:02.377387 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:02.377243    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140560019493680" event={"ID":"360e376c-35ba-4622-ba88-11dfff9adc25","Type":"ContainerDied","Data":"158e9840ba1e49e1544776d38dcd90ab2930a8409c9dc9359079946bf1e01468"}
Jul 16 12:39:03.515773 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:03.515743    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019493680"
Jul 16 12:39:03.542799 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:03.542767    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7350-140560019493680_360e376c-35ba-4622-ba88-11dfff9adc25/test-curl-7350-140560019493680/0.log"
Jul 16 12:39:03.570433 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:03.570394    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7350-140560019493680"]
Jul 16 12:39:03.575364 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:03.575313    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7350-140560019493680"]
Jul 16 12:39:03.615387 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:03.615314    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kh2q\" (UniqueName: \"kubernetes.io/projected/360e376c-35ba-4622-ba88-11dfff9adc25-kube-api-access-2kh2q\") pod \"360e376c-35ba-4622-ba88-11dfff9adc25\" (UID: \"360e376c-35ba-4622-ba88-11dfff9adc25\") "
Jul 16 12:39:03.617558 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:03.617535    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/360e376c-35ba-4622-ba88-11dfff9adc25-kube-api-access-2kh2q" (OuterVolumeSpecName: "kube-api-access-2kh2q") pod "360e376c-35ba-4622-ba88-11dfff9adc25" (UID: "360e376c-35ba-4622-ba88-11dfff9adc25"). InnerVolumeSpecName "kube-api-access-2kh2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:39:03.716258 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:03.716171    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kh2q\" (UniqueName: \"kubernetes.io/projected/360e376c-35ba-4622-ba88-11dfff9adc25-kube-api-access-2kh2q\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:39:03.746213 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:03.746180    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7350-140560019476528"]
Jul 16 12:39:03.746567 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:03.746552    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="360e376c-35ba-4622-ba88-11dfff9adc25" containerName="test-curl-7350-140560019493680"
Jul 16 12:39:03.746615 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:03.746569    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="360e376c-35ba-4622-ba88-11dfff9adc25" containerName="test-curl-7350-140560019493680"
Jul 16 12:39:03.746655 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:03.746623    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="360e376c-35ba-4622-ba88-11dfff9adc25" containerName="test-curl-7350-140560019493680"
Jul 16 12:39:03.749558 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:03.749541    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019476528"
Jul 16 12:39:03.757565 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:03.757543    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140560019476528"]
Jul 16 12:39:03.817589 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:03.817542    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l44mt\" (UniqueName: \"kubernetes.io/projected/ee8fd43f-fbb7-4430-9d02-eef629377c76-kube-api-access-l44mt\") pod \"test-curl-7350-140560019476528\" (UID: \"ee8fd43f-fbb7-4430-9d02-eef629377c76\") " pod="opendatahub/test-curl-7350-140560019476528"
Jul 16 12:39:03.855125 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:03.855093    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="360e376c-35ba-4622-ba88-11dfff9adc25" path="/var/lib/kubelet/pods/360e376c-35ba-4622-ba88-11dfff9adc25/volumes"
Jul 16 12:39:03.918897 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:03.918855    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l44mt\" (UniqueName: \"kubernetes.io/projected/ee8fd43f-fbb7-4430-9d02-eef629377c76-kube-api-access-l44mt\") pod \"test-curl-7350-140560019476528\" (UID: \"ee8fd43f-fbb7-4430-9d02-eef629377c76\") " pod="opendatahub/test-curl-7350-140560019476528"
Jul 16 12:39:03.928624 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:03.928595    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l44mt\" (UniqueName: \"kubernetes.io/projected/ee8fd43f-fbb7-4430-9d02-eef629377c76-kube-api-access-l44mt\") pod \"test-curl-7350-140560019476528\" (UID: \"ee8fd43f-fbb7-4430-9d02-eef629377c76\") " pod="opendatahub/test-curl-7350-140560019476528"
Jul 16 12:39:04.059829 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:04.059743    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019476528"
Jul 16 12:39:04.195467 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:04.195441    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140560019476528"]
Jul 16 12:39:04.197310 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:39:04.197283    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee8fd43f_fbb7_4430_9d02_eef629377c76.slice/crio-f38a81f57a961da741a111aeccb2e346f4afbbb70f4453485d9642086109766a WatchSource:0}: Error finding container f38a81f57a961da741a111aeccb2e346f4afbbb70f4453485d9642086109766a: Status 404 returned error can't find the container with id f38a81f57a961da741a111aeccb2e346f4afbbb70f4453485d9642086109766a
Jul 16 12:39:04.388347 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:04.388297    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140560019476528" event={"ID":"ee8fd43f-fbb7-4430-9d02-eef629377c76","Type":"ContainerStarted","Data":"f38a81f57a961da741a111aeccb2e346f4afbbb70f4453485d9642086109766a"}
Jul 16 12:39:04.389575 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:04.389554    2564 scope.go:117] "RemoveContainer" containerID="158e9840ba1e49e1544776d38dcd90ab2930a8409c9dc9359079946bf1e01468"
Jul 16 12:39:04.389712 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:04.389583    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019493680"
Jul 16 12:39:05.397698 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:05.397664    2564 generic.go:356] "Generic (PLEG): container finished" podID="ee8fd43f-fbb7-4430-9d02-eef629377c76" containerID="5fc878bb5b5c36548203040e51a31a477075434a471a2c8c807c6a5041ad1374" exitCode=0
Jul 16 12:39:05.398059 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:05.397741    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140560019476528" event={"ID":"ee8fd43f-fbb7-4430-9d02-eef629377c76","Type":"ContainerDied","Data":"5fc878bb5b5c36548203040e51a31a477075434a471a2c8c807c6a5041ad1374"}
Jul 16 12:39:06.545030 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:06.545002    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019476528"
Jul 16 12:39:06.568923 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:06.568896    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7350-140560019476528_ee8fd43f-fbb7-4430-9d02-eef629377c76/test-curl-7350-140560019476528/0.log"
Jul 16 12:39:06.598903 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:06.598867    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7350-140560019476528"]
Jul 16 12:39:06.603845 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:06.603807    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7350-140560019476528"]
Jul 16 12:39:06.644816 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:06.644780    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l44mt\" (UniqueName: \"kubernetes.io/projected/ee8fd43f-fbb7-4430-9d02-eef629377c76-kube-api-access-l44mt\") pod \"ee8fd43f-fbb7-4430-9d02-eef629377c76\" (UID: \"ee8fd43f-fbb7-4430-9d02-eef629377c76\") "
Jul 16 12:39:06.647018 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:06.646987    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee8fd43f-fbb7-4430-9d02-eef629377c76-kube-api-access-l44mt" (OuterVolumeSpecName: "kube-api-access-l44mt") pod "ee8fd43f-fbb7-4430-9d02-eef629377c76" (UID: "ee8fd43f-fbb7-4430-9d02-eef629377c76"). InnerVolumeSpecName "kube-api-access-l44mt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:39:06.731862 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:06.731774    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7350-140560019476528"]
Jul 16 12:39:06.732145 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:06.732132    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee8fd43f-fbb7-4430-9d02-eef629377c76" containerName="test-curl-7350-140560019476528"
Jul 16 12:39:06.732191 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:06.732147    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee8fd43f-fbb7-4430-9d02-eef629377c76" containerName="test-curl-7350-140560019476528"
Jul 16 12:39:06.732235 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:06.732204    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee8fd43f-fbb7-4430-9d02-eef629377c76" containerName="test-curl-7350-140560019476528"
Jul 16 12:39:06.735185 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:06.735167    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019476528"
Jul 16 12:39:06.745000 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:06.744970    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140560019476528"]
Jul 16 12:39:06.746565 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:06.746542    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l44mt\" (UniqueName: \"kubernetes.io/projected/ee8fd43f-fbb7-4430-9d02-eef629377c76-kube-api-access-l44mt\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:39:06.847727 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:06.847685    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t575v\" (UniqueName: \"kubernetes.io/projected/b8d7686a-64c0-4057-a2f7-c05c909d1112-kube-api-access-t575v\") pod \"test-curl-7350-140560019476528\" (UID: \"b8d7686a-64c0-4057-a2f7-c05c909d1112\") " pod="opendatahub/test-curl-7350-140560019476528"
Jul 16 12:39:06.948722 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:06.948688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t575v\" (UniqueName: \"kubernetes.io/projected/b8d7686a-64c0-4057-a2f7-c05c909d1112-kube-api-access-t575v\") pod \"test-curl-7350-140560019476528\" (UID: \"b8d7686a-64c0-4057-a2f7-c05c909d1112\") " pod="opendatahub/test-curl-7350-140560019476528"
Jul 16 12:39:06.958372 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:06.958319    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t575v\" (UniqueName: \"kubernetes.io/projected/b8d7686a-64c0-4057-a2f7-c05c909d1112-kube-api-access-t575v\") pod \"test-curl-7350-140560019476528\" (UID: \"b8d7686a-64c0-4057-a2f7-c05c909d1112\") " pod="opendatahub/test-curl-7350-140560019476528"
Jul 16 12:39:07.045455 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:07.045362    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019476528"
Jul 16 12:39:07.187901 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:07.187866    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140560019476528"]
Jul 16 12:39:07.190841 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:39:07.190816    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8d7686a_64c0_4057_a2f7_c05c909d1112.slice/crio-1f940afa5e82de0f161825eadc84224c00542c002b302425fb770643ae28231e WatchSource:0}: Error finding container 1f940afa5e82de0f161825eadc84224c00542c002b302425fb770643ae28231e: Status 404 returned error can't find the container with id 1f940afa5e82de0f161825eadc84224c00542c002b302425fb770643ae28231e
Jul 16 12:39:07.408911 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:07.408883    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019476528"
Jul 16 12:39:07.408911 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:07.408903    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f38a81f57a961da741a111aeccb2e346f4afbbb70f4453485d9642086109766a"
Jul 16 12:39:07.410105 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:07.410080    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140560019476528" event={"ID":"b8d7686a-64c0-4057-a2f7-c05c909d1112","Type":"ContainerStarted","Data":"1f940afa5e82de0f161825eadc84224c00542c002b302425fb770643ae28231e"}
Jul 16 12:39:07.421070 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:07.421042    2564 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7350-140560019476528" oldPodUID="ee8fd43f-fbb7-4430-9d02-eef629377c76" podUID="b8d7686a-64c0-4057-a2f7-c05c909d1112"
Jul 16 12:39:07.854195 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:07.854112    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee8fd43f-fbb7-4430-9d02-eef629377c76" path="/var/lib/kubelet/pods/ee8fd43f-fbb7-4430-9d02-eef629377c76/volumes"
Jul 16 12:39:08.416911 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:08.416878    2564 generic.go:356] "Generic (PLEG): container finished" podID="b8d7686a-64c0-4057-a2f7-c05c909d1112" containerID="58a131aabfced83916824a305529ec46a98ccaffef85f51a1fa41db7dfa09aba" exitCode=0
Jul 16 12:39:08.417080 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:08.416924    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140560019476528" event={"ID":"b8d7686a-64c0-4057-a2f7-c05c909d1112","Type":"ContainerDied","Data":"58a131aabfced83916824a305529ec46a98ccaffef85f51a1fa41db7dfa09aba"}
Jul 16 12:39:09.557459 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:09.557430    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019476528"
Jul 16 12:39:09.586438 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:09.586406    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7350-140560019476528_b8d7686a-64c0-4057-a2f7-c05c909d1112/test-curl-7350-140560019476528/0.log"
Jul 16 12:39:09.625176 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:09.625144    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7350-140560019476528"]
Jul 16 12:39:09.634411 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:09.634375    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7350-140560019476528"]
Jul 16 12:39:09.671063 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:09.671030    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t575v\" (UniqueName: \"kubernetes.io/projected/b8d7686a-64c0-4057-a2f7-c05c909d1112-kube-api-access-t575v\") pod \"b8d7686a-64c0-4057-a2f7-c05c909d1112\" (UID: \"b8d7686a-64c0-4057-a2f7-c05c909d1112\") "
Jul 16 12:39:09.673388 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:09.673311    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8d7686a-64c0-4057-a2f7-c05c909d1112-kube-api-access-t575v" (OuterVolumeSpecName: "kube-api-access-t575v") pod "b8d7686a-64c0-4057-a2f7-c05c909d1112" (UID: "b8d7686a-64c0-4057-a2f7-c05c909d1112"). InnerVolumeSpecName "kube-api-access-t575v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:39:09.766404 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:09.766368    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7350-140560019477536"]
Jul 16 12:39:09.766729 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:09.766716    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8d7686a-64c0-4057-a2f7-c05c909d1112" containerName="test-curl-7350-140560019476528"
Jul 16 12:39:09.766779 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:09.766731    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8d7686a-64c0-4057-a2f7-c05c909d1112" containerName="test-curl-7350-140560019476528"
Jul 16 12:39:09.766819 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:09.766803    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8d7686a-64c0-4057-a2f7-c05c909d1112" containerName="test-curl-7350-140560019476528"
Jul 16 12:39:09.769774 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:09.769753    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019477536"
Jul 16 12:39:09.772233 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:09.772210    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t575v\" (UniqueName: \"kubernetes.io/projected/b8d7686a-64c0-4057-a2f7-c05c909d1112-kube-api-access-t575v\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:39:09.779639 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:09.779611    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140560019477536"]
Jul 16 12:39:09.854704 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:09.854670    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8d7686a-64c0-4057-a2f7-c05c909d1112" path="/var/lib/kubelet/pods/b8d7686a-64c0-4057-a2f7-c05c909d1112/volumes"
Jul 16 12:39:09.873491 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:09.873462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gphlp\" (UniqueName: \"kubernetes.io/projected/504a4b04-48bf-44e0-8167-82b5092afbbe-kube-api-access-gphlp\") pod \"test-curl-7350-140560019477536\" (UID: \"504a4b04-48bf-44e0-8167-82b5092afbbe\") " pod="opendatahub/test-curl-7350-140560019477536"
Jul 16 12:39:09.974555 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:09.974450    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gphlp\" (UniqueName: \"kubernetes.io/projected/504a4b04-48bf-44e0-8167-82b5092afbbe-kube-api-access-gphlp\") pod \"test-curl-7350-140560019477536\" (UID: \"504a4b04-48bf-44e0-8167-82b5092afbbe\") " pod="opendatahub/test-curl-7350-140560019477536"
Jul 16 12:39:09.990887 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:09.990852    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gphlp\" (UniqueName: \"kubernetes.io/projected/504a4b04-48bf-44e0-8167-82b5092afbbe-kube-api-access-gphlp\") pod \"test-curl-7350-140560019477536\" (UID: \"504a4b04-48bf-44e0-8167-82b5092afbbe\") " pod="opendatahub/test-curl-7350-140560019477536"
Jul 16 12:39:10.080809 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:10.080755    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019477536"
Jul 16 12:39:10.232188 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:10.232101    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140560019477536"]
Jul 16 12:39:10.243661 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:39:10.243620    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod504a4b04_48bf_44e0_8167_82b5092afbbe.slice/crio-6dbed27ee213280247cc6624430b21a41e67edc96a2fc4bc91c9714fae647b19 WatchSource:0}: Error finding container 6dbed27ee213280247cc6624430b21a41e67edc96a2fc4bc91c9714fae647b19: Status 404 returned error can't find the container with id 6dbed27ee213280247cc6624430b21a41e67edc96a2fc4bc91c9714fae647b19
Jul 16 12:39:10.428056 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:10.428012    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140560019477536" event={"ID":"504a4b04-48bf-44e0-8167-82b5092afbbe","Type":"ContainerStarted","Data":"6dbed27ee213280247cc6624430b21a41e67edc96a2fc4bc91c9714fae647b19"}
Jul 16 12:39:10.429240 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:10.429224    2564 scope.go:117] "RemoveContainer" containerID="58a131aabfced83916824a305529ec46a98ccaffef85f51a1fa41db7dfa09aba"
Jul 16 12:39:10.429321 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:10.429256    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019476528"
Jul 16 12:39:11.435879 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:11.435842    2564 generic.go:356] "Generic (PLEG): container finished" podID="504a4b04-48bf-44e0-8167-82b5092afbbe" containerID="b331cce667de081fa48b458ce49d5ecc52319b29259e19237ac55707ab4c2ac0" exitCode=0
Jul 16 12:39:11.436317 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:11.435892    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140560019477536" event={"ID":"504a4b04-48bf-44e0-8167-82b5092afbbe","Type":"ContainerDied","Data":"b331cce667de081fa48b458ce49d5ecc52319b29259e19237ac55707ab4c2ac0"}
Jul 16 12:39:12.581623 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:12.581591    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019477536"
Jul 16 12:39:12.609076 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:12.609050    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7350-140560019477536_504a4b04-48bf-44e0-8167-82b5092afbbe/test-curl-7350-140560019477536/0.log"
Jul 16 12:39:12.642500 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:12.642464    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7350-140560019477536"]
Jul 16 12:39:12.646402 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:12.646376    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7350-140560019477536"]
Jul 16 12:39:12.700954 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:12.700859    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gphlp\" (UniqueName: \"kubernetes.io/projected/504a4b04-48bf-44e0-8167-82b5092afbbe-kube-api-access-gphlp\") pod \"504a4b04-48bf-44e0-8167-82b5092afbbe\" (UID: \"504a4b04-48bf-44e0-8167-82b5092afbbe\") "
Jul 16 12:39:12.703137 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:12.703111    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504a4b04-48bf-44e0-8167-82b5092afbbe-kube-api-access-gphlp" (OuterVolumeSpecName: "kube-api-access-gphlp") pod "504a4b04-48bf-44e0-8167-82b5092afbbe" (UID: "504a4b04-48bf-44e0-8167-82b5092afbbe"). InnerVolumeSpecName "kube-api-access-gphlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:39:12.791203 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:12.791165    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7350-140560019477536"]
Jul 16 12:39:12.791526 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:12.791512    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="504a4b04-48bf-44e0-8167-82b5092afbbe" containerName="test-curl-7350-140560019477536"
Jul 16 12:39:12.791585 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:12.791528    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="504a4b04-48bf-44e0-8167-82b5092afbbe" containerName="test-curl-7350-140560019477536"
Jul 16 12:39:12.791618 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:12.791595    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="504a4b04-48bf-44e0-8167-82b5092afbbe" containerName="test-curl-7350-140560019477536"
Jul 16 12:39:12.794558 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:12.794536    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019477536"
Jul 16 12:39:12.801819 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:12.801791    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gphlp\" (UniqueName: \"kubernetes.io/projected/504a4b04-48bf-44e0-8167-82b5092afbbe-kube-api-access-gphlp\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:39:12.818404 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:12.818375    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140560019477536"]
Jul 16 12:39:12.903010 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:12.902973    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt5jt\" (UniqueName: \"kubernetes.io/projected/d962e20c-2cea-4ca8-98c5-2c9e02e35741-kube-api-access-jt5jt\") pod \"test-curl-7350-140560019477536\" (UID: \"d962e20c-2cea-4ca8-98c5-2c9e02e35741\") " pod="opendatahub/test-curl-7350-140560019477536"
Jul 16 12:39:13.004565 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:13.004468    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt5jt\" (UniqueName: \"kubernetes.io/projected/d962e20c-2cea-4ca8-98c5-2c9e02e35741-kube-api-access-jt5jt\") pod \"test-curl-7350-140560019477536\" (UID: \"d962e20c-2cea-4ca8-98c5-2c9e02e35741\") " pod="opendatahub/test-curl-7350-140560019477536"
Jul 16 12:39:13.022398 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:13.022362    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt5jt\" (UniqueName: \"kubernetes.io/projected/d962e20c-2cea-4ca8-98c5-2c9e02e35741-kube-api-access-jt5jt\") pod \"test-curl-7350-140560019477536\" (UID: \"d962e20c-2cea-4ca8-98c5-2c9e02e35741\") " pod="opendatahub/test-curl-7350-140560019477536"
Jul 16 12:39:13.104404 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:13.104361    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019477536"
Jul 16 12:39:13.242558 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:13.242527    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140560019477536"]
Jul 16 12:39:13.244096 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:39:13.244061    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd962e20c_2cea_4ca8_98c5_2c9e02e35741.slice/crio-06064e40c55b54b4a87bc8692b4c3135559e43ac611a9496230737f112ac8266 WatchSource:0}: Error finding container 06064e40c55b54b4a87bc8692b4c3135559e43ac611a9496230737f112ac8266: Status 404 returned error can't find the container with id 06064e40c55b54b4a87bc8692b4c3135559e43ac611a9496230737f112ac8266
Jul 16 12:39:13.448697 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:13.448671    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019477536"
Jul 16 12:39:13.448884 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:13.448715    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6dbed27ee213280247cc6624430b21a41e67edc96a2fc4bc91c9714fae647b19"
Jul 16 12:39:13.449907 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:13.449876    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140560019477536" event={"ID":"d962e20c-2cea-4ca8-98c5-2c9e02e35741","Type":"ContainerStarted","Data":"06064e40c55b54b4a87bc8692b4c3135559e43ac611a9496230737f112ac8266"}
Jul 16 12:39:13.460728 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:13.460701    2564 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7350-140560019477536" oldPodUID="504a4b04-48bf-44e0-8167-82b5092afbbe" podUID="d962e20c-2cea-4ca8-98c5-2c9e02e35741"
Jul 16 12:39:13.855132 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:13.855050    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="504a4b04-48bf-44e0-8167-82b5092afbbe" path="/var/lib/kubelet/pods/504a4b04-48bf-44e0-8167-82b5092afbbe/volumes"
Jul 16 12:39:14.456788 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:14.456752    2564 generic.go:356] "Generic (PLEG): container finished" podID="d962e20c-2cea-4ca8-98c5-2c9e02e35741" containerID="cb05ed98ee4dd1abca30d7714f3db8e481cdde62d57769cc6145c3de17c3f16f" exitCode=0
Jul 16 12:39:14.456975 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:14.456837    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140560019477536" event={"ID":"d962e20c-2cea-4ca8-98c5-2c9e02e35741","Type":"ContainerDied","Data":"cb05ed98ee4dd1abca30d7714f3db8e481cdde62d57769cc6145c3de17c3f16f"}
Jul 16 12:39:15.599665 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:15.599635    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019477536"
Jul 16 12:39:15.628536 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:15.628499    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7350-140560019477536_d962e20c-2cea-4ca8-98c5-2c9e02e35741/test-curl-7350-140560019477536/0.log"
Jul 16 12:39:15.659523 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:15.659487    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7350-140560019477536"]
Jul 16 12:39:15.663647 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:15.663619    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7350-140560019477536"]
Jul 16 12:39:15.731087 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:15.731006    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jt5jt\" (UniqueName: \"kubernetes.io/projected/d962e20c-2cea-4ca8-98c5-2c9e02e35741-kube-api-access-jt5jt\") pod \"d962e20c-2cea-4ca8-98c5-2c9e02e35741\" (UID: \"d962e20c-2cea-4ca8-98c5-2c9e02e35741\") "
Jul 16 12:39:15.733227 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:15.733197    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d962e20c-2cea-4ca8-98c5-2c9e02e35741-kube-api-access-jt5jt" (OuterVolumeSpecName: "kube-api-access-jt5jt") pod "d962e20c-2cea-4ca8-98c5-2c9e02e35741" (UID: "d962e20c-2cea-4ca8-98c5-2c9e02e35741"). InnerVolumeSpecName "kube-api-access-jt5jt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:39:15.831890 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:15.831853    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt5jt\" (UniqueName: \"kubernetes.io/projected/d962e20c-2cea-4ca8-98c5-2c9e02e35741-kube-api-access-jt5jt\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:39:15.858160 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:15.858128    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d962e20c-2cea-4ca8-98c5-2c9e02e35741" path="/var/lib/kubelet/pods/d962e20c-2cea-4ca8-98c5-2c9e02e35741/volumes"
Jul 16 12:39:15.873344 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:15.873297    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a96583-gq8fk"]
Jul 16 12:39:15.873675 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:15.873661    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d962e20c-2cea-4ca8-98c5-2c9e02e35741" containerName="test-curl-7350-140560019477536"
Jul 16 12:39:15.873719 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:15.873677    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d962e20c-2cea-4ca8-98c5-2c9e02e35741" containerName="test-curl-7350-140560019477536"
Jul 16 12:39:15.873759 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:15.873739    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d962e20c-2cea-4ca8-98c5-2c9e02e35741" containerName="test-curl-7350-140560019477536"
Jul 16 12:39:15.876741 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:15.876723    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a96583-gq8fk"
Jul 16 12:39:15.881227 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:15.881206    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:39:15.881544 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:15.881520    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 12:39:15.888919 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:15.888892    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a96583-gq8fk"]
Jul 16 12:39:16.033966 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:16.033865    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dcd8538-36d3-46af-b2b8-282df4487cde-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a96583-gq8fk\" (UID: \"9dcd8538-36d3-46af-b2b8-282df4487cde\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a96583-gq8fk"
Jul 16 12:39:16.135391 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:16.135312    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dcd8538-36d3-46af-b2b8-282df4487cde-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a96583-gq8fk\" (UID: \"9dcd8538-36d3-46af-b2b8-282df4487cde\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a96583-gq8fk"
Jul 16 12:39:16.136006 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:16.135977    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dcd8538-36d3-46af-b2b8-282df4487cde-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a96583-gq8fk\" (UID: \"9dcd8538-36d3-46af-b2b8-282df4487cde\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a96583-gq8fk"
Jul 16 12:39:16.187541 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:16.187497    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a96583-gq8fk"
Jul 16 12:39:16.330152 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:16.330120    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a96583-gq8fk"]
Jul 16 12:39:16.331272 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:39:16.331244    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dcd8538_36d3_46af_b2b8_282df4487cde.slice/crio-c6c58cbfdc90ff7ce6a42ff89f760df5a33c76d96f2ce06226f7729b743de361 WatchSource:0}: Error finding container c6c58cbfdc90ff7ce6a42ff89f760df5a33c76d96f2ce06226f7729b743de361: Status 404 returned error can't find the container with id c6c58cbfdc90ff7ce6a42ff89f760df5a33c76d96f2ce06226f7729b743de361
Jul 16 12:39:16.469483 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:16.469444    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a96583-gq8fk" event={"ID":"9dcd8538-36d3-46af-b2b8-282df4487cde","Type":"ContainerStarted","Data":"c6c58cbfdc90ff7ce6a42ff89f760df5a33c76d96f2ce06226f7729b743de361"}
Jul 16 12:39:16.470773 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:16.470751    2564 scope.go:117] "RemoveContainer" containerID="cb05ed98ee4dd1abca30d7714f3db8e481cdde62d57769cc6145c3de17c3f16f"
Jul 16 12:39:16.470899 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:16.470772    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140560019477536"
Jul 16 12:39:17.477825 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:17.477793    2564 generic.go:356] "Generic (PLEG): container finished" podID="9dcd8538-36d3-46af-b2b8-282df4487cde" containerID="fce2ea8cf1a6f5367ae25176363c65cae64ad51300a399b033ca38a9f20c169b" exitCode=0
Jul 16 12:39:17.478269 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:17.477887    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a96583-gq8fk" event={"ID":"9dcd8538-36d3-46af-b2b8-282df4487cde","Type":"ContainerDied","Data":"fce2ea8cf1a6f5367ae25176363c65cae64ad51300a399b033ca38a9f20c169b"}
Jul 16 12:39:18.620941 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:18.620916    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a96583-gq8fk"
Jul 16 12:39:18.757643 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:18.757544    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dcd8538-36d3-46af-b2b8-282df4487cde-maas-api-service-ca\") pod \"9dcd8538-36d3-46af-b2b8-282df4487cde\" (UID: \"9dcd8538-36d3-46af-b2b8-282df4487cde\") "
Jul 16 12:39:18.757950 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:18.757925    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dcd8538-36d3-46af-b2b8-282df4487cde-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9dcd8538-36d3-46af-b2b8-282df4487cde" (UID: "9dcd8538-36d3-46af-b2b8-282df4487cde"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:39:18.858320 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:18.858284    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dcd8538-36d3-46af-b2b8-282df4487cde-maas-api-service-ca\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:39:19.489719 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:19.489682    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a96583-gq8fk" event={"ID":"9dcd8538-36d3-46af-b2b8-282df4487cde","Type":"ContainerDied","Data":"c6c58cbfdc90ff7ce6a42ff89f760df5a33c76d96f2ce06226f7729b743de361"}
Jul 16 12:39:19.489964 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:19.489754    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6c58cbfdc90ff7ce6a42ff89f760df5a33c76d96f2ce06226f7729b743de361"
Jul 16 12:39:19.489964 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:19.489692    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a96583-gq8fk"
Jul 16 12:39:29.995296 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:29.995254    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:39:42.110507 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:42.110475    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66e9a3-vgx7n"]
Jul 16 12:39:42.110897 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:42.110808    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dcd8538-36d3-46af-b2b8-282df4487cde" containerName="revoke-keys"
Jul 16 12:39:42.110897 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:42.110819    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dcd8538-36d3-46af-b2b8-282df4487cde" containerName="revoke-keys"
Jul 16 12:39:42.110897 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:42.110871    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dcd8538-36d3-46af-b2b8-282df4487cde" containerName="revoke-keys"
Jul 16 12:39:42.115894 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:42.115876    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66e9a3-vgx7n"
Jul 16 12:39:42.118855 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:42.118837    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:39:42.118997 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:42.118840    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 12:39:42.123379 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:42.123308    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66e9a3-vgx7n"]
Jul 16 12:39:42.168107 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:42.168069    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81079d35-d018-4bce-9169-33c11d5caa4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-66e9a3-vgx7n\" (UID: \"81079d35-d018-4bce-9169-33c11d5caa4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66e9a3-vgx7n"
Jul 16 12:39:42.269139 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:42.269097    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81079d35-d018-4bce-9169-33c11d5caa4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-66e9a3-vgx7n\" (UID: \"81079d35-d018-4bce-9169-33c11d5caa4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66e9a3-vgx7n"
Jul 16 12:39:42.269794 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:42.269767    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81079d35-d018-4bce-9169-33c11d5caa4d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-66e9a3-vgx7n\" (UID: \"81079d35-d018-4bce-9169-33c11d5caa4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66e9a3-vgx7n"
Jul 16 12:39:42.427588 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:42.427554    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66e9a3-vgx7n"
Jul 16 12:39:42.581157 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:39:42.581128    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81079d35_d018_4bce_9169_33c11d5caa4d.slice/crio-41977c7351d1714a3e8c1a464841b28cd6be5080e6769fbd286eb95afccaea25 WatchSource:0}: Error finding container 41977c7351d1714a3e8c1a464841b28cd6be5080e6769fbd286eb95afccaea25: Status 404 returned error can't find the container with id 41977c7351d1714a3e8c1a464841b28cd6be5080e6769fbd286eb95afccaea25
Jul 16 12:39:42.586934 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:42.586908    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66e9a3-vgx7n"]
Jul 16 12:39:42.611390 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:42.611362    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66e9a3-vgx7n" event={"ID":"81079d35-d018-4bce-9169-33c11d5caa4d","Type":"ContainerStarted","Data":"41977c7351d1714a3e8c1a464841b28cd6be5080e6769fbd286eb95afccaea25"}
Jul 16 12:39:43.618655 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:43.618619    2564 generic.go:356] "Generic (PLEG): container finished" podID="81079d35-d018-4bce-9169-33c11d5caa4d" containerID="06cad9a4418294d8beee0844e19615f028f5ca5ea8b3ec7d4cb82104d67710e7" exitCode=0
Jul 16 12:39:43.619017 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:43.618680    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66e9a3-vgx7n" event={"ID":"81079d35-d018-4bce-9169-33c11d5caa4d","Type":"ContainerDied","Data":"06cad9a4418294d8beee0844e19615f028f5ca5ea8b3ec7d4cb82104d67710e7"}
Jul 16 12:39:44.758027 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:44.758003    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66e9a3-vgx7n"
Jul 16 12:39:44.790457 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:44.790428    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81079d35-d018-4bce-9169-33c11d5caa4d-maas-api-service-ca\") pod \"81079d35-d018-4bce-9169-33c11d5caa4d\" (UID: \"81079d35-d018-4bce-9169-33c11d5caa4d\") "
Jul 16 12:39:44.790755 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:44.790735    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81079d35-d018-4bce-9169-33c11d5caa4d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "81079d35-d018-4bce-9169-33c11d5caa4d" (UID: "81079d35-d018-4bce-9169-33c11d5caa4d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:39:44.891796 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:44.891715    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81079d35-d018-4bce-9169-33c11d5caa4d-maas-api-service-ca\") on node \"ip-10-0-129-78.ec2.internal\" DevicePath \"\""
Jul 16 12:39:45.631417 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:45.631388    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66e9a3-vgx7n"
Jul 16 12:39:45.631584 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:45.631432    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-66e9a3-vgx7n" event={"ID":"81079d35-d018-4bce-9169-33c11d5caa4d","Type":"ContainerDied","Data":"41977c7351d1714a3e8c1a464841b28cd6be5080e6769fbd286eb95afccaea25"}
Jul 16 12:39:45.631584 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:45.631476    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41977c7351d1714a3e8c1a464841b28cd6be5080e6769fbd286eb95afccaea25"
Jul 16 12:39:55.786838 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:39:55.786786    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7brcb"]
Jul 16 12:40:08.785273 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:08.785240    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76b955f8f8-zp75h_61dd6670-0366-4d6d-94be-6b0d455e6d5a/authorino/0.log"
Jul 16 12:40:15.188136 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:15.188059    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dvg4x_d106636a-4bfc-4af0-a287-975598e759ea/server/0.log"
Jul 16 12:40:15.579842 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:15.579757    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57d7447f8f-lvlfn_221c55eb-d383-48f0-9521-d6c03a4ba52f/copy-manifests/0.log"
Jul 16 12:40:15.598534 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:15.598493    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57d7447f8f-lvlfn_221c55eb-d383-48f0-9521-d6c03a4ba52f/manager/0.log"
Jul 16 12:40:16.718309 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:16.718276    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-2f272c-bv9vf_4fc25d2e-588a-418b-8419-d6094e5610b0/revoke-keys/0.log"
Jul 16 12:40:17.074223 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:17.074134    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-e86929-gdqmx_3510e684-19d6-4e3f-a67e-ef3bb1628337/revoke-keys/0.log"
Jul 16 12:40:17.674527 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:17.674489    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-a96583-gq8fk_9dcd8538-36d3-46af-b2b8-282df4487cde/revoke-keys/0.log"
Jul 16 12:40:17.793189 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:17.793166    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-66e9a3-vgx7n_81079d35-d018-4bce-9169-33c11d5caa4d/revoke-keys/0.log"
Jul 16 12:40:18.752118 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:18.752088    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc_28383a56-3f32-43d0-95ca-7b2aa1ec3427/util/0.log"
Jul 16 12:40:18.759695 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:18.759673    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc_28383a56-3f32-43d0-95ca-7b2aa1ec3427/pull/0.log"
Jul 16 12:40:18.766963 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:18.766946    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc_28383a56-3f32-43d0-95ca-7b2aa1ec3427/extract/0.log"
Jul 16 12:40:18.910928 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:18.910898    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2_9272f491-ef17-45d3-bc56-fc9b760d3648/util/0.log"
Jul 16 12:40:18.917983 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:18.917959    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2_9272f491-ef17-45d3-bc56-fc9b760d3648/pull/0.log"
Jul 16 12:40:18.924924 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:18.924903    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2_9272f491-ef17-45d3-bc56-fc9b760d3648/extract/0.log"
Jul 16 12:40:19.052506 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:19.052430    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t_45a0611a-315a-47a4-aa28-68ef6f90dc7d/util/0.log"
Jul 16 12:40:19.060479 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:19.060459    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t_45a0611a-315a-47a4-aa28-68ef6f90dc7d/pull/0.log"
Jul 16 12:40:19.067968 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:19.067952    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t_45a0611a-315a-47a4-aa28-68ef6f90dc7d/extract/0.log"
Jul 16 12:40:19.198346 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:19.198305    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76_90b8c1bc-8179-48af-abde-791e9e86a979/util/0.log"
Jul 16 12:40:19.205736 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:19.205714    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76_90b8c1bc-8179-48af-abde-791e9e86a979/pull/0.log"
Jul 16 12:40:19.213127 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:19.213108    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76_90b8c1bc-8179-48af-abde-791e9e86a979/extract/0.log"
Jul 16 12:40:19.349509 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:19.349425    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76b955f8f8-zp75h_61dd6670-0366-4d6d-94be-6b0d455e6d5a/authorino/0.log"
Jul 16 12:40:20.133299 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:20.133273    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7brcb_32da4eec-08f5-40e2-b357-e77c2154ece7/limitador/0.log"
Jul 16 12:40:21.011732 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:21.011699    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69fc9c4ddf-7c878_c8b8b732-e65f-4754-982a-5aea00a87561/kube-auth-proxy/0.log"
Jul 16 12:40:22.539805 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:22.539772    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-m2tp4_04ab4861-d25c-486a-a250-f57f58507438/main/0.log"
Jul 16 12:40:28.651176 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:28.651135    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2sc8x/must-gather-g7qpg"]
Jul 16 12:40:28.651637 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:28.651538    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81079d35-d018-4bce-9169-33c11d5caa4d" containerName="revoke-keys"
Jul 16 12:40:28.651637 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:28.651551    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="81079d35-d018-4bce-9169-33c11d5caa4d" containerName="revoke-keys"
Jul 16 12:40:28.651637 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:28.651632    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="81079d35-d018-4bce-9169-33c11d5caa4d" containerName="revoke-keys"
Jul 16 12:40:28.654917 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:28.654896    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2sc8x/must-gather-g7qpg"
Jul 16 12:40:28.658093 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:28.658071    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2sc8x\"/\"default-dockercfg-hxnm7\""
Jul 16 12:40:28.658211 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:28.658079    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2sc8x\"/\"openshift-service-ca.crt\""
Jul 16 12:40:28.658211 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:28.658150    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2sc8x\"/\"kube-root-ca.crt\""
Jul 16 12:40:28.667058 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:28.667035    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4sqf\" (UniqueName: \"kubernetes.io/projected/356bfb10-ed62-4759-9204-71008ab51ad3-kube-api-access-h4sqf\") pod \"must-gather-g7qpg\" (UID: \"356bfb10-ed62-4759-9204-71008ab51ad3\") " pod="openshift-must-gather-2sc8x/must-gather-g7qpg"
Jul 16 12:40:28.667255 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:28.667090    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/356bfb10-ed62-4759-9204-71008ab51ad3-must-gather-output\") pod \"must-gather-g7qpg\" (UID: \"356bfb10-ed62-4759-9204-71008ab51ad3\") " pod="openshift-must-gather-2sc8x/must-gather-g7qpg"
Jul 16 12:40:28.670181 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:28.670160    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2sc8x/must-gather-g7qpg"]
Jul 16 12:40:28.767769 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:28.767734    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4sqf\" (UniqueName: \"kubernetes.io/projected/356bfb10-ed62-4759-9204-71008ab51ad3-kube-api-access-h4sqf\") pod \"must-gather-g7qpg\" (UID: \"356bfb10-ed62-4759-9204-71008ab51ad3\") " pod="openshift-must-gather-2sc8x/must-gather-g7qpg"
Jul 16 12:40:28.767932 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:28.767797    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/356bfb10-ed62-4759-9204-71008ab51ad3-must-gather-output\") pod \"must-gather-g7qpg\" (UID: \"356bfb10-ed62-4759-9204-71008ab51ad3\") " pod="openshift-must-gather-2sc8x/must-gather-g7qpg"
Jul 16 12:40:28.768076 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:28.768057    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/356bfb10-ed62-4759-9204-71008ab51ad3-must-gather-output\") pod \"must-gather-g7qpg\" (UID: \"356bfb10-ed62-4759-9204-71008ab51ad3\") " pod="openshift-must-gather-2sc8x/must-gather-g7qpg"
Jul 16 12:40:28.779942 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:28.779915    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4sqf\" (UniqueName: \"kubernetes.io/projected/356bfb10-ed62-4759-9204-71008ab51ad3-kube-api-access-h4sqf\") pod \"must-gather-g7qpg\" (UID: \"356bfb10-ed62-4759-9204-71008ab51ad3\") " pod="openshift-must-gather-2sc8x/must-gather-g7qpg"
Jul 16 12:40:28.964244 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:28.964152    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2sc8x/must-gather-g7qpg"
Jul 16 12:40:29.111415 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:29.111389    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2sc8x/must-gather-g7qpg"]
Jul 16 12:40:29.113721 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:40:29.113693    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod356bfb10_ed62_4759_9204_71008ab51ad3.slice/crio-398c8313d2612a109b2806da22e61b193322a2ef961920e70f4051cd8a2cbaaf WatchSource:0}: Error finding container 398c8313d2612a109b2806da22e61b193322a2ef961920e70f4051cd8a2cbaaf: Status 404 returned error can't find the container with id 398c8313d2612a109b2806da22e61b193322a2ef961920e70f4051cd8a2cbaaf
Jul 16 12:40:29.869305 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:29.869264    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2sc8x/must-gather-g7qpg" event={"ID":"356bfb10-ed62-4759-9204-71008ab51ad3","Type":"ContainerStarted","Data":"398c8313d2612a109b2806da22e61b193322a2ef961920e70f4051cd8a2cbaaf"}
Jul 16 12:40:30.879489 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:30.879443    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2sc8x/must-gather-g7qpg" event={"ID":"356bfb10-ed62-4759-9204-71008ab51ad3","Type":"ContainerStarted","Data":"867b340d5820018d3f8c7985aec148f9f25a0919e5be09b76a51698e6d85ba44"}
Jul 16 12:40:30.879892 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:30.879507    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2sc8x/must-gather-g7qpg" event={"ID":"356bfb10-ed62-4759-9204-71008ab51ad3","Type":"ContainerStarted","Data":"53c5e6b1bce43cfd0a8790a31e32cc6aa79a86018c28314290c0793d3b5e6f86"}
Jul 16 12:40:30.896618 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:30.896560    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2sc8x/must-gather-g7qpg" podStartSLOduration=2.022168402 podStartE2EDuration="2.896540231s" totalImagesPullingTime="874.371829ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:40:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:30.895756909 +0000 UTC m=+2959.530550981" watchObservedRunningTime="2026-07-16 12:40:30.896540231 +0000 UTC m=+2959.531334305"
Jul 16 12:40:31.642456 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:31.642427    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fdd9b_554acfac-aace-48e2-a6e4-54b9a794d6ee/global-pull-secret-syncer/0.log"
Jul 16 12:40:31.808955 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:31.808915    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qj68c_f01f887f-219a-4248-a266-511c7fa0eea4/konnectivity-agent/0.log"
Jul 16 12:40:31.861096 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:31.861032    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-78.ec2.internal_69bb1843a08e184331a0a7517508501b/haproxy/0.log"
Jul 16 12:40:36.636369 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:36.636283    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc_28383a56-3f32-43d0-95ca-7b2aa1ec3427/extract/0.log"
Jul 16 12:40:36.661405 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:36.661371    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc_28383a56-3f32-43d0-95ca-7b2aa1ec3427/util/0.log"
Jul 16 12:40:36.683786 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:36.683752    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t22bc_28383a56-3f32-43d0-95ca-7b2aa1ec3427/pull/0.log"
Jul 16 12:40:36.711942 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:36.711895    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2_9272f491-ef17-45d3-bc56-fc9b760d3648/extract/0.log"
Jul 16 12:40:36.734963 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:36.734931    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2_9272f491-ef17-45d3-bc56-fc9b760d3648/util/0.log"
Jul 16 12:40:36.760509 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:36.760470    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cg8s2_9272f491-ef17-45d3-bc56-fc9b760d3648/pull/0.log"
Jul 16 12:40:36.798299 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:36.798269    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t_45a0611a-315a-47a4-aa28-68ef6f90dc7d/extract/0.log"
Jul 16 12:40:36.820636 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:36.820608    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t_45a0611a-315a-47a4-aa28-68ef6f90dc7d/util/0.log"
Jul 16 12:40:36.846388 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:36.846356    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739mj4t_45a0611a-315a-47a4-aa28-68ef6f90dc7d/pull/0.log"
Jul 16 12:40:36.877713 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:36.877667    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76_90b8c1bc-8179-48af-abde-791e9e86a979/extract/0.log"
Jul 16 12:40:36.902221 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:36.902139    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76_90b8c1bc-8179-48af-abde-791e9e86a979/util/0.log"
Jul 16 12:40:36.933548 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:36.933516    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15qx76_90b8c1bc-8179-48af-abde-791e9e86a979/pull/0.log"
Jul 16 12:40:37.525354 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:37.525138    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76b955f8f8-zp75h_61dd6670-0366-4d6d-94be-6b0d455e6d5a/authorino/0.log"
Jul 16 12:40:37.851934 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:37.851864    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7brcb_32da4eec-08f5-40e2-b357-e77c2154ece7/limitador/0.log"
Jul 16 12:40:39.958926 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:39.958830    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8695566d49-2mb6f_7262dac5-3e13-4ad6-be18-0c87ac6e82a9/metrics-server/0.log"
Jul 16 12:40:40.021378 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:40.021313    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7fsk8_d030df13-f44a-4e02-8f03-b903776e57a8/node-exporter/0.log"
Jul 16 12:40:40.047734 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:40.047699    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7fsk8_d030df13-f44a-4e02-8f03-b903776e57a8/kube-rbac-proxy/0.log"
Jul 16 12:40:40.079966 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:40.079917    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7fsk8_d030df13-f44a-4e02-8f03-b903776e57a8/init-textfile/0.log"
Jul 16 12:40:40.548958 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:40.548923    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-2sjp2_667ec765-f8ba-48c6-b5b3-8668a2cb7ea5/prometheus-operator/0.log"
Jul 16 12:40:40.568083 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:40.568056    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-2sjp2_667ec765-f8ba-48c6-b5b3-8668a2cb7ea5/kube-rbac-proxy/0.log"
Jul 16 12:40:40.603983 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:40.603941    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-9czvt_efc1f5b6-ea75-450f-b72b-a47a5af547aa/prometheus-operator-admission-webhook/0.log"
Jul 16 12:40:40.637542 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:40.637515    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-689dc86744-xxmks_57e0fac1-c52b-4d57-8349-9d1cd3a557e6/telemeter-client/0.log"
Jul 16 12:40:40.659598 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:40.659563    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-689dc86744-xxmks_57e0fac1-c52b-4d57-8349-9d1cd3a557e6/reload/0.log"
Jul 16 12:40:40.682237 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:40.682205    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-689dc86744-xxmks_57e0fac1-c52b-4d57-8349-9d1cd3a557e6/kube-rbac-proxy/0.log"
Jul 16 12:40:42.639322 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.639291    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"]
Jul 16 12:40:42.643772 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.643747    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:42.653849 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.653824    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"]
Jul 16 12:40:42.704891 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.704854    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06-sys\") pod \"perf-node-gather-daemonset-jsjq4\" (UID: \"cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:42.705063 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.704908    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzvcg\" (UniqueName: \"kubernetes.io/projected/cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06-kube-api-access-jzvcg\") pod \"perf-node-gather-daemonset-jsjq4\" (UID: \"cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:42.705063 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.704958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06-proc\") pod \"perf-node-gather-daemonset-jsjq4\" (UID: \"cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:42.705063 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.705024    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06-lib-modules\") pod \"perf-node-gather-daemonset-jsjq4\" (UID: \"cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:42.705170 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.705092    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06-podres\") pod \"perf-node-gather-daemonset-jsjq4\" (UID: \"cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:42.805801 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.805764    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06-podres\") pod \"perf-node-gather-daemonset-jsjq4\" (UID: \"cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:42.805953 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.805824    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06-sys\") pod \"perf-node-gather-daemonset-jsjq4\" (UID: \"cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:42.805953 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.805860    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzvcg\" (UniqueName: \"kubernetes.io/projected/cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06-kube-api-access-jzvcg\") pod \"perf-node-gather-daemonset-jsjq4\" (UID: \"cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:42.805953 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.805885    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06-proc\") pod \"perf-node-gather-daemonset-jsjq4\" (UID: \"cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:42.805953 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.805904    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06-sys\") pod \"perf-node-gather-daemonset-jsjq4\" (UID: \"cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:42.805953 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.805944    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06-podres\") pod \"perf-node-gather-daemonset-jsjq4\" (UID: \"cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:42.806124 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.805960    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06-proc\") pod \"perf-node-gather-daemonset-jsjq4\" (UID: \"cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:42.806124 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.805980    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06-lib-modules\") pod \"perf-node-gather-daemonset-jsjq4\" (UID: \"cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:42.806124 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.806107    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06-lib-modules\") pod \"perf-node-gather-daemonset-jsjq4\" (UID: \"cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:42.815097 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.815073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzvcg\" (UniqueName: \"kubernetes.io/projected/cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06-kube-api-access-jzvcg\") pod \"perf-node-gather-daemonset-jsjq4\" (UID: \"cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:42.957859 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:42.957773    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:43.124271 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:43.124241    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d474f4484-drzd9_c39ca538-c0b0-4f17-af3e-6bc175714ee3/console/0.log"
Jul 16 12:40:43.135425 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:43.135397    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"]
Jul 16 12:40:43.138164 ip-10-0-129-78 kubenswrapper[2564]: W0716 12:40:43.138136    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcc7d3383_d53a_4bf7_9e33_0c57f7fb0b06.slice/crio-9e3adaa3a5496c03b92ddc038e424403bf175bff02d3cb39d855f2a606ba7247 WatchSource:0}: Error finding container 9e3adaa3a5496c03b92ddc038e424403bf175bff02d3cb39d855f2a606ba7247: Status 404 returned error can't find the container with id 9e3adaa3a5496c03b92ddc038e424403bf175bff02d3cb39d855f2a606ba7247
Jul 16 12:40:43.986838 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:43.986804    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4" event={"ID":"cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06","Type":"ContainerStarted","Data":"81ed11e46d540a034c5e3b18b87c5f8e2545de2b88aaf07084395cdc34745fe4"}
Jul 16 12:40:43.987362 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:43.986859    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4" event={"ID":"cc7d3383-d53a-4bf7-9e33-0c57f7fb0b06","Type":"ContainerStarted","Data":"9e3adaa3a5496c03b92ddc038e424403bf175bff02d3cb39d855f2a606ba7247"}
Jul 16 12:40:43.987362 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:43.987020    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:44.003738 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:44.003684    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4" podStartSLOduration=2.00366697 podStartE2EDuration="2.00366697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:40:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:44.003146497 +0000 UTC m=+2972.637940570" watchObservedRunningTime="2026-07-16 12:40:44.00366697 +0000 UTC m=+2972.638461040"
Jul 16 12:40:44.802580 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:44.802554    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bfqxq_36c30764-f4ed-4fbc-9369-61a80c162b83/dns/0.log"
Jul 16 12:40:44.824461 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:44.824428    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bfqxq_36c30764-f4ed-4fbc-9369-61a80c162b83/kube-rbac-proxy/0.log"
Jul 16 12:40:45.035037 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:45.035008    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bp2rl_8e38731d-db50-48f8-bf39-caac0473dcc6/dns-node-resolver/0.log"
Jul 16 12:40:45.577257 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:45.577223    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-667f9448f5-wxsg7_9968b111-2956-4e07-8ceb-8596724f4057/registry/0.log"
Jul 16 12:40:45.605860 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:45.605828    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8929c_81602ec2-6161-4799-a83c-d8b926799fe2/node-ca/0.log"
Jul 16 12:40:46.795794 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:46.795763    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69fc9c4ddf-7c878_c8b8b732-e65f-4754-982a-5aea00a87561/kube-auth-proxy/0.log"
Jul 16 12:40:47.661949 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:47.661918    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8cj4r_87611f27-ba17-46a3-8489-7ef7ad49d48d/serve-healthcheck-canary/0.log"
Jul 16 12:40:48.231893 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:48.231860    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2qsjs_e79115f4-3fb7-422c-8d99-62d65531c257/kube-rbac-proxy/0.log"
Jul 16 12:40:48.253807 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:48.253778    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2qsjs_e79115f4-3fb7-422c-8d99-62d65531c257/exporter/0.log"
Jul 16 12:40:48.276878 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:48.276842    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2qsjs_e79115f4-3fb7-422c-8d99-62d65531c257/extractor/0.log"
Jul 16 12:40:50.005108 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:50.005076    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-jsjq4"
Jul 16 12:40:50.882414 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:50.882386    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dvg4x_d106636a-4bfc-4af0-a287-975598e759ea/server/0.log"
Jul 16 12:40:51.144247 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:51.144165    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57d7447f8f-lvlfn_221c55eb-d383-48f0-9521-d6c03a4ba52f/manager/0.log"
Jul 16 12:40:51.162811 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:51.162783    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57d7447f8f-lvlfn_221c55eb-d383-48f0-9521-d6c03a4ba52f/copy-manifests/0.log"
Jul 16 12:40:52.528250 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:52.528222    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69fc9c4ddf-7c878_c8b8b732-e65f-4754-982a-5aea00a87561/kube-auth-proxy/0.log"
Jul 16 12:40:52.655086 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:52.655051    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-86477779b7-n94ql_20f79fb9-dfe2-4356-b705-3fcd6e4cbaa1/manager/0.log"
Jul 16 12:40:52.692899 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:52.692866    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-bwxvt_63e92515-7bce-44df-9050-3ee604acc2e3/openshift-lws-operator/0.log"
Jul 16 12:40:54.133498 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:54.133470    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69fc9c4ddf-7c878_c8b8b732-e65f-4754-982a-5aea00a87561/kube-auth-proxy/0.log"
Jul 16 12:40:58.017076 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:58.017036    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-s5dl6_d05c681c-8aa4-46b1-9bea-78c25a160ed1/kube-storage-version-migrator-operator/1.log"
Jul 16 12:40:58.018496 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:58.018468    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-s5dl6_d05c681c-8aa4-46b1-9bea-78c25a160ed1/kube-storage-version-migrator-operator/0.log"
Jul 16 12:40:59.104138 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:59.104106    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7vtc7_a9dd4544-99c9-4565-8f45-b124541bb29e/kube-multus/0.log"
Jul 16 12:40:59.133423 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:59.133396    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-74ll5_69851010-8a64-40df-b2fa-a65d69a78155/kube-multus-additional-cni-plugins/0.log"
Jul 16 12:40:59.163266 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:59.163246    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-74ll5_69851010-8a64-40df-b2fa-a65d69a78155/egress-router-binary-copy/0.log"
Jul 16 12:40:59.192535 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:59.192507    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-74ll5_69851010-8a64-40df-b2fa-a65d69a78155/cni-plugins/0.log"
Jul 16 12:40:59.214467 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:59.214348    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-74ll5_69851010-8a64-40df-b2fa-a65d69a78155/bond-cni-plugin/0.log"
Jul 16 12:40:59.235247 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:59.235219    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-74ll5_69851010-8a64-40df-b2fa-a65d69a78155/routeoverride-cni/0.log"
Jul 16 12:40:59.256787 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:59.256765    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-74ll5_69851010-8a64-40df-b2fa-a65d69a78155/whereabouts-cni-bincopy/0.log"
Jul 16 12:40:59.278522 ip-10-0-129-78 kubenswrapper[2564]: I0716 12:40:59.278496    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-74ll5_69851010-8a64-40df-b2fa-a65d69a78155/whereabouts-cni/0.log"