Jul 09 00:55:14.811541 ip-10-0-134-227 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 00:55:15.262815 ip-10-0-134-227 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 00:55:15.262815 ip-10-0-134-227 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 00:55:15.262815 ip-10-0-134-227 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 00:55:15.262815 ip-10-0-134-227 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 00:55:15.262815 ip-10-0-134-227 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 00:55:15.263467 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.262874    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 00:55:15.268342 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268325    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 00:55:15.268342 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268341    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268345    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268348    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268351    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268354    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268357    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268359    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268362    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268365    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268368    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268370    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268373    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268375    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268378    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268381    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268384    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268386    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268389    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268391    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268394    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 00:55:15.268405 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268397    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268399    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268405    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268408    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268411    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268413    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268416    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268419    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268421    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268424    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268427    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268429    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268432    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268434    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268437    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268440    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268442    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268444    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268447    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268451    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 00:55:15.268862 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268455    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268458    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268460    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268463    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268466    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268469    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268471    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268474    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268476    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268479    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268481    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268484    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268487    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268489    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268492    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268495    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268498    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268501    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268503    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268506    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 00:55:15.269350 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268508    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268511    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268514    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268516    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268519    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268521    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268524    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268527    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268530    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268532    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268535    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268538    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268541    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268543    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268546    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268548    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268550    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268553    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268555    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268560    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 00:55:15.269820 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268564    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268566    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268569    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268573    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268577    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268581    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268584    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268587    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268590    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268592    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268595    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268597    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268600    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268602    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268605    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268607    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268609    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.268612    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269332    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 00:55:15.270293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269340    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269342    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269345    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269348    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269351    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269355    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269357    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269360    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269363    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269365    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269368    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269370    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269373    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269375    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269378    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269381    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269384    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269386    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269390    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269393    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 00:55:15.270743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269396    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269398    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269401    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269404    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269406    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269409    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269411    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269414    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269416    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269419    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269422    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269424    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269426    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269429    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269431    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269434    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269436    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269439    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269442    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269444    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 00:55:15.271293 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269447    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269449    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269452    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269455    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269458    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269461    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269463    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269466    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269468    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269471    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269473    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269477    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269480    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269482    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269485    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269487    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269490    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269492    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269495    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269497    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 00:55:15.271779 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269500    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269502    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269505    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269507    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269510    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269512    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269515    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269518    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269520    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269523    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269526    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269528    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269533    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269537    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269540    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269542    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269545    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269548    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269551    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 00:55:15.272273 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269555    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269558    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269561    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269564    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269567    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269569    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269574    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269577    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269581    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269584    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269586    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269589    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269591    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269594    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269598    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269601    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269604    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269607    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269610    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 00:55:15.272744 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269973    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269978    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269981    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269983    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269986    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269989    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269992    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269994    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.269997    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270000    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270002    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270005    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270007    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270010    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270012    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270016    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270018    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270021    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270024    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270026    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 00:55:15.273195 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270029    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270032    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270034    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270037    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270039    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270042    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270045    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270047    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270050    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270052    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270055    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270060    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270062    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270064    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270067    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270069    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270072    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270075    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270077    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270080    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 00:55:15.273672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270082    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270085    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270087    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270089    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270092    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270094    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270097    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270100    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270104    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270108    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270110    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270113    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270115    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270118    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270120    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270123    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270125    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270128    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270130    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 00:55:15.274144 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270132    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270135    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270137    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270141    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270146    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270149    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270152    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270155    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270158    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270179    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270183    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270188    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270191    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270194    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270197    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270200    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270203    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270220    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270223    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270226    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 00:55:15.274612 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270231    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270234    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270237    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270241    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270244    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270246    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270249    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270251    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270254    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270256    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270259    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270263    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270266    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270269    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270271    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270274    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270278    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270281    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270283    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270286    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270350    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 00:55:15.275099 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270357    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270364    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270370    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270376    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270381    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270387    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270393    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270398    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270402    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270405    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270408    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270412    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270415    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270418    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270421    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270424    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270427    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270431    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270433    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270436    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270440    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270443    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270447    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 00:55:15.275638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270450    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270453    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270456    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270459    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270463    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270466    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270469    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270472    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270476    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270479    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270482    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270485    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270488    2565 flags.go:64] FLAG: --enable-server="true"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270492    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270497    2565 flags.go:64] FLAG: --event-burst="100"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270499    2565 flags.go:64] FLAG: --event-qps="50"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270502    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270505    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270508    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270512    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270515    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270518    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270521    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270524    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270527    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 00:55:15.276177 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270530    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270533    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270535    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270538    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270541    2565 flags.go:64] FLAG: --feature-gates=""
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270551    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270556    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270559    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270562    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270565    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270568    2565 flags.go:64] FLAG: --help="false"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270573    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270576    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270579    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270582    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270586    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270589    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270592    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270595    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270598    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270601    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270609    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270612    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270616    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 09 00:55:15.276812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270619    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270622    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270625    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270628    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270631    2565 flags.go:64] FLAG: --lock-file=""
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270634    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270637    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270640    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270646    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270648    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270651    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270654    2565 flags.go:64] FLAG: --logging-format="text"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270657    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270660    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270664    2565 flags.go:64] FLAG: --manifest-url=""
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270666    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270671    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270674    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270678    2565 flags.go:64] FLAG: --max-pods="110"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270683    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270686    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270689    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270692    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270695    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270698    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 00:55:15.277407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270701    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270708    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270711    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270714    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270717    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270721    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270726    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270729    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270732    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270735    2565 flags.go:64] FLAG: --port="10250"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270738    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270741    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a134732e3ed4c19f"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270744    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270747    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270751    2565 flags.go:64] FLAG: --register-node="true"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270754    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270757    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270760    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270763    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270766    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270769    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270772    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270775    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270778    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270781    2565 flags.go:64] FLAG: --runonce="false"
Jul 09 00:55:15.278006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270784    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270788    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270791    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270794    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270797    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270799    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270803    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270806    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270809    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270811    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270814    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270817    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270820    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270823    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270826    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270832    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270834    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270837    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270845    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270848    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270850    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270853    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270856    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270859    2565 flags.go:64] FLAG: --v="2"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270863    2565 flags.go:64] FLAG: --version="false"
Jul 09 00:55:15.278631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270867    2565 flags.go:64] FLAG: --vmodule=""
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270871    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.270875    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270993    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270996    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.270999    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271001    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271004    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271007    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271009    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271012    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271015    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271018    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271020    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271023    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271025    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271028    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271030    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271033    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271036    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 00:55:15.279268 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271039    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271042    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271044    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271046    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271050    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271055    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271058    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271061    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271064    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271067    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271069    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271072    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271075    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271077    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271080    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271082    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271085    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271087    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271090    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271093    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 00:55:15.279743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271095    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271098    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271100    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271103    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271105    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271121    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271125    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271129    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271132    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271135    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271138    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271140    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271143    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271145    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271148    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271151    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271154    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271158    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271160    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 00:55:15.280233 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271163    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271167    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271170    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271173    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271176    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271178    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271181    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271183    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271186    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271189    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271192    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271194    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271197    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271200    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271203    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271220    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271223    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271226    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271229    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271232    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 00:55:15.280683 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271234    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271237    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271240    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271242    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271245    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271247    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271250    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271252    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271256    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271259    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271263    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271266    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271271    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271274    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271277    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271280    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271283    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271285    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271288    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 00:55:15.281181 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271290    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 00:55:15.281656 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271293    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 00:55:15.281656 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271296    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 00:55:15.281656 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.271298    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 00:55:15.281656 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.271999    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 00:55:15.281656 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.279822    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 09 00:55:15.281656 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.279842    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 00:55:15.281656 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.280754    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 00:55:15.281656 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.280764    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 00:55:15.281656 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280842    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 00:55:15.281656 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280849    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 00:55:15.281656 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280854    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 00:55:15.281656 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280859    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 00:55:15.281656 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280863    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 00:55:15.281656 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280869    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 00:55:15.281656 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280873    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280877    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280880    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280884    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280889    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280893    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280897    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280901    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280905    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280909    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280912    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280916    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280921    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280925    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280928    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280932    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280935    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280939    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280943    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280947    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 00:55:15.282042 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280950    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280954    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280958    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280964    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280968    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280972    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280976    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280980    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280983    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280988    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280993    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.280998    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281003    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281009    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281014    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281018    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281022    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281026    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281031    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 00:55:15.282528 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281036    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281040    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281045    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281048    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281053    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281057    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281061    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281066    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281070    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281074    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281079    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281083    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281086    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281090    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281094    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281099    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281102    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281107    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281111    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281115    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 00:55:15.283019 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281119    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281122    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281126    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281130    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281133    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281137    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281141    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281144    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281148    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281152    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281156    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281159    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281165    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281170    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281173    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281177    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281181    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281185    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281189    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 00:55:15.283802 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281193    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 00:55:15.284364 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281198    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 00:55:15.284364 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281202    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 00:55:15.284364 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281217    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 00:55:15.284364 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281222    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 00:55:15.284364 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281227    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 00:55:15.284364 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281231    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 00:55:15.284364 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281234    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 00:55:15.284364 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281238    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 00:55:15.284364 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281242    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 00:55:15.284364 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281246    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 00:55:15.284364 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281251    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 00:55:15.284364 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281254    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 00:55:15.284364 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281258    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 00:55:15.284364 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281262    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 00:55:15.284364 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.281269    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281429    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281438    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281443    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281447    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281451    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281456    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281460    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281464    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281468    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281472    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281479    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281484    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281488    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281492    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281495    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281499    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281502    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281506    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 00:55:15.284733 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281511    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281514    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281518    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281522    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281526    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281530    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281533    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281537    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281541    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281545    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281550    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281553    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281557    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281561    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281565    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281569    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281573    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281577    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281580    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 00:55:15.285193 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281584    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281588    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281592    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281596    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281599    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281603    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281606    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281610    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281614    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281617    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281621    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281624    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281628    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281633    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281636    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281640    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281644    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281648    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281652    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281656    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 00:55:15.285672 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281660    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281664    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281668    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281672    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281677    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281681    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281685    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281688    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281692    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281695    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281699    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281704    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281709    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281714    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281718    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281723    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281726    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281729    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281733    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 00:55:15.286175 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281737    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281740    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281744    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281749    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281753    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281756    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281760    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281764    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281768    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281772    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281775    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281779    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281782    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281788    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281793    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281797    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281801    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281805    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281809    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281813    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 00:55:15.286645 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281817    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 00:55:15.287118 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281821    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 00:55:15.287118 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:15.281824    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 00:55:15.287118 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.281830    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 00:55:15.287118 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.281983    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 00:55:15.287118 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.286917    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 00:55:15.288279 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.288266    2565 server.go:1019] "Starting client certificate rotation"
Jul 09 00:55:15.288386 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.288367    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 00:55:15.288416 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.288401    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 00:55:15.290912 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.290898    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 00:55:15.293845 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.293825    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 00:55:15.306363 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.306295    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 09 00:55:15.309241 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.309221    2565 log.go:25] "Validated CRI v1 image API"
Jul 09 00:55:15.310099 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.310082    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 00:55:15.312777 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.312754    2565 fs.go:135] Filesystem UUIDs: map[542b9081-ab24-44c4-876a-71cee9ade272:/dev/nvme0n1p4 759e2e09-1318-4fce-9099-bfc103591e9d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 09 00:55:15.312845 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.312775    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 00:55:15.316248 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.316231    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 00:55:15.319706 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.319316    2565 manager.go:216] Machine: {Timestamp:2026-07-09 00:55:15.317501256 +0000 UTC m=+0.380995954 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100875 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2790898a5da6933f4d66eb9c4d6ce0 SystemUUID:ec279089-8a5d-a693-3f4d-66eb9c4d6ce0 BootID:eca5a62c-a8cb-4833-975e-2c92f19b08c2 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:22:8e:59:f6:61 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:22:8e:59:f6:61 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:64:b8:98:a8:d8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 00:55:15.319706 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.319697    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 00:55:15.319854 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.319838    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 00:55:15.323605 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.323576    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 00:55:15.323784 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.323610    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-227.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 00:55:15.324974 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.324961    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 00:55:15.325015 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.324979    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 00:55:15.325015 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.324988    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 00:55:15.325457 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.325445    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 00:55:15.326715 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.326703    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 00:55:15.330034 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.330022    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 00:55:15.330179 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.330169    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 00:55:15.330227 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.330219    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 00:55:15.330257 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.330237    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 00:55:15.330257 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.330253    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 00:55:15.330337 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.330266    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 09 00:55:15.330337 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.330279    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 00:55:15.330761 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.330749    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 00:55:15.330800 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.330772    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 00:55:15.332926 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.332902    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 09 00:55:15.334954 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.334936    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 00:55:15.335049 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.334975    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 00:55:15.336255 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.336242    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 00:55:15.336322 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.336264    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 00:55:15.336322 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.336273    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 00:55:15.336322 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.336283    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 00:55:15.336322 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.336296    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 00:55:15.336322 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.336305    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 00:55:15.336322 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.336317    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 00:55:15.336322 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.336325    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 00:55:15.336545 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.336336    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 00:55:15.336545 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.336345    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 00:55:15.336545 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.336358    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 00:55:15.336545 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.336367    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 00:55:15.338172 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.338159    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 00:55:15.338247 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.338176    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 00:55:15.340837 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.340807    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 00:55:15.340837 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.340825    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-227.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 00:55:15.340837 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.340832    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-227.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 00:55:15.341572 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.341557    2565 server.go:1268] "Started kubelet"
Jul 09 00:55:15.341731 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.341669    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 00:55:15.341832 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.341817    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 00:55:15.342308 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.342286    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cmlx8"
Jul 09 00:55:15.342399 ip-10-0-134-227 systemd[1]: Started Kubernetes Kubelet.
Jul 09 00:55:15.342865 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.341913    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 00:55:15.343129 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.343099    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 00:55:15.344270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.344253    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 00:55:15.346616 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.346600    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cmlx8"
Jul 09 00:55:15.348237 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.348195    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 00:55:15.349058 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.347959    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-227.ec2.internal.18c079051f0b61ef  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-227.ec2.internal,UID:ip-10-0-134-227.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-227.ec2.internal,},FirstTimestamp:2026-07-09 00:55:15.341353455 +0000 UTC m=+0.404848151,LastTimestamp:2026-07-09 00:55:15.341353455 +0000 UTC m=+0.404848151,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-227.ec2.internal,}"
Jul 09 00:55:15.351284 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.351265    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 00:55:15.351284 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.351279    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 00:55:15.351436 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.351354    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-227.ec2.internal\" not found"
Jul 09 00:55:15.352785 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.352671    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 00:55:15.352906 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.352888    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 00:55:15.352988 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.352834    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 00:55:15.353072 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.353060    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 00:55:15.353117 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.353073    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 00:55:15.354015 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.353813    2565 factory.go:55] Registering systemd factory
Jul 09 00:55:15.354015 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.353834    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 09 00:55:15.354145 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.354076    2565 factory.go:153] Registering CRI-O factory
Jul 09 00:55:15.354145 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.354094    2565 factory.go:223] Registration of the crio container factory successfully
Jul 09 00:55:15.354258 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.354151    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 00:55:15.354258 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.354174    2565 factory.go:103] Registering Raw factory
Jul 09 00:55:15.354258 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.354189    2565 manager.go:1196] Started watching for new ooms in manager
Jul 09 00:55:15.354694 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.354678    2565 manager.go:349] Starting recovery of all containers
Jul 09 00:55:15.357247 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.357227    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 00:55:15.360374 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.360350    2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-227.ec2.internal\" not found" node="ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.366240 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.366202    2565 manager.go:354] Recovery completed
Jul 09 00:55:15.370352 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.370337    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 00:55:15.372317 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.372301    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 00:55:15.372382 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.372333    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 00:55:15.372382 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.372347    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasSufficientPID"
Jul 09 00:55:15.372895 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.372879    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 00:55:15.372895 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.372894    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 00:55:15.372994 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.372911    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 00:55:15.372994 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.372885    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 00:55:15.373716 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.373702    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 00:55:15.373765 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.373733    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 00:55:15.373765 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.373747    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasSufficientPID"
Jul 09 00:55:15.374638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.374627    2565 policy_none.go:49] "None policy: Start"
Jul 09 00:55:15.374670 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.374642    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 00:55:15.374670 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.374652    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 00:55:15.375940 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.375930    2565 policy_none.go:47] "Start"
Jul 09 00:55:15.445734 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.439791    2565 manager.go:337] "Starting Device Plugin manager"
Jul 09 00:55:15.445734 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.439871    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 00:55:15.445734 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.439882    2565 server.go:87] "Starting device plugin registration server"
Jul 09 00:55:15.445734 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.440111    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 00:55:15.445734 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.440121    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 00:55:15.445734 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.440245    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 00:55:15.445734 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.440324    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 00:55:15.445734 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.440333    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 00:55:15.445734 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.440839    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 00:55:15.445734 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.440878    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-227.ec2.internal\" not found"
Jul 09 00:55:15.498071 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.498028    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 00:55:15.499260 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.499236    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 00:55:15.499383 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.499270    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 00:55:15.499383 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.499293    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 00:55:15.499383 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.499329    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 00:55:15.501430 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.501410    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 00:55:15.540274 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.540232    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 00:55:15.541230 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.541200    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 00:55:15.541301 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.541247    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 00:55:15.541301 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.541259    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasSufficientPID"
Jul 09 00:55:15.541301 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.541282    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.552218 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.552195    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.552327 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.552231    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-227.ec2.internal\": node \"ip-10-0-134-227.ec2.internal\" not found"
Jul 09 00:55:15.567259 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.567192    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-227.ec2.internal\" not found"
Jul 09 00:55:15.600178 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.600145    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-227.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal"]
Jul 09 00:55:15.600313 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.600247    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 00:55:15.601684 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.601666    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 00:55:15.601762 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.601698    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 00:55:15.601762 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.601709    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasSufficientPID"
Jul 09 00:55:15.603311 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.603299    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 00:55:15.603402 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.603387    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.603460 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.603415    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 00:55:15.604048 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.604036    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 00:55:15.604126 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.604057    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 00:55:15.604126 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.604071    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasSufficientPID"
Jul 09 00:55:15.604126 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.604074    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 00:55:15.604126 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.604099    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 00:55:15.604126 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.604112    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasSufficientPID"
Jul 09 00:55:15.605385 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.605369    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.605467 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.605410    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 00:55:15.606124 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.606110    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 00:55:15.606185 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.606137    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 00:55:15.606185 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.606152    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeHasSufficientPID"
Jul 09 00:55:15.641084 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.641055    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-227.ec2.internal\" not found" node="ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.644542 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.644526    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-227.ec2.internal\" not found" node="ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.654855 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.654826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/909e8761eb0f31e787ea2b2e42e45455-config\") pod \"kube-apiserver-proxy-ip-10-0-134-227.ec2.internal\" (UID: \"909e8761eb0f31e787ea2b2e42e45455\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.654929 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.654881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f4b8195244e25b3b7060ea95d758498-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal\" (UID: \"4f4b8195244e25b3b7060ea95d758498\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.654964 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.654927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f4b8195244e25b3b7060ea95d758498-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal\" (UID: \"4f4b8195244e25b3b7060ea95d758498\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.667874 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.667837    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-227.ec2.internal\" not found"
Jul 09 00:55:15.755636 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.755600    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/909e8761eb0f31e787ea2b2e42e45455-config\") pod \"kube-apiserver-proxy-ip-10-0-134-227.ec2.internal\" (UID: \"909e8761eb0f31e787ea2b2e42e45455\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.755636 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.755633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f4b8195244e25b3b7060ea95d758498-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal\" (UID: \"4f4b8195244e25b3b7060ea95d758498\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.755776 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.755652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f4b8195244e25b3b7060ea95d758498-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal\" (UID: \"4f4b8195244e25b3b7060ea95d758498\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.755776 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.755696    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f4b8195244e25b3b7060ea95d758498-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal\" (UID: \"4f4b8195244e25b3b7060ea95d758498\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.755776 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.755704    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f4b8195244e25b3b7060ea95d758498-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal\" (UID: \"4f4b8195244e25b3b7060ea95d758498\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.755776 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.755739    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/909e8761eb0f31e787ea2b2e42e45455-config\") pod \"kube-apiserver-proxy-ip-10-0-134-227.ec2.internal\" (UID: \"909e8761eb0f31e787ea2b2e42e45455\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.768770 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.768745    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-227.ec2.internal\" not found"
Jul 09 00:55:15.869159 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.869082    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-227.ec2.internal\" not found"
Jul 09 00:55:15.949015 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.948968    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.949015 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:15.949016    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal"
Jul 09 00:55:15.970242 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:15.970196    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-227.ec2.internal\" not found"
Jul 09 00:55:16.071396 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:16.071362    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-227.ec2.internal\" not found"
Jul 09 00:55:16.171965 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:16.171901    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-227.ec2.internal\" not found"
Jul 09 00:55:16.272862 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:16.272835    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-227.ec2.internal\" not found"
Jul 09 00:55:16.287527 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:16.287483    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 00:55:16.287670 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:16.287649    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 00:55:16.287715 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:16.287693    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 00:55:16.351780 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:16.351720    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 00:50:16 +0000 UTC" deadline="2028-03-10 14:02:13.566739117 +0000 UTC"
Jul 09 00:55:16.351780 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:16.351771    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14653h6m57.214973024s"
Jul 09 00:55:16.373067 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:16.373031    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-227.ec2.internal\" not found"
Jul 09 00:55:16.473398 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:16.473324    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-227.ec2.internal\" not found"
Jul 09 00:55:16.540818 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:16.540792    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 00:55:16.552589 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:16.552564    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-227.ec2.internal"
Jul 09 00:55:16.562335 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:16.562312    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 00:55:16.564322 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:16.564304    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal"
Jul 09 00:55:16.574719 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:16.574701    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 00:55:16.599882 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:16.599845    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f4b8195244e25b3b7060ea95d758498.slice/crio-033a39a396e3e2e6d487d1a3b9b66c53695e82111647d5e35761c7187972c391 WatchSource:0}: Error finding container 033a39a396e3e2e6d487d1a3b9b66c53695e82111647d5e35761c7187972c391: Status 404 returned error can't find the container with id 033a39a396e3e2e6d487d1a3b9b66c53695e82111647d5e35761c7187972c391
Jul 09 00:55:16.600272 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:16.600249    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod909e8761eb0f31e787ea2b2e42e45455.slice/crio-3e77a69e629512682f69cc5df3be4c0b678a68c7e31a1261c1bc19ba3ca65802 WatchSource:0}: Error finding container 3e77a69e629512682f69cc5df3be4c0b678a68c7e31a1261c1bc19ba3ca65802: Status 404 returned error can't find the container with id 3e77a69e629512682f69cc5df3be4c0b678a68c7e31a1261c1bc19ba3ca65802
Jul 09 00:55:16.605837 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:16.605820    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 00:55:16.899517 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:16.899475    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 00:55:17.315204 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.315169    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 00:55:17.330800 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.330770    2565 apiserver.go:52] "Watching apiserver"
Jul 09 00:55:17.337409 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.337382    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 00:55:17.342962 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.342927    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal","openshift-multus/multus-additional-cni-plugins-djxlj","openshift-multus/network-metrics-daemon-6jcwt","openshift-network-operator/iptables-alerter-29lhn","openshift-ovn-kubernetes/ovnkube-node-nn6t5","kube-system/global-pull-secret-syncer-8vx5f","kube-system/konnectivity-agent-dfn4c","kube-system/kube-apiserver-proxy-ip-10-0-134-227.ec2.internal","openshift-cluster-node-tuning-operator/tuned-2fv6j","openshift-dns/node-resolver-9qh2x","openshift-image-registry/node-ca-99x8l","openshift-multus/multus-bxgnp","openshift-network-diagnostics/network-check-target-bbw2n","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"]
Jul 09 00:55:17.344999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.344975    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dfn4c"
Jul 09 00:55:17.346217 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.346199    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:17.346352 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:17.346294    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:17.347737 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.347713    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 00:55:17.347836 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.347734    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ccsk5\""
Jul 09 00:55:17.347836 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.347734    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 00:55:17.348104 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.348078    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:17.348259 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:17.348181    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:17.351665 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.351588    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-29lhn"
Jul 09 00:55:17.352031 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.351909    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 00:55:17.353171 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.353130    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.353967 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.353913    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t6w65\""
Jul 09 00:55:17.354045 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.353977    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 00:55:17.354255 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.354238    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 00:55:17.354408 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.354244    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 00:55:17.355452 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.355364    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:17.355452 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:17.355429    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:17.355579 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.355528    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 00:55:17.355639 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.355581    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 00:55:17.356322 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.355911    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 00:55:17.356322 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.355918    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 00:55:17.356322 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.356245    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bp4xs\""
Jul 09 00:55:17.356322 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.356247    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 00:55:17.356686 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.356666    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 00:55:17.357179 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.357159    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.359553 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.359533    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v6tkk\""
Jul 09 00:55:17.359658 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.359564    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 00:55:17.359658 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.359583    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 00:55:17.359815 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.359795    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.361494 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.361477    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.361759 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.361700    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 00:55:17.362030 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.362011    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 00:55:17.362261 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.362202    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 00:55:17.362351 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.362215    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-28wfm\""
Jul 09 00:55:17.363616 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.363598    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 00:55:17.363829 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.363666    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9qh2x"
Jul 09 00:55:17.364005 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.363988    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 00:55:17.364083 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.364052    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s29xf\""
Jul 09 00:55:17.364268 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.364183    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 00:55:17.364479 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.364410    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 00:55:17.364479 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.364471    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 00:55:17.365664 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.365645    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-99x8l"
Jul 09 00:55:17.365999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.365974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ff2d724-96a5-41c8-a106-b8524a6aa862-host-slash\") pod \"iptables-alerter-29lhn\" (UID: \"0ff2d724-96a5-41c8-a106-b8524a6aa862\") " pod="openshift-network-operator/iptables-alerter-29lhn"
Jul 09 00:55:17.366088 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-run-netns\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.366088 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366037    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-cni-bin\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.366088 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret\") pod \"global-pull-secret-syncer-8vx5f\" (UID: \"93c25998-c800-4bf5-90cb-173986d24386\") " pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:17.366259 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8glnr\" (UniqueName: \"kubernetes.io/projected/0c3cdb55-354c-454f-b498-64c2a1a329ee-kube-api-access-8glnr\") pod \"network-metrics-daemon-6jcwt\" (UID: \"0c3cdb55-354c-454f-b498-64c2a1a329ee\") " pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:17.366259 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-etc-openvswitch\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.366259 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-node-log\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.366259 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366190    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28c40a0a-d72b-423d-9c3a-dc332c68fa80-ovnkube-script-lib\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.366259 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366254    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/93c25998-c800-4bf5-90cb-173986d24386-dbus\") pod \"global-pull-secret-syncer-8vx5f\" (UID: \"93c25998-c800-4bf5-90cb-173986d24386\") " pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:17.366550 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk7tx\" (UniqueName: \"kubernetes.io/projected/0ff2d724-96a5-41c8-a106-b8524a6aa862-kube-api-access-xk7tx\") pod \"iptables-alerter-29lhn\" (UID: \"0ff2d724-96a5-41c8-a106-b8524a6aa862\") " pod="openshift-network-operator/iptables-alerter-29lhn"
Jul 09 00:55:17.366550 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366349    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-kubelet\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.366550 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366379    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-slash\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.366550 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366412    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.366550 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdc6n\" (UniqueName: \"kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n\") pod \"network-check-target-bbw2n\" (UID: \"4544db24-d746-4f38-896b-bdda644ee5ce\") " pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:17.366550 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs\") pod \"network-metrics-daemon-6jcwt\" (UID: \"0c3cdb55-354c-454f-b498-64c2a1a329ee\") " pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:17.366550 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-run-systemd\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.366901 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-var-lib-openvswitch\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.366901 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366580    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 00:55:17.366901 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366589    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb1420ad-db26-449b-8975-78ee8f8b94b8-konnectivity-ca\") pod \"konnectivity-agent-dfn4c\" (UID: \"eb1420ad-db26-449b-8975-78ee8f8b94b8\") " pod="kube-system/konnectivity-agent-dfn4c"
Jul 09 00:55:17.366901 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-systemd-units\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.366901 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28c40a0a-d72b-423d-9c3a-dc332c68fa80-ovn-node-metrics-cert\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.366901 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ff2d724-96a5-41c8-a106-b8524a6aa862-iptables-alerter-script\") pod \"iptables-alerter-29lhn\" (UID: \"0ff2d724-96a5-41c8-a106-b8524a6aa862\") " pod="openshift-network-operator/iptables-alerter-29lhn"
Jul 09 00:55:17.366901 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366590    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 00:55:17.366901 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-run-openvswitch\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.366901 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-run-ovn\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.366901 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366803    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-log-socket\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.366901 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-cni-netd\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.366901 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366837    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wksbq\""
Jul 09 00:55:17.366901 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366854    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28c40a0a-d72b-423d-9c3a-dc332c68fa80-env-overrides\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.366901 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-run-ovn-kubernetes\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.367563 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366941    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/93c25998-c800-4bf5-90cb-173986d24386-kubelet-config\") pod \"global-pull-secret-syncer-8vx5f\" (UID: \"93c25998-c800-4bf5-90cb-173986d24386\") " pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:17.367563 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366985    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 00:55:17.367563 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.366989    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb1420ad-db26-449b-8975-78ee8f8b94b8-agent-certs\") pod \"konnectivity-agent-dfn4c\" (UID: \"eb1420ad-db26-449b-8975-78ee8f8b94b8\") " pod="kube-system/konnectivity-agent-dfn4c"
Jul 09 00:55:17.367563 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.367049    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28c40a0a-d72b-423d-9c3a-dc332c68fa80-ovnkube-config\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.367563 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.367091    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8pq7\" (UniqueName: \"kubernetes.io/projected/28c40a0a-d72b-423d-9c3a-dc332c68fa80-kube-api-access-n8pq7\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.367563 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.367478    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.367916 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.367899    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 00:55:17.367916 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.367914    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 00:55:17.368105 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.368087    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 00:55:17.368171 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.368152    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v9fsd\""
Jul 09 00:55:17.369576 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.369555    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 00:55:17.369659 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.369586    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hk7z7\""
Jul 09 00:55:17.385034 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.385008    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x48fc"
Jul 09 00:55:17.392181 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.392155    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x48fc"
Jul 09 00:55:17.454232 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.454186    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 00:55:17.467902 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.467869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdc6n\" (UniqueName: \"kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n\") pod \"network-check-target-bbw2n\" (UID: \"4544db24-d746-4f38-896b-bdda644ee5ce\") " pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:17.467902 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.467912    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs\") pod \"network-metrics-daemon-6jcwt\" (UID: \"0c3cdb55-354c-454f-b498-64c2a1a329ee\") " pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:17.468132 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.467941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-var-lib-openvswitch\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.468132 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.467971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1252da54-e942-4e80-97c4-d34b84841d1a-tmp-dir\") pod \"node-resolver-9qh2x\" (UID: \"1252da54-e942-4e80-97c4-d34b84841d1a\") " pod="openshift-dns/node-resolver-9qh2x"
Jul 09 00:55:17.468132 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.467997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11109ade-c94b-4ae7-8f23-bad58d31cadb-os-release\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.468132 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468024    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb1420ad-db26-449b-8975-78ee8f8b94b8-konnectivity-ca\") pod \"konnectivity-agent-dfn4c\" (UID: \"eb1420ad-db26-449b-8975-78ee8f8b94b8\") " pod="kube-system/konnectivity-agent-dfn4c"
Jul 09 00:55:17.468132 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ff2d724-96a5-41c8-a106-b8524a6aa862-iptables-alerter-script\") pod \"iptables-alerter-29lhn\" (UID: \"0ff2d724-96a5-41c8-a106-b8524a6aa862\") " pod="openshift-network-operator/iptables-alerter-29lhn"
Jul 09 00:55:17.468132 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:17.468070    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:17.468132 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468121    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-run-openvswitch\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.468551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468172    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-var-lib-openvswitch\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.468551 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:17.468182    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs podName:0c3cdb55-354c-454f-b498-64c2a1a329ee nodeName:}" failed. No retries permitted until 2026-07-09 00:55:17.96812801 +0000 UTC m=+3.031622710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs") pod "network-metrics-daemon-6jcwt" (UID: "0c3cdb55-354c-454f-b498-64c2a1a329ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:17.468551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-run-openvswitch\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.468551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-run-ovn\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.468551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468260    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-log-socket\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.468551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-cni-netd\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.468551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-modprobe-d\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.468551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8rk8\" (UniqueName: \"kubernetes.io/projected/1252da54-e942-4e80-97c4-d34b84841d1a-kube-api-access-r8rk8\") pod \"node-resolver-9qh2x\" (UID: \"1252da54-e942-4e80-97c4-d34b84841d1a\") " pod="openshift-dns/node-resolver-9qh2x"
Jul 09 00:55:17.468551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5daf2603-bdab-405e-a733-a9ec1b51ab68-serviceca\") pod \"node-ca-99x8l\" (UID: \"5daf2603-bdab-405e-a733-a9ec1b51ab68\") " pod="openshift-image-registry/node-ca-99x8l"
Jul 09 00:55:17.468551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468430    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-cni-netd\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.468551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/93c25998-c800-4bf5-90cb-173986d24386-kubelet-config\") pod \"global-pull-secret-syncer-8vx5f\" (UID: \"93c25998-c800-4bf5-90cb-173986d24386\") " pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:17.468551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468483    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-etc-selinux\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.468551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468514    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11109ade-c94b-4ae7-8f23-bad58d31cadb-system-cni-dir\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.468551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468543    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11109ade-c94b-4ae7-8f23-bad58d31cadb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.468551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468485    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-run-ovn\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.468551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-cnibin\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.469508 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-etc-kubernetes\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.469508 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468599    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fpdh\" (UniqueName: \"kubernetes.io/projected/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-kube-api-access-9fpdh\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.469508 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468609    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/93c25998-c800-4bf5-90cb-173986d24386-kubelet-config\") pod \"global-pull-secret-syncer-8vx5f\" (UID: \"93c25998-c800-4bf5-90cb-173986d24386\") " pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:17.469508 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468617    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28c40a0a-d72b-423d-9c3a-dc332c68fa80-ovnkube-config\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.469508 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-run\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.469508 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468658    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-hostroot\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.469508 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468692    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-socket-dir\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.469508 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ff2d724-96a5-41c8-a106-b8524a6aa862-host-slash\") pod \"iptables-alerter-29lhn\" (UID: \"0ff2d724-96a5-41c8-a106-b8524a6aa862\") " pod="openshift-network-operator/iptables-alerter-29lhn"
Jul 09 00:55:17.469508 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-cni-bin\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.469508 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret\") pod \"global-pull-secret-syncer-8vx5f\" (UID: \"93c25998-c800-4bf5-90cb-173986d24386\") " pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:17.469508 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468800    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-sysconfig\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.469508 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-tmp\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.469508 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468849    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11109ade-c94b-4ae7-8f23-bad58d31cadb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.469508 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468861    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb1420ad-db26-449b-8975-78ee8f8b94b8-konnectivity-ca\") pod \"konnectivity-agent-dfn4c\" (UID: \"eb1420ad-db26-449b-8975-78ee8f8b94b8\") " pod="kube-system/konnectivity-agent-dfn4c"
Jul 09 00:55:17.469508 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-run-netns\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.469508 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468518    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-log-socket\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.469508 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468929    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8glnr\" (UniqueName: \"kubernetes.io/projected/0c3cdb55-354c-454f-b498-64c2a1a329ee-kube-api-access-8glnr\") pod \"network-metrics-daemon-6jcwt\" (UID: \"0c3cdb55-354c-454f-b498-64c2a1a329ee\") " pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:17.470429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468950    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ff2d724-96a5-41c8-a106-b8524a6aa862-iptables-alerter-script\") pod \"iptables-alerter-29lhn\" (UID: \"0ff2d724-96a5-41c8-a106-b8524a6aa862\") " pod="openshift-network-operator/iptables-alerter-29lhn"
Jul 09 00:55:17.470429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468967    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-cni-bin\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.470429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.468959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-etc-openvswitch\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.470429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469005    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-systemd\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.470429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469004    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ff2d724-96a5-41c8-a106-b8524a6aa862-host-slash\") pod \"iptables-alerter-29lhn\" (UID: \"0ff2d724-96a5-41c8-a106-b8524a6aa862\") " pod="openshift-network-operator/iptables-alerter-29lhn"
Jul 09 00:55:17.470429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469036    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-etc-openvswitch\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.470429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469074    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-host\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.470429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11109ade-c94b-4ae7-8f23-bad58d31cadb-cni-binary-copy\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.470429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469076    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28c40a0a-d72b-423d-9c3a-dc332c68fa80-ovnkube-config\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.470429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469143    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-multus-cni-dir\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.470429 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:17.469187    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:17.470429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-var-lib-kubelet\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.470429 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:17.469234    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret podName:93c25998-c800-4bf5-90cb-173986d24386 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:17.96921983 +0000 UTC m=+3.032714515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret") pod "global-pull-secret-syncer-8vx5f" (UID: "93c25998-c800-4bf5-90cb-173986d24386") : object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:17.470429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-kubelet\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.470429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469313    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-slash\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.470429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469336    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-kubelet\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.470429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469340    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-sys\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.471270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469372    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-registration-dir\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.471270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469378    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-slash\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.471270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469401    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11109ade-c94b-4ae7-8f23-bad58d31cadb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.471270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-multus-conf-dir\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.471270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-run-systemd\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.471270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.471270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469507    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-run-systemd\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.471270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469521    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-run-k8s-cni-cncf-io\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.471270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469555    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-run-multus-certs\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.471270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-systemd-units\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.471270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469609    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28c40a0a-d72b-423d-9c3a-dc332c68fa80-ovn-node-metrics-cert\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.471270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-kubernetes\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.471270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-sysctl-d\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.471270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469663    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-systemd-units\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.471270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469687    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-tuned\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.471270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11109ade-c94b-4ae7-8f23-bad58d31cadb-cnibin\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.471270 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469752    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-os-release\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.472135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-var-lib-cni-multus\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.472135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469785    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28c40a0a-d72b-423d-9c3a-dc332c68fa80-env-overrides\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.472135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-run-ovn-kubernetes\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.472135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469817    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1252da54-e942-4e80-97c4-d34b84841d1a-hosts-file\") pod \"node-resolver-9qh2x\" (UID: \"1252da54-e942-4e80-97c4-d34b84841d1a\") " pod="openshift-dns/node-resolver-9qh2x"
Jul 09 00:55:17.472135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-device-dir\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.472135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469848    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-sys-fs\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.472135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469862    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-var-lib-cni-bin\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.472135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb1420ad-db26-449b-8975-78ee8f8b94b8-agent-certs\") pod \"konnectivity-agent-dfn4c\" (UID: \"eb1420ad-db26-449b-8975-78ee8f8b94b8\") " pod="kube-system/konnectivity-agent-dfn4c"
Jul 09 00:55:17.472135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469913    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8pq7\" (UniqueName: \"kubernetes.io/projected/28c40a0a-d72b-423d-9c3a-dc332c68fa80-kube-api-access-n8pq7\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.472135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469930    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6gqz\" (UniqueName: \"kubernetes.io/projected/11109ade-c94b-4ae7-8f23-bad58d31cadb-kube-api-access-j6gqz\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.472135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-run-netns\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.472135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469976    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-lib-modules\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.472135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469979    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 00:55:17.472135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.469993    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-var-lib-kubelet\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.472135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.470017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcgth\" (UniqueName: \"kubernetes.io/projected/5daf2603-bdab-405e-a733-a9ec1b51ab68-kube-api-access-jcgth\") pod \"node-ca-99x8l\" (UID: \"5daf2603-bdab-405e-a733-a9ec1b51ab68\") " pod="openshift-image-registry/node-ca-99x8l"
Jul 09 00:55:17.472135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.470033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-cni-binary-copy\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.472135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.470050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-node-log\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.472999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.470067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28c40a0a-d72b-423d-9c3a-dc332c68fa80-ovnkube-script-lib\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.472999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.470086    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/93c25998-c800-4bf5-90cb-173986d24386-dbus\") pod \"global-pull-secret-syncer-8vx5f\" (UID: \"93c25998-c800-4bf5-90cb-173986d24386\") " pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:17.472999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.470109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlwfl\" (UniqueName: \"kubernetes.io/projected/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-kube-api-access-rlwfl\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.472999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.470126    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-multus-socket-dir-parent\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.472999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.470141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk7tx\" (UniqueName: \"kubernetes.io/projected/0ff2d724-96a5-41c8-a106-b8524a6aa862-kube-api-access-xk7tx\") pod \"iptables-alerter-29lhn\" (UID: \"0ff2d724-96a5-41c8-a106-b8524a6aa862\") " pod="openshift-network-operator/iptables-alerter-29lhn"
Jul 09 00:55:17.472999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.470171    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.472999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.470188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-sysctl-conf\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.472999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.470205    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5daf2603-bdab-405e-a733-a9ec1b51ab68-host\") pod \"node-ca-99x8l\" (UID: \"5daf2603-bdab-405e-a733-a9ec1b51ab68\") " pod="openshift-image-registry/node-ca-99x8l"
Jul 09 00:55:17.472999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.470221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ffm5\" (UniqueName: \"kubernetes.io/projected/816c2c96-76ef-4fdd-8f63-eb6cd0508322-kube-api-access-7ffm5\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.472999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.470236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-system-cni-dir\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.472999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.470251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-multus-daemon-config\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.472999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.470622    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-run-ovn-kubernetes\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.472999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.470657    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28c40a0a-d72b-423d-9c3a-dc332c68fa80-env-overrides\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.472999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.470793    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-node-log\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.472999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.471244    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28c40a0a-d72b-423d-9c3a-dc332c68fa80-ovnkube-script-lib\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.472999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.471442    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/93c25998-c800-4bf5-90cb-173986d24386-dbus\") pod \"global-pull-secret-syncer-8vx5f\" (UID: \"93c25998-c800-4bf5-90cb-173986d24386\") " pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:17.472999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.471665    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.474005 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.471716    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28c40a0a-d72b-423d-9c3a-dc332c68fa80-host-run-netns\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.475186 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.474750    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28c40a0a-d72b-423d-9c3a-dc332c68fa80-ovn-node-metrics-cert\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.475186 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.475153    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb1420ad-db26-449b-8975-78ee8f8b94b8-agent-certs\") pod \"konnectivity-agent-dfn4c\" (UID: \"eb1420ad-db26-449b-8975-78ee8f8b94b8\") " pod="kube-system/konnectivity-agent-dfn4c"
Jul 09 00:55:17.480220 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:17.480198    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 00:55:17.480403 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:17.480227    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 00:55:17.480403 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:17.480243    2565 projected.go:196] Error preparing data for projected volume kube-api-access-vdc6n for pod openshift-network-diagnostics/network-check-target-bbw2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:17.480403 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:17.480320    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n podName:4544db24-d746-4f38-896b-bdda644ee5ce nodeName:}" failed. No retries permitted until 2026-07-09 00:55:17.980301968 +0000 UTC m=+3.043796667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vdc6n" (UniqueName: "kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n") pod "network-check-target-bbw2n" (UID: "4544db24-d746-4f38-896b-bdda644ee5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:17.484040 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.484012    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8pq7\" (UniqueName: \"kubernetes.io/projected/28c40a0a-d72b-423d-9c3a-dc332c68fa80-kube-api-access-n8pq7\") pod \"ovnkube-node-nn6t5\" (UID: \"28c40a0a-d72b-423d-9c3a-dc332c68fa80\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.485495 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.485464    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk7tx\" (UniqueName: \"kubernetes.io/projected/0ff2d724-96a5-41c8-a106-b8524a6aa862-kube-api-access-xk7tx\") pod \"iptables-alerter-29lhn\" (UID: \"0ff2d724-96a5-41c8-a106-b8524a6aa862\") " pod="openshift-network-operator/iptables-alerter-29lhn"
Jul 09 00:55:17.485600 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.485530    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8glnr\" (UniqueName: \"kubernetes.io/projected/0c3cdb55-354c-454f-b498-64c2a1a329ee-kube-api-access-8glnr\") pod \"network-metrics-daemon-6jcwt\" (UID: \"0c3cdb55-354c-454f-b498-64c2a1a329ee\") " pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:17.504651 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.504586    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-227.ec2.internal" event={"ID":"909e8761eb0f31e787ea2b2e42e45455","Type":"ContainerStarted","Data":"3e77a69e629512682f69cc5df3be4c0b678a68c7e31a1261c1bc19ba3ca65802"}
Jul 09 00:55:17.505906 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.505874    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal" event={"ID":"4f4b8195244e25b3b7060ea95d758498","Type":"ContainerStarted","Data":"033a39a396e3e2e6d487d1a3b9b66c53695e82111647d5e35761c7187972c391"}
Jul 09 00:55:17.571564 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-modprobe-d\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.571564 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8rk8\" (UniqueName: \"kubernetes.io/projected/1252da54-e942-4e80-97c4-d34b84841d1a-kube-api-access-r8rk8\") pod \"node-resolver-9qh2x\" (UID: \"1252da54-e942-4e80-97c4-d34b84841d1a\") " pod="openshift-dns/node-resolver-9qh2x"
Jul 09 00:55:17.571564 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571547    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5daf2603-bdab-405e-a733-a9ec1b51ab68-serviceca\") pod \"node-ca-99x8l\" (UID: \"5daf2603-bdab-405e-a733-a9ec1b51ab68\") " pod="openshift-image-registry/node-ca-99x8l"
Jul 09 00:55:17.571839 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-etc-selinux\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.571839 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11109ade-c94b-4ae7-8f23-bad58d31cadb-system-cni-dir\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.571839 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571618    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11109ade-c94b-4ae7-8f23-bad58d31cadb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.571839 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571665    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-modprobe-d\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.571839 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571718    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-etc-selinux\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.571839 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571731    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11109ade-c94b-4ae7-8f23-bad58d31cadb-system-cni-dir\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.571839 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571759    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-cnibin\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.571839 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571784    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-etc-kubernetes\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.571839 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fpdh\" (UniqueName: \"kubernetes.io/projected/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-kube-api-access-9fpdh\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.571839 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571829    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-run\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571847    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-etc-kubernetes\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-hostroot\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571861    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-cnibin\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-socket-dir\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571932    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-run\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571980    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-hostroot\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.571935    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-sysconfig\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-tmp\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572044    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-socket-dir\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11109ade-c94b-4ae7-8f23-bad58d31cadb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-run-netns\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572097    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-sysconfig\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-systemd\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572138    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-host\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11109ade-c94b-4ae7-8f23-bad58d31cadb-cni-binary-copy\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-multus-cni-dir\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572210    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-systemd\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.572375 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-var-lib-kubelet\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.573271 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572232    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11109ade-c94b-4ae7-8f23-bad58d31cadb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.573271 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572259    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-var-lib-kubelet\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.573271 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572162    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5daf2603-bdab-405e-a733-a9ec1b51ab68-serviceca\") pod \"node-ca-99x8l\" (UID: \"5daf2603-bdab-405e-a733-a9ec1b51ab68\") " pod="openshift-image-registry/node-ca-99x8l"
Jul 09 00:55:17.573271 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572319    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-run-netns\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.573271 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572278    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-sys\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.573271 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572341    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11109ade-c94b-4ae7-8f23-bad58d31cadb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.573271 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-registration-dir\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.573271 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11109ade-c94b-4ae7-8f23-bad58d31cadb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.573271 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572395    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-multus-cni-dir\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.573271 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572413    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-multus-conf-dir\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.573271 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572422    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-host\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.573271 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.573271 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572451    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-registration-dir\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.573271 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-run-k8s-cni-cncf-io\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.573271 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572476    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-multus-conf-dir\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.573271 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-run-multus-certs\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.573271 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572508    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.574163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572527    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-run-k8s-cni-cncf-io\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.574163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-kubernetes\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.574163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572553    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-run-multus-certs\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.574163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-sysctl-d\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.574163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572576    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-kubernetes\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.574163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-tuned\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.574163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572626    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11109ade-c94b-4ae7-8f23-bad58d31cadb-cnibin\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.574163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-os-release\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.574163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-var-lib-cni-multus\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.574163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572704    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-sysctl-d\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.574163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572707    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1252da54-e942-4e80-97c4-d34b84841d1a-hosts-file\") pod \"node-resolver-9qh2x\" (UID: \"1252da54-e942-4e80-97c4-d34b84841d1a\") " pod="openshift-dns/node-resolver-9qh2x"
Jul 09 00:55:17.574163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572749    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1252da54-e942-4e80-97c4-d34b84841d1a-hosts-file\") pod \"node-resolver-9qh2x\" (UID: \"1252da54-e942-4e80-97c4-d34b84841d1a\") " pod="openshift-dns/node-resolver-9qh2x"
Jul 09 00:55:17.574163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572752    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-device-dir\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.574163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572784    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-sys-fs\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.574163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572793    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-device-dir\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.574163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572809    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-var-lib-cni-bin\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.574163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6gqz\" (UniqueName: \"kubernetes.io/projected/11109ade-c94b-4ae7-8f23-bad58d31cadb-kube-api-access-j6gqz\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-lib-modules\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572602    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-sys\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-var-lib-kubelet\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572924    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11109ade-c94b-4ae7-8f23-bad58d31cadb-cnibin\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcgth\" (UniqueName: \"kubernetes.io/projected/5daf2603-bdab-405e-a733-a9ec1b51ab68-kube-api-access-jcgth\") pod \"node-ca-99x8l\" (UID: \"5daf2603-bdab-405e-a733-a9ec1b51ab68\") " pod="openshift-image-registry/node-ca-99x8l"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572861    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-os-release\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572949    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11109ade-c94b-4ae7-8f23-bad58d31cadb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.572988    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-cni-binary-copy\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlwfl\" (UniqueName: \"kubernetes.io/projected/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-kube-api-access-rlwfl\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-multus-socket-dir-parent\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573054    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-lib-modules\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573073    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-sysctl-conf\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573217    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-sysctl-conf\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573246    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-var-lib-cni-multus\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573275    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-multus-socket-dir-parent\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573326    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/816c2c96-76ef-4fdd-8f63-eb6cd0508322-sys-fs\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573344    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-var-lib-kubelet\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.575042 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573344    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-host-var-lib-cni-bin\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.575844 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5daf2603-bdab-405e-a733-a9ec1b51ab68-host\") pod \"node-ca-99x8l\" (UID: \"5daf2603-bdab-405e-a733-a9ec1b51ab68\") " pod="openshift-image-registry/node-ca-99x8l"
Jul 09 00:55:17.575844 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573422    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11109ade-c94b-4ae7-8f23-bad58d31cadb-cni-binary-copy\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.575844 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ffm5\" (UniqueName: \"kubernetes.io/projected/816c2c96-76ef-4fdd-8f63-eb6cd0508322-kube-api-access-7ffm5\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.575844 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-system-cni-dir\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.575844 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573496    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5daf2603-bdab-405e-a733-a9ec1b51ab68-host\") pod \"node-ca-99x8l\" (UID: \"5daf2603-bdab-405e-a733-a9ec1b51ab68\") " pod="openshift-image-registry/node-ca-99x8l"
Jul 09 00:55:17.575844 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-multus-daemon-config\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.575844 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573571    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-system-cni-dir\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.575844 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1252da54-e942-4e80-97c4-d34b84841d1a-tmp-dir\") pod \"node-resolver-9qh2x\" (UID: \"1252da54-e942-4e80-97c4-d34b84841d1a\") " pod="openshift-dns/node-resolver-9qh2x"
Jul 09 00:55:17.575844 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11109ade-c94b-4ae7-8f23-bad58d31cadb-os-release\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.575844 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573701    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-cni-binary-copy\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.575844 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573741    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11109ade-c94b-4ae7-8f23-bad58d31cadb-os-release\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.575844 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.573976    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1252da54-e942-4e80-97c4-d34b84841d1a-tmp-dir\") pod \"node-resolver-9qh2x\" (UID: \"1252da54-e942-4e80-97c4-d34b84841d1a\") " pod="openshift-dns/node-resolver-9qh2x"
Jul 09 00:55:17.575844 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.574075    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-multus-daemon-config\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.575844 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.575523    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-etc-tuned\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.575844 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.575709    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-tmp\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.580424 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.580386    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8rk8\" (UniqueName: \"kubernetes.io/projected/1252da54-e942-4e80-97c4-d34b84841d1a-kube-api-access-r8rk8\") pod \"node-resolver-9qh2x\" (UID: \"1252da54-e942-4e80-97c4-d34b84841d1a\") " pod="openshift-dns/node-resolver-9qh2x"
Jul 09 00:55:17.581127 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.581103    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fpdh\" (UniqueName: \"kubernetes.io/projected/1cd58c28-12ba-4565-948b-0cd4ebfcf0f0-kube-api-access-9fpdh\") pod \"multus-bxgnp\" (UID: \"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0\") " pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.582057 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.582037    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6gqz\" (UniqueName: \"kubernetes.io/projected/11109ade-c94b-4ae7-8f23-bad58d31cadb-kube-api-access-j6gqz\") pod \"multus-additional-cni-plugins-djxlj\" (UID: \"11109ade-c94b-4ae7-8f23-bad58d31cadb\") " pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.582914 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.582891    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlwfl\" (UniqueName: \"kubernetes.io/projected/17f7f9dc-ef47-4ff7-b90c-26ef998038a7-kube-api-access-rlwfl\") pod \"tuned-2fv6j\" (UID: \"17f7f9dc-ef47-4ff7-b90c-26ef998038a7\") " pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.584119 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.584047    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcgth\" (UniqueName: \"kubernetes.io/projected/5daf2603-bdab-405e-a733-a9ec1b51ab68-kube-api-access-jcgth\") pod \"node-ca-99x8l\" (UID: \"5daf2603-bdab-405e-a733-a9ec1b51ab68\") " pod="openshift-image-registry/node-ca-99x8l"
Jul 09 00:55:17.584228 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.584142    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ffm5\" (UniqueName: \"kubernetes.io/projected/816c2c96-76ef-4fdd-8f63-eb6cd0508322-kube-api-access-7ffm5\") pod \"aws-ebs-csi-driver-node-7mfv2\" (UID: \"816c2c96-76ef-4fdd-8f63-eb6cd0508322\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.659526 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.659480    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dfn4c"
Jul 09 00:55:17.669673 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.669643    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-29lhn"
Jul 09 00:55:17.681109 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.681073    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:17.687131 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.687100    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2fv6j"
Jul 09 00:55:17.694063 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.694039    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2"
Jul 09 00:55:17.703355 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.703327    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-djxlj"
Jul 09 00:55:17.712471 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.712443    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9qh2x"
Jul 09 00:55:17.721542 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.721513    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-99x8l"
Jul 09 00:55:17.729606 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.729574    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bxgnp"
Jul 09 00:55:17.860414 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.860332    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 00:55:17.976784 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.976743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs\") pod \"network-metrics-daemon-6jcwt\" (UID: \"0c3cdb55-354c-454f-b498-64c2a1a329ee\") " pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:17.976952 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:17.976809    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret\") pod \"global-pull-secret-syncer-8vx5f\" (UID: \"93c25998-c800-4bf5-90cb-173986d24386\") " pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:17.976952 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:17.976900    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:17.976952 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:17.976936    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:17.977063 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:17.976968    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs podName:0c3cdb55-354c-454f-b498-64c2a1a329ee nodeName:}" failed. No retries permitted until 2026-07-09 00:55:18.976951514 +0000 UTC m=+4.040446198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs") pod "network-metrics-daemon-6jcwt" (UID: "0c3cdb55-354c-454f-b498-64c2a1a329ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:17.977063 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:17.976993    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret podName:93c25998-c800-4bf5-90cb-173986d24386 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:18.976974816 +0000 UTC m=+4.040469533 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret") pod "global-pull-secret-syncer-8vx5f" (UID: "93c25998-c800-4bf5-90cb-173986d24386") : object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:18.077620 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:18.077581    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdc6n\" (UniqueName: \"kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n\") pod \"network-check-target-bbw2n\" (UID: \"4544db24-d746-4f38-896b-bdda644ee5ce\") " pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:18.077816 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:18.077743    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 00:55:18.077816 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:18.077769    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 00:55:18.077816 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:18.077782    2565 projected.go:196] Error preparing data for projected volume kube-api-access-vdc6n for pod openshift-network-diagnostics/network-check-target-bbw2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:18.077977 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:18.077842    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n podName:4544db24-d746-4f38-896b-bdda644ee5ce nodeName:}" failed. No retries permitted until 2026-07-09 00:55:19.077821957 +0000 UTC m=+4.141316650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vdc6n" (UniqueName: "kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n") pod "network-check-target-bbw2n" (UID: "4544db24-d746-4f38-896b-bdda644ee5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:18.395019 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:18.394971    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 00:50:17 +0000 UTC" deadline="2027-12-13 11:20:41.776427577 +0000 UTC"
Jul 09 00:55:18.395019 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:18.395009    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12538h25m23.381422417s"
Jul 09 00:55:18.695435 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:18.695403    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f7f9dc_ef47_4ff7_b90c_26ef998038a7.slice/crio-89c0209e6a7d5172c47d53a04ae81276566d3cdf34c4eabb786c5919673b3a91 WatchSource:0}: Error finding container 89c0209e6a7d5172c47d53a04ae81276566d3cdf34c4eabb786c5919673b3a91: Status 404 returned error can't find the container with id 89c0209e6a7d5172c47d53a04ae81276566d3cdf34c4eabb786c5919673b3a91
Jul 09 00:55:18.696860 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:18.696726    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28c40a0a_d72b_423d_9c3a_dc332c68fa80.slice/crio-7d820fcf2b442007cf14bdcd240dcb59b2e871d75cd63c935e3d907dd41eecc3 WatchSource:0}: Error finding container 7d820fcf2b442007cf14bdcd240dcb59b2e871d75cd63c935e3d907dd41eecc3: Status 404 returned error can't find the container with id 7d820fcf2b442007cf14bdcd240dcb59b2e871d75cd63c935e3d907dd41eecc3
Jul 09 00:55:18.697906 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:18.697868    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff2d724_96a5_41c8_a106_b8524a6aa862.slice/crio-b503d34119adfaa68b8259505f29a929e522995694cb77e99ec6019691a9a8b6 WatchSource:0}: Error finding container b503d34119adfaa68b8259505f29a929e522995694cb77e99ec6019691a9a8b6: Status 404 returned error can't find the container with id b503d34119adfaa68b8259505f29a929e522995694cb77e99ec6019691a9a8b6
Jul 09 00:55:18.698695 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:18.698673    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1420ad_db26_449b_8975_78ee8f8b94b8.slice/crio-1469f210eef1a57d9c9ac369a6acfe0cf8490c31931905a9b097b28e68794f08 WatchSource:0}: Error finding container 1469f210eef1a57d9c9ac369a6acfe0cf8490c31931905a9b097b28e68794f08: Status 404 returned error can't find the container with id 1469f210eef1a57d9c9ac369a6acfe0cf8490c31931905a9b097b28e68794f08
Jul 09 00:55:18.700556 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:18.699794    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5daf2603_bdab_405e_a733_a9ec1b51ab68.slice/crio-9a790570ae69235794929eeba9c482b748e42e9e957bbe3ae24380c6e13b5f72 WatchSource:0}: Error finding container 9a790570ae69235794929eeba9c482b748e42e9e957bbe3ae24380c6e13b5f72: Status 404 returned error can't find the container with id 9a790570ae69235794929eeba9c482b748e42e9e957bbe3ae24380c6e13b5f72
Jul 09 00:55:18.701830 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:18.701710    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd58c28_12ba_4565_948b_0cd4ebfcf0f0.slice/crio-73cffc5a65dab93b6325f452696ee324a857bd162cffab36d16e2d36bffc389d WatchSource:0}: Error finding container 73cffc5a65dab93b6325f452696ee324a857bd162cffab36d16e2d36bffc389d: Status 404 returned error can't find the container with id 73cffc5a65dab93b6325f452696ee324a857bd162cffab36d16e2d36bffc389d
Jul 09 00:55:18.709973 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:55:18.708945    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816c2c96_76ef_4fdd_8f63_eb6cd0508322.slice/crio-d6ed835e5f5890aece33e7ab6cb76735ce90d94b763e7ec009df8f7b72281f4e WatchSource:0}: Error finding container d6ed835e5f5890aece33e7ab6cb76735ce90d94b763e7ec009df8f7b72281f4e: Status 404 returned error can't find the container with id d6ed835e5f5890aece33e7ab6cb76735ce90d94b763e7ec009df8f7b72281f4e
Jul 09 00:55:18.984986 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:18.984801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret\") pod \"global-pull-secret-syncer-8vx5f\" (UID: \"93c25998-c800-4bf5-90cb-173986d24386\") " pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:18.985049 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:18.985035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs\") pod \"network-metrics-daemon-6jcwt\" (UID: \"0c3cdb55-354c-454f-b498-64c2a1a329ee\") " pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:18.985104 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:18.984957    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:18.985142 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:18.985117    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:18.985142 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:18.985125    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret podName:93c25998-c800-4bf5-90cb-173986d24386 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:20.985106503 +0000 UTC m=+6.048601191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret") pod "global-pull-secret-syncer-8vx5f" (UID: "93c25998-c800-4bf5-90cb-173986d24386") : object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:18.985232 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:18.985157    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs podName:0c3cdb55-354c-454f-b498-64c2a1a329ee nodeName:}" failed. No retries permitted until 2026-07-09 00:55:20.985144869 +0000 UTC m=+6.048639554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs") pod "network-metrics-daemon-6jcwt" (UID: "0c3cdb55-354c-454f-b498-64c2a1a329ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:19.085704 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.085665    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdc6n\" (UniqueName: \"kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n\") pod \"network-check-target-bbw2n\" (UID: \"4544db24-d746-4f38-896b-bdda644ee5ce\") " pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:19.085911 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:19.085888    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 00:55:19.085965 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:19.085921    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 00:55:19.085965 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:19.085936    2565 projected.go:196] Error preparing data for projected volume kube-api-access-vdc6n for pod openshift-network-diagnostics/network-check-target-bbw2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:19.086034 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:19.086008    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n podName:4544db24-d746-4f38-896b-bdda644ee5ce nodeName:}" failed. No retries permitted until 2026-07-09 00:55:21.085986589 +0000 UTC m=+6.149481278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vdc6n" (UniqueName: "kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n") pod "network-check-target-bbw2n" (UID: "4544db24-d746-4f38-896b-bdda644ee5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:19.395684 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.395602    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 00:50:17 +0000 UTC" deadline="2028-03-20 20:05:38.938307892 +0000 UTC"
Jul 09 00:55:19.395684 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.395669    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14899h10m19.542644465s"
Jul 09 00:55:19.502999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.502428    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:19.502999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.502441    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:19.502999 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:19.502583    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:19.502999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.502635    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:19.502999 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:19.502741    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:19.502999 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:19.502820    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:19.536312 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.536048    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-227.ec2.internal" event={"ID":"909e8761eb0f31e787ea2b2e42e45455","Type":"ContainerStarted","Data":"ebac4ef9c4187e084712210cb6267e0c64b27b02bd4fe471d945d6a326281437"}
Jul 09 00:55:19.548007 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.547881    2565 generic.go:356] "Generic (PLEG): container finished" podID="4f4b8195244e25b3b7060ea95d758498" containerID="482226ce527a3c14fd9690f926eeaacce39bd37aa53d8c7f5ca0178e0d8765ce" exitCode=0
Jul 09 00:55:19.548007 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.547989    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal" event={"ID":"4f4b8195244e25b3b7060ea95d758498","Type":"ContainerDied","Data":"482226ce527a3c14fd9690f926eeaacce39bd37aa53d8c7f5ca0178e0d8765ce"}
Jul 09 00:55:19.551891 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.550477    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-227.ec2.internal" podStartSLOduration=2.550455223 podStartE2EDuration="2.550455223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:55:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:19.549252197 +0000 UTC m=+4.612746901" watchObservedRunningTime="2026-07-09 00:55:19.550455223 +0000 UTC m=+4.613949933"
Jul 09 00:55:19.574823 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.574788    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9qh2x" event={"ID":"1252da54-e942-4e80-97c4-d34b84841d1a","Type":"ContainerStarted","Data":"56b34ff2004ada7cb8f2a3de03cff1ab2092e7de9651ba50690c8f70672e277e"}
Jul 09 00:55:19.580462 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.580352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2" event={"ID":"816c2c96-76ef-4fdd-8f63-eb6cd0508322","Type":"ContainerStarted","Data":"d6ed835e5f5890aece33e7ab6cb76735ce90d94b763e7ec009df8f7b72281f4e"}
Jul 09 00:55:19.587903 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.587864    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djxlj" event={"ID":"11109ade-c94b-4ae7-8f23-bad58d31cadb","Type":"ContainerStarted","Data":"5470a08a39fcf6dad87b28375cd859d932ea5bb6299ae64e36c033826d3ebfc5"}
Jul 09 00:55:19.599105 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.599001    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dfn4c" event={"ID":"eb1420ad-db26-449b-8975-78ee8f8b94b8","Type":"ContainerStarted","Data":"1469f210eef1a57d9c9ac369a6acfe0cf8490c31931905a9b097b28e68794f08"}
Jul 09 00:55:19.624819 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.624751    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bxgnp" event={"ID":"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0","Type":"ContainerStarted","Data":"73cffc5a65dab93b6325f452696ee324a857bd162cffab36d16e2d36bffc389d"}
Jul 09 00:55:19.640376 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.640337    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-99x8l" event={"ID":"5daf2603-bdab-405e-a733-a9ec1b51ab68","Type":"ContainerStarted","Data":"9a790570ae69235794929eeba9c482b748e42e9e957bbe3ae24380c6e13b5f72"}
Jul 09 00:55:19.660055 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.659973    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-29lhn" event={"ID":"0ff2d724-96a5-41c8-a106-b8524a6aa862","Type":"ContainerStarted","Data":"b503d34119adfaa68b8259505f29a929e522995694cb77e99ec6019691a9a8b6"}
Jul 09 00:55:19.694146 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.694020    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5" event={"ID":"28c40a0a-d72b-423d-9c3a-dc332c68fa80","Type":"ContainerStarted","Data":"7d820fcf2b442007cf14bdcd240dcb59b2e871d75cd63c935e3d907dd41eecc3"}
Jul 09 00:55:19.713638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:19.713536    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2fv6j" event={"ID":"17f7f9dc-ef47-4ff7-b90c-26ef998038a7","Type":"ContainerStarted","Data":"89c0209e6a7d5172c47d53a04ae81276566d3cdf34c4eabb786c5919673b3a91"}
Jul 09 00:55:20.741894 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:20.741818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal" event={"ID":"4f4b8195244e25b3b7060ea95d758498","Type":"ContainerStarted","Data":"c4d3d564fc08fa397cc4527854604374d849ea463e26d4badd987f281934281f"}
Jul 09 00:55:21.005931 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:21.005862    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret\") pod \"global-pull-secret-syncer-8vx5f\" (UID: \"93c25998-c800-4bf5-90cb-173986d24386\") " pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:21.006139 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:21.005966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs\") pod \"network-metrics-daemon-6jcwt\" (UID: \"0c3cdb55-354c-454f-b498-64c2a1a329ee\") " pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:21.006139 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:21.006130    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:21.006282 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:21.006197    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs podName:0c3cdb55-354c-454f-b498-64c2a1a329ee nodeName:}" failed. No retries permitted until 2026-07-09 00:55:25.006177842 +0000 UTC m=+10.069672547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs") pod "network-metrics-daemon-6jcwt" (UID: "0c3cdb55-354c-454f-b498-64c2a1a329ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:21.006670 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:21.006481    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:21.006670 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:21.006552    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret podName:93c25998-c800-4bf5-90cb-173986d24386 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:25.006533658 +0000 UTC m=+10.070028358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret") pod "global-pull-secret-syncer-8vx5f" (UID: "93c25998-c800-4bf5-90cb-173986d24386") : object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:21.107632 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:21.107587    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdc6n\" (UniqueName: \"kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n\") pod \"network-check-target-bbw2n\" (UID: \"4544db24-d746-4f38-896b-bdda644ee5ce\") " pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:21.107903 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:21.107862    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 00:55:21.107903 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:21.107886    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 00:55:21.107903 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:21.107900    2565 projected.go:196] Error preparing data for projected volume kube-api-access-vdc6n for pod openshift-network-diagnostics/network-check-target-bbw2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:21.108094 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:21.107965    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n podName:4544db24-d746-4f38-896b-bdda644ee5ce nodeName:}" failed. No retries permitted until 2026-07-09 00:55:25.107944941 +0000 UTC m=+10.171439629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vdc6n" (UniqueName: "kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n") pod "network-check-target-bbw2n" (UID: "4544db24-d746-4f38-896b-bdda644ee5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:21.500144 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:21.500105    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:21.500349 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:21.500280    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:21.500721 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:21.500701    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:21.500820 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:21.500799    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:21.500896 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:21.500883    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:21.500976 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:21.500959    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:23.502117 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:23.501603    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:23.502117 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:23.501771    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:23.502117 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:23.501864    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:23.502117 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:23.501907    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:23.502117 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:23.501967    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:23.502117 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:23.501762    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:25.044502 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:25.044465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs\") pod \"network-metrics-daemon-6jcwt\" (UID: \"0c3cdb55-354c-454f-b498-64c2a1a329ee\") " pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:25.045010 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:25.044529    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret\") pod \"global-pull-secret-syncer-8vx5f\" (UID: \"93c25998-c800-4bf5-90cb-173986d24386\") " pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:25.045010 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:25.044607    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:25.045010 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:25.044657    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:25.045010 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:25.044687    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs podName:0c3cdb55-354c-454f-b498-64c2a1a329ee nodeName:}" failed. No retries permitted until 2026-07-09 00:55:33.044666493 +0000 UTC m=+18.108161179 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs") pod "network-metrics-daemon-6jcwt" (UID: "0c3cdb55-354c-454f-b498-64c2a1a329ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:25.045010 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:25.044712    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret podName:93c25998-c800-4bf5-90cb-173986d24386 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:33.044695569 +0000 UTC m=+18.108190265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret") pod "global-pull-secret-syncer-8vx5f" (UID: "93c25998-c800-4bf5-90cb-173986d24386") : object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:25.145258 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:25.145185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdc6n\" (UniqueName: \"kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n\") pod \"network-check-target-bbw2n\" (UID: \"4544db24-d746-4f38-896b-bdda644ee5ce\") " pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:25.145499 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:25.145348    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 00:55:25.145499 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:25.145372    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 00:55:25.145499 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:25.145385    2565 projected.go:196] Error preparing data for projected volume kube-api-access-vdc6n for pod openshift-network-diagnostics/network-check-target-bbw2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:25.145499 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:25.145447    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n podName:4544db24-d746-4f38-896b-bdda644ee5ce nodeName:}" failed. No retries permitted until 2026-07-09 00:55:33.145430654 +0000 UTC m=+18.208925349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vdc6n" (UniqueName: "kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n") pod "network-check-target-bbw2n" (UID: "4544db24-d746-4f38-896b-bdda644ee5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:25.501998 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:25.501378    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:25.501998 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:25.501487    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:25.501998 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:25.501821    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:25.501998 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:25.501881    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:25.501998 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:25.501913    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:25.501998 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:25.501959    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:27.500351 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:27.500318    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:27.500815 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:27.500470    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:27.500815 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:27.500526    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:27.500815 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:27.500526    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:27.500815 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:27.500641    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:27.500815 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:27.500684    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:29.500458 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:29.500428    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:29.500898 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:29.500428    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:29.500898 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:29.500570    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:29.500898 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:29.500672    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:29.500898 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:29.500707    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:29.500898 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:29.500785    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:31.500357 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:31.500315    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:31.500765 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:31.500448    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:31.500765 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:31.500734    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:31.500868 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:31.500739    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:31.500924 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:31.500876    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:31.501001 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:31.500977    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:33.104777 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:33.104742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret\") pod \"global-pull-secret-syncer-8vx5f\" (UID: \"93c25998-c800-4bf5-90cb-173986d24386\") " pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:33.105295 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:33.104811    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs\") pod \"network-metrics-daemon-6jcwt\" (UID: \"0c3cdb55-354c-454f-b498-64c2a1a329ee\") " pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:33.105295 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:33.104913    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:33.105295 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:33.104918    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:33.105295 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:33.104980    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs podName:0c3cdb55-354c-454f-b498-64c2a1a329ee nodeName:}" failed. No retries permitted until 2026-07-09 00:55:49.104958971 +0000 UTC m=+34.168453672 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs") pod "network-metrics-daemon-6jcwt" (UID: "0c3cdb55-354c-454f-b498-64c2a1a329ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:33.105295 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:33.105000    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret podName:93c25998-c800-4bf5-90cb-173986d24386 nodeName:}" failed. No retries permitted until 2026-07-09 00:55:49.104991082 +0000 UTC m=+34.168485766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret") pod "global-pull-secret-syncer-8vx5f" (UID: "93c25998-c800-4bf5-90cb-173986d24386") : object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:33.206061 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:33.206020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdc6n\" (UniqueName: \"kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n\") pod \"network-check-target-bbw2n\" (UID: \"4544db24-d746-4f38-896b-bdda644ee5ce\") " pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:33.206293 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:33.206194    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 00:55:33.206293 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:33.206228    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 00:55:33.206293 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:33.206239    2565 projected.go:196] Error preparing data for projected volume kube-api-access-vdc6n for pod openshift-network-diagnostics/network-check-target-bbw2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:33.206293 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:33.206295    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n podName:4544db24-d746-4f38-896b-bdda644ee5ce nodeName:}" failed. No retries permitted until 2026-07-09 00:55:49.206277418 +0000 UTC m=+34.269772111 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vdc6n" (UniqueName: "kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n") pod "network-check-target-bbw2n" (UID: "4544db24-d746-4f38-896b-bdda644ee5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:33.500585 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:33.500532    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:33.500585 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:33.500573    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:33.500810 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:33.500540    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:33.500810 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:33.500671    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:33.500810 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:33.500738    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:33.500946 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:33.500853    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:35.500978 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:35.500938    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:35.501469 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:35.500992    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:35.501469 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:35.501059    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:35.501469 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:35.501119    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:35.501469 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:35.501156    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:35.501469 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:35.501266    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:37.500203 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:37.500173    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:37.500642 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:37.500176    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:37.500642 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:37.500308    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:37.500642 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:37.500186    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:37.500642 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:37.500402    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:37.500642 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:37.500488    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:37.787853 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:37.787633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2fv6j" event={"ID":"17f7f9dc-ef47-4ff7-b90c-26ef998038a7","Type":"ContainerStarted","Data":"ebb0e53daeb1a992e5261c5f61e10e66367aaf5432bea52ee9a4502773e5788e"}
Jul 09 00:55:37.803968 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:37.803916    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2fv6j" podStartSLOduration=2.874891165 podStartE2EDuration="21.803897234s" totalImagesPullingTime="18.929006069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:37.803712946 +0000 UTC m=+22.867207655" watchObservedRunningTime="2026-07-09 00:55:37.803897234 +0000 UTC m=+22.867391943"
Jul 09 00:55:37.804471 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:37.804432    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-227.ec2.internal" podStartSLOduration=20.804415941 podStartE2EDuration="20.804415941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:55:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:20.759588789 +0000 UTC m=+5.823083502" watchObservedRunningTime="2026-07-09 00:55:37.804415941 +0000 UTC m=+22.867910647"
Jul 09 00:55:38.791434 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:38.791147    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9qh2x" event={"ID":"1252da54-e942-4e80-97c4-d34b84841d1a","Type":"ContainerStarted","Data":"9c5f6b5cd3bcd179d04dd02d70d9ee38bb5e65848ee20747b9158ce67a5d9939"}
Jul 09 00:55:38.792565 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:38.792540    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2" event={"ID":"816c2c96-76ef-4fdd-8f63-eb6cd0508322","Type":"ContainerStarted","Data":"e0bceb12fb34554294d03b9d6a93872066c4b4c61c69df885c7b6a74e0a86971"}
Jul 09 00:55:38.794055 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:38.794029    2565 generic.go:356] "Generic (PLEG): container finished" podID="11109ade-c94b-4ae7-8f23-bad58d31cadb" containerID="e6d5b4fdfad1f8f3b13e4bea5e0df0a064161a179be631bc9194abc5ae0c9326" exitCode=0
Jul 09 00:55:38.794150 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:38.794107    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djxlj" event={"ID":"11109ade-c94b-4ae7-8f23-bad58d31cadb","Type":"ContainerDied","Data":"e6d5b4fdfad1f8f3b13e4bea5e0df0a064161a179be631bc9194abc5ae0c9326"}
Jul 09 00:55:38.795471 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:38.795446    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dfn4c" event={"ID":"eb1420ad-db26-449b-8975-78ee8f8b94b8","Type":"ContainerStarted","Data":"bfbfaccd15e6648c4e3569c666abac8ddf2a4bf645d5614c7d0d798aafd35663"}
Jul 09 00:55:38.797156 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:38.797125    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bxgnp" event={"ID":"1cd58c28-12ba-4565-948b-0cd4ebfcf0f0","Type":"ContainerStarted","Data":"26ada485f837bb11e5a16eca301893f22c865e3145c4f50f2848e324dd894935"}
Jul 09 00:55:38.798759 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:38.798732    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-99x8l" event={"ID":"5daf2603-bdab-405e-a733-a9ec1b51ab68","Type":"ContainerStarted","Data":"c133551b160a3c664ef2fc87a38421d4a5c24fdb530cde8a2a8122dff23bbdea"}
Jul 09 00:55:38.802032 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:38.802008    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5" event={"ID":"28c40a0a-d72b-423d-9c3a-dc332c68fa80","Type":"ContainerStarted","Data":"2e6e375c44aa5a6a290b646edfdf0e0c6576a7c89c44397371f673b2efebb79c"}
Jul 09 00:55:38.802124 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:38.802092    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5" event={"ID":"28c40a0a-d72b-423d-9c3a-dc332c68fa80","Type":"ContainerStarted","Data":"f20d9d87471d3dd6843a8a999a7ca417168b7086c430928f26eacd2f316385a2"}
Jul 09 00:55:38.802165 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:38.802127    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5" event={"ID":"28c40a0a-d72b-423d-9c3a-dc332c68fa80","Type":"ContainerStarted","Data":"fdd5506522ee9fe3b5fe4b0537524122e6fcbe2f50b4f77f0a126058796615db"}
Jul 09 00:55:38.802165 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:38.802159    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5" event={"ID":"28c40a0a-d72b-423d-9c3a-dc332c68fa80","Type":"ContainerStarted","Data":"83c23a855fedb9c64bd9740a8cc4fa19a4083c48c128e61162020b1c7b7916f4"}
Jul 09 00:55:38.802246 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:38.802200    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5" event={"ID":"28c40a0a-d72b-423d-9c3a-dc332c68fa80","Type":"ContainerStarted","Data":"b87f0b656687987e8f2925915a285e0ca5f880edde05db0cbd8a033d13300155"}
Jul 09 00:55:38.802279 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:38.802254    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5" event={"ID":"28c40a0a-d72b-423d-9c3a-dc332c68fa80","Type":"ContainerStarted","Data":"56625fea3baff1efd2e1d25867cd2e5b1f858bc64cefec42f1aed9645056e118"}
Jul 09 00:55:38.807151 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:38.807112    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9qh2x" podStartSLOduration=3.892920493 podStartE2EDuration="22.807099609s" totalImagesPullingTime="18.914179116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:38.806708498 +0000 UTC m=+23.870203204" watchObservedRunningTime="2026-07-09 00:55:38.807099609 +0000 UTC m=+23.870594313"
Jul 09 00:55:38.838293 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:38.838245    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-99x8l" podStartSLOduration=3.914408352 podStartE2EDuration="22.838202711s" totalImagesPullingTime="18.923794359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:38.838007469 +0000 UTC m=+23.901502175" watchObservedRunningTime="2026-07-09 00:55:38.838202711 +0000 UTC m=+23.901697417"
Jul 09 00:55:38.853224 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:38.853143    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bxgnp" podStartSLOduration=3.855456979 podStartE2EDuration="22.853122206s" totalImagesPullingTime="18.997665227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:38.852579033 +0000 UTC m=+23.916073742" watchObservedRunningTime="2026-07-09 00:55:38.853122206 +0000 UTC m=+23.916616912"
Jul 09 00:55:38.865321 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:38.865266    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dfn4c" podStartSLOduration=8.195369486 podStartE2EDuration="22.865247326s" totalImagesPullingTime="14.66987784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:38.864861604 +0000 UTC m=+23.928356308" watchObservedRunningTime="2026-07-09 00:55:38.865247326 +0000 UTC m=+23.928742031"
Jul 09 00:55:39.251948 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:39.251925    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:39.318075 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:39.318043    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:39.367332 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:39.367305    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 00:55:39.452899 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:39.452791    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T00:55:39.367324702Z","UUID":"67c7a3ab-5370-49d8-a231-2b45f9e9dd3f","Handler":null,"Name":"","Endpoint":""}
Jul 09 00:55:39.454163 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:39.454144    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 00:55:39.454298 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:39.454178    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 00:55:39.500468 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:39.500438    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:39.500468 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:39.500469    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:39.500704 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:39.500438    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:39.500704 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:39.500569    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:39.500704 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:39.500678    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:39.500853 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:39.500768    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:39.598800 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:39.598761    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:39.685891 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:39.685853    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:39.798868 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:39.798789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:39.805365 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:39.805329    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-29lhn" event={"ID":"0ff2d724-96a5-41c8-a106-b8524a6aa862","Type":"ContainerStarted","Data":"4706b442b06b47092982ff2a313ea9ada9ba048af9913cfeead119818e550c48"}
Jul 09 00:55:39.807038 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:39.807016    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2" event={"ID":"816c2c96-76ef-4fdd-8f63-eb6cd0508322","Type":"ContainerStarted","Data":"5de827dc4b48003848f9ed0b5b044f827e04d10653c21773328b1f07ce7df22f"}
Jul 09 00:55:39.818920 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:39.818880    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-29lhn" podStartSLOduration=4.893580641 podStartE2EDuration="23.818867601s" totalImagesPullingTime="18.92528696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:39.818570517 +0000 UTC m=+24.882065235" watchObservedRunningTime="2026-07-09 00:55:39.818867601 +0000 UTC m=+24.882362306"
Jul 09 00:55:39.940927 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:39.940885    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:40.031426 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:40.031392    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:40.102954 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:40.102864    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:40.202393 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:40.202364    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:40.403713 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:40.403683    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:40.504779 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:40.504738    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:40.811262 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:40.811222    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:40.812747 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:40.812723    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5" event={"ID":"28c40a0a-d72b-423d-9c3a-dc332c68fa80","Type":"ContainerStarted","Data":"8fb050b801c568bdeb0b247135b14787d26897fb990c8e11250a45b083975479"}
Jul 09 00:55:40.911451 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:40.911396    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:40.981073 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:40.981041    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:41.500516 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:41.500305    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:41.500691 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:41.500304    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:41.500691 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:41.500630    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:41.500799 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:41.500697    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:41.500799 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:41.500317    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:41.500911 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:41.500800    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:41.641289 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:41.641252    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:41.691890 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:41.691859    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:41.816855 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:41.816773    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2" event={"ID":"816c2c96-76ef-4fdd-8f63-eb6cd0508322","Type":"ContainerStarted","Data":"c11252c3d4ba36ac0f0236ee859ee15558c1be4f4c67b933cadadac4be2e2ee9"}
Jul 09 00:55:41.834095 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:41.834049    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mfv2" podStartSLOduration=3.888292411 podStartE2EDuration="25.834035042s" totalImagesPullingTime="21.945742631s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:55:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:41.833692353 +0000 UTC m=+26.897187057" watchObservedRunningTime="2026-07-09 00:55:41.834035042 +0000 UTC m=+26.897529747"
Jul 09 00:55:42.013135 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:42.013100    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dfn4c"
Jul 09 00:55:42.041162 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:42.041128    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:42.089302 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:42.089204    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:42.442490 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:42.442399    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:42.498472 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:42.498448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:42.737651 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:42.737573    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9qh2x_1252da54-e942-4e80-97c4-d34b84841d1a/dns-node-resolver/0.log"
Jul 09 00:55:42.822671 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:42.822636    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5" event={"ID":"28c40a0a-d72b-423d-9c3a-dc332c68fa80","Type":"ContainerStarted","Data":"db7f035764be3e0cd65d32739b6852e7d2d0fd3cf3f4e80d95e880ca6272bc94"}
Jul 09 00:55:42.852932 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:42.852874    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5" podStartSLOduration=7.851713393 podStartE2EDuration="26.852857239s" totalImagesPullingTime="19.001143846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:42.852349204 +0000 UTC m=+27.915843909" watchObservedRunningTime="2026-07-09 00:55:42.852857239 +0000 UTC m=+27.916351944"
Jul 09 00:55:43.268552 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:43.268345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:43.337125 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:43.337091    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dfn4c"
Jul 09 00:55:43.337752 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:43.337726    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dfn4c"
Jul 09 00:55:43.499980 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:43.499945    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:43.499980 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:43.499962    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:43.500233 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:43.499943    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:43.500233 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:43.500070    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:43.500233 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:43.500153    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:43.500363 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:43.500261    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:43.737033 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:43.736938    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-99x8l_5daf2603-bdab-405e-a733-a9ec1b51ab68/node-ca/0.log"
Jul 09 00:55:43.825618 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:43.825531    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:43.826035 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:43.825639    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:43.826035 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:43.825697    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:43.826658 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:43.826599    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dfn4c"
Jul 09 00:55:43.848385 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:43.848275    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:43.848595 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:43.848534    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:55:44.263329 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:44.263296    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:44.365485 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:44.365451    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:44.463057 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:44.463029    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:44.563838 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:44.563755    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:44.670794 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:44.670757    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:44.872240 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:44.872137    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6jcwt"]
Jul 09 00:55:44.872775 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:44.872296    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:44.872775 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:44.872435    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:44.874860 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:44.874832    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bbw2n"]
Jul 09 00:55:44.875006 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:44.874936    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:44.875076 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:44.875032    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:44.882866 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:44.882831    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8vx5f"]
Jul 09 00:55:44.883000 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:44.882932    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:44.883058 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:44.883013    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:45.362770 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:45.362736    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:45.760415 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:45.760381    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:45.831029 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:45.830992    2565 generic.go:356] "Generic (PLEG): container finished" podID="11109ade-c94b-4ae7-8f23-bad58d31cadb" containerID="1f96750044fb5dc5140fb9013ef0bad36e851e3f1abd42c61b9697f5580ef8e8" exitCode=0
Jul 09 00:55:45.831029 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:45.831023    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djxlj" event={"ID":"11109ade-c94b-4ae7-8f23-bad58d31cadb","Type":"ContainerDied","Data":"1f96750044fb5dc5140fb9013ef0bad36e851e3f1abd42c61b9697f5580ef8e8"}
Jul 09 00:55:46.178245 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:46.178015    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:46.414128 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:46.414097    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:46.500096 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:46.500071    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:46.500096 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:46.500083    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:46.500303 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:46.500178    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:46.500303 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:46.500191    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:46.500385 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:46.500319    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:46.500445 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:46.500425    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:46.573052 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:46.573010    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:46.972706 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:46.972624    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:47.073443 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:47.073412    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:47.176763 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:47.176726    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log" limit=1024
Jul 09 00:55:47.836788 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:47.836751    2565 generic.go:356] "Generic (PLEG): container finished" podID="11109ade-c94b-4ae7-8f23-bad58d31cadb" containerID="3acb6fec9c0ecbe2572dd3dda2c88088c1e6c196761bab1464352758a9807280" exitCode=0
Jul 09 00:55:47.837374 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:47.836789    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djxlj" event={"ID":"11109ade-c94b-4ae7-8f23-bad58d31cadb","Type":"ContainerDied","Data":"3acb6fec9c0ecbe2572dd3dda2c88088c1e6c196761bab1464352758a9807280"}
Jul 09 00:55:48.499999 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:48.499963    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:48.500160 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:48.499963    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:48.500160 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:48.500088    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:48.500160 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:48.500100    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:48.500325 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:48.500183    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:48.500325 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:48.500295    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:48.841160 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:48.841123    2565 generic.go:356] "Generic (PLEG): container finished" podID="11109ade-c94b-4ae7-8f23-bad58d31cadb" containerID="daabe933409251a08ceb51c02eed467e3ff58a9ca6933194c355a40295e4b5ec" exitCode=0
Jul 09 00:55:48.841606 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:48.841171    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djxlj" event={"ID":"11109ade-c94b-4ae7-8f23-bad58d31cadb","Type":"ContainerDied","Data":"daabe933409251a08ceb51c02eed467e3ff58a9ca6933194c355a40295e4b5ec"}
Jul 09 00:55:49.123703 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:49.123663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret\") pod \"global-pull-secret-syncer-8vx5f\" (UID: \"93c25998-c800-4bf5-90cb-173986d24386\") " pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:49.123880 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:49.123726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs\") pod \"network-metrics-daemon-6jcwt\" (UID: \"0c3cdb55-354c-454f-b498-64c2a1a329ee\") " pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:49.123880 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:49.123807    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:49.123880 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:49.123807    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:49.123880 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:49.123858    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs podName:0c3cdb55-354c-454f-b498-64c2a1a329ee nodeName:}" failed. No retries permitted until 2026-07-09 00:56:21.123845484 +0000 UTC m=+66.187340166 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs") pod "network-metrics-daemon-6jcwt" (UID: "0c3cdb55-354c-454f-b498-64c2a1a329ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 00:55:49.123880 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:49.123871    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret podName:93c25998-c800-4bf5-90cb-173986d24386 nodeName:}" failed. No retries permitted until 2026-07-09 00:56:21.123864525 +0000 UTC m=+66.187359208 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret") pod "global-pull-secret-syncer-8vx5f" (UID: "93c25998-c800-4bf5-90cb-173986d24386") : object "kube-system"/"original-pull-secret" not registered
Jul 09 00:55:49.224446 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:49.224407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdc6n\" (UniqueName: \"kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n\") pod \"network-check-target-bbw2n\" (UID: \"4544db24-d746-4f38-896b-bdda644ee5ce\") " pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:49.224611 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:49.224571    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 00:55:49.224611 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:49.224593    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 00:55:49.224611 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:49.224605    2565 projected.go:196] Error preparing data for projected volume kube-api-access-vdc6n for pod openshift-network-diagnostics/network-check-target-bbw2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:49.224711 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:49.224659    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n podName:4544db24-d746-4f38-896b-bdda644ee5ce nodeName:}" failed. No retries permitted until 2026-07-09 00:56:21.224641309 +0000 UTC m=+66.288135995 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vdc6n" (UniqueName: "kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n") pod "network-check-target-bbw2n" (UID: "4544db24-d746-4f38-896b-bdda644ee5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 00:55:50.500497 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:50.500465    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:50.501113 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:50.500472    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:50.501113 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:50.500579    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:50.501113 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:50.500655    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:50.501113 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:50.500472    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:50.501113 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:50.500754    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:52.499484 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:52.499447    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:52.499995 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:52.499447    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:52.499995 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:52.499452    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:52.499995 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:52.499813    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:52.499995 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:52.499937    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:52.500205 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:52.500040    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:54.500381 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:54.500187    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:54.500696 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:54.500245    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:54.500696 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:54.500460    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:54.500696 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:54.500321    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:54.500696 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:54.500530    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:54.500696 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:54.500635    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:54.858756 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:54.858722    2565 generic.go:356] "Generic (PLEG): container finished" podID="11109ade-c94b-4ae7-8f23-bad58d31cadb" containerID="27f58c17503e05d848548775ac74f74dc1b8eec136b5067fe8085fbe6e8be4f3" exitCode=0
Jul 09 00:55:54.858929 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:54.858774    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djxlj" event={"ID":"11109ade-c94b-4ae7-8f23-bad58d31cadb","Type":"ContainerDied","Data":"27f58c17503e05d848548775ac74f74dc1b8eec136b5067fe8085fbe6e8be4f3"}
Jul 09 00:55:55.864259 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:55.864226    2565 generic.go:356] "Generic (PLEG): container finished" podID="11109ade-c94b-4ae7-8f23-bad58d31cadb" containerID="84c048087c8a245dab1c8c705d38c34355275c925e4a1121232c026c45d282bb" exitCode=0
Jul 09 00:55:55.864699 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:55.864283    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djxlj" event={"ID":"11109ade-c94b-4ae7-8f23-bad58d31cadb","Type":"ContainerDied","Data":"84c048087c8a245dab1c8c705d38c34355275c925e4a1121232c026c45d282bb"}
Jul 09 00:55:56.500273 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:56.500234    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:56.500476 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:56.500234    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:56.500476 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:56.500363    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:56.500476 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:56.500234    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:56.500476 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:56.500419    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:55:56.500688 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:56.500482    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:56.870115 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:56.870018    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djxlj" event={"ID":"11109ade-c94b-4ae7-8f23-bad58d31cadb","Type":"ContainerStarted","Data":"77937124da416752b5c773149a0e39830c8d687eb195a17eb3eb50dbcf2d7840"}
Jul 09 00:55:56.891348 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:56.891289    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-djxlj" podStartSLOduration=8.020516723 podStartE2EDuration="40.891273352s" totalImagesPullingTime="32.870756629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:55:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:55:56.890418454 +0000 UTC m=+41.953913159" watchObservedRunningTime="2026-07-09 00:55:56.891273352 +0000 UTC m=+41.954768059"
Jul 09 00:55:58.500410 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:58.500378    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:55:58.500798 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:58.500379    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:55:58.500798 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:58.500483    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:55:58.500798 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:55:58.500393    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:55:58.500798 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:58.500551    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:55:58.500798 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:55:58.500630    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:56:00.499971 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:00.499931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:56:00.500462 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:00.499931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:56:00.500462 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:00.500063    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:56:00.500462 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:00.499931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:56:00.500462 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:00.500122    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:56:00.500462 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:00.500186    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:56:02.500399 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:02.500368    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:56:02.500862 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:02.500368    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:56:02.500862 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:02.500464    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:56:02.500862 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:02.500375    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:56:02.500862 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:02.500533    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:56:02.500862 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:02.500598    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:56:04.499991 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:04.499956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:56:04.500429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:04.499956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:56:04.500429 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:04.500062    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:56:04.500429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:04.499956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:56:04.500429 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:04.500127    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:56:04.500429 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:04.500203    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:56:06.500065 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.500032    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:56:06.500556 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.500034    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:56:06.500556 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.500157    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:56:06.500556 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:06.500141    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcwt" podUID="0c3cdb55-354c-454f-b498-64c2a1a329ee"
Jul 09 00:56:06.500556 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:06.500274    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbw2n" podUID="4544db24-d746-4f38-896b-bdda644ee5ce"
Jul 09 00:56:06.500556 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:06.500314    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8vx5f" podUID="93c25998-c800-4bf5-90cb-173986d24386"
Jul 09 00:56:06.651810 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.651782    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-227.ec2.internal" event="NodeReady"
Jul 09 00:56:06.651993 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.651906    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 00:56:06.684503 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.684469    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d7bb587-w4gzp"]
Jul 09 00:56:06.702705 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.702673    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dtmg6"]
Jul 09 00:56:06.702859 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.702782    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.705145 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.705121    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 00:56:06.705300 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.705157    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 00:56:06.705300 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.705122    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 00:56:06.705510 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.705494    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tqqbn\""
Jul 09 00:56:06.710869 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.710845    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 00:56:06.715070 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.715048    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p9n8r"]
Jul 09 00:56:06.715178 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.715155    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dtmg6"
Jul 09 00:56:06.718082 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.718065    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7p7kq\""
Jul 09 00:56:06.718198 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.718089    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 00:56:06.718198 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.718113    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 00:56:06.718198 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.718171    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 00:56:06.733520 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.733498    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d7bb587-w4gzp"]
Jul 09 00:56:06.733637 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.733533    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dtmg6"]
Jul 09 00:56:06.733637 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.733556    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p9n8r"]
Jul 09 00:56:06.733637 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.733607    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p9n8r"
Jul 09 00:56:06.736139 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.736118    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 00:56:06.736292 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.736164    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 00:56:06.736292 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.736195    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 00:56:06.736452 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.736439    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-95w8r\""
Jul 09 00:56:06.736494 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.736468    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 00:56:06.750877 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.750827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f3a5efef-8d70-422c-9734-0da95678328e-crio-socket\") pod \"insights-runtime-extractor-p9n8r\" (UID: \"f3a5efef-8d70-422c-9734-0da95678328e\") " pod="openshift-insights/insights-runtime-extractor-p9n8r"
Jul 09 00:56:06.750877 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.750857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-registry-certificates\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.751032 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.750875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-image-registry-private-configuration\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.751032 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.750900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-installation-pull-secrets\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.751032 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.750924    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz8ft\" (UniqueName: \"kubernetes.io/projected/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-kube-api-access-cz8ft\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.751032 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.750942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f3a5efef-8d70-422c-9734-0da95678328e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9n8r\" (UID: \"f3a5efef-8d70-422c-9734-0da95678328e\") " pod="openshift-insights/insights-runtime-extractor-p9n8r"
Jul 09 00:56:06.751032 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.751007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dqlb\" (UniqueName: \"kubernetes.io/projected/f3a5efef-8d70-422c-9734-0da95678328e-kube-api-access-4dqlb\") pod \"insights-runtime-extractor-p9n8r\" (UID: \"f3a5efef-8d70-422c-9734-0da95678328e\") " pod="openshift-insights/insights-runtime-extractor-p9n8r"
Jul 09 00:56:06.751232 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.751037    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-bound-sa-token\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.751232 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.751086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2475349-184c-40c1-8825-45e4b8c349fe-cert\") pod \"ingress-canary-dtmg6\" (UID: \"e2475349-184c-40c1-8825-45e4b8c349fe\") " pod="openshift-ingress-canary/ingress-canary-dtmg6"
Jul 09 00:56:06.751232 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.751112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-ca-trust-extracted\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.751232 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.751156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f3a5efef-8d70-422c-9734-0da95678328e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p9n8r\" (UID: \"f3a5efef-8d70-422c-9734-0da95678328e\") " pod="openshift-insights/insights-runtime-extractor-p9n8r"
Jul 09 00:56:06.751232 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.751173    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3a5efef-8d70-422c-9734-0da95678328e-data-volume\") pod \"insights-runtime-extractor-p9n8r\" (UID: \"f3a5efef-8d70-422c-9734-0da95678328e\") " pod="openshift-insights/insights-runtime-extractor-p9n8r"
Jul 09 00:56:06.751232 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.751187    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-registry-tls\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.751232 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.751224    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-trusted-ca\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.751456 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.751248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z57lc\" (UniqueName: \"kubernetes.io/projected/e2475349-184c-40c1-8825-45e4b8c349fe-kube-api-access-z57lc\") pod \"ingress-canary-dtmg6\" (UID: \"e2475349-184c-40c1-8825-45e4b8c349fe\") " pod="openshift-ingress-canary/ingress-canary-dtmg6"
Jul 09 00:56:06.795892 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.795865    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hmhcq"]
Jul 09 00:56:06.813914 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.813889    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmhcq"]
Jul 09 00:56:06.814036 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.813993    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmhcq"
Jul 09 00:56:06.816505 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.816484    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 00:56:06.816505 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.816502    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4kshp\""
Jul 09 00:56:06.816666 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.816622    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 00:56:06.852127 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f3a5efef-8d70-422c-9734-0da95678328e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9n8r\" (UID: \"f3a5efef-8d70-422c-9734-0da95678328e\") " pod="openshift-insights/insights-runtime-extractor-p9n8r"
Jul 09 00:56:06.852127 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a1651df-abf2-4c74-8783-5cc32699d298-config-volume\") pod \"dns-default-hmhcq\" (UID: \"1a1651df-abf2-4c74-8783-5cc32699d298\") " pod="openshift-dns/dns-default-hmhcq"
Jul 09 00:56:06.852355 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852153    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dqlb\" (UniqueName: \"kubernetes.io/projected/f3a5efef-8d70-422c-9734-0da95678328e-kube-api-access-4dqlb\") pod \"insights-runtime-extractor-p9n8r\" (UID: \"f3a5efef-8d70-422c-9734-0da95678328e\") " pod="openshift-insights/insights-runtime-extractor-p9n8r"
Jul 09 00:56:06.852355 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-bound-sa-token\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.852355 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852247    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2475349-184c-40c1-8825-45e4b8c349fe-cert\") pod \"ingress-canary-dtmg6\" (UID: \"e2475349-184c-40c1-8825-45e4b8c349fe\") " pod="openshift-ingress-canary/ingress-canary-dtmg6"
Jul 09 00:56:06.852355 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852284    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-ca-trust-extracted\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.852355 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvfq6\" (UniqueName: \"kubernetes.io/projected/1a1651df-abf2-4c74-8783-5cc32699d298-kube-api-access-hvfq6\") pod \"dns-default-hmhcq\" (UID: \"1a1651df-abf2-4c74-8783-5cc32699d298\") " pod="openshift-dns/dns-default-hmhcq"
Jul 09 00:56:06.852590 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852392    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f3a5efef-8d70-422c-9734-0da95678328e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p9n8r\" (UID: \"f3a5efef-8d70-422c-9734-0da95678328e\") " pod="openshift-insights/insights-runtime-extractor-p9n8r"
Jul 09 00:56:06.852590 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3a5efef-8d70-422c-9734-0da95678328e-data-volume\") pod \"insights-runtime-extractor-p9n8r\" (UID: \"f3a5efef-8d70-422c-9734-0da95678328e\") " pod="openshift-insights/insights-runtime-extractor-p9n8r"
Jul 09 00:56:06.852590 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-registry-tls\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.852590 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a1651df-abf2-4c74-8783-5cc32699d298-metrics-tls\") pod \"dns-default-hmhcq\" (UID: \"1a1651df-abf2-4c74-8783-5cc32699d298\") " pod="openshift-dns/dns-default-hmhcq"
Jul 09 00:56:06.852590 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-trusted-ca\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.852590 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z57lc\" (UniqueName: \"kubernetes.io/projected/e2475349-184c-40c1-8825-45e4b8c349fe-kube-api-access-z57lc\") pod \"ingress-canary-dtmg6\" (UID: \"e2475349-184c-40c1-8825-45e4b8c349fe\") " pod="openshift-ingress-canary/ingress-canary-dtmg6"
Jul 09 00:56:06.852843 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852674    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-ca-trust-extracted\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.852843 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a1651df-abf2-4c74-8783-5cc32699d298-tmp-dir\") pod \"dns-default-hmhcq\" (UID: \"1a1651df-abf2-4c74-8783-5cc32699d298\") " pod="openshift-dns/dns-default-hmhcq"
Jul 09 00:56:06.852843 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852797    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f3a5efef-8d70-422c-9734-0da95678328e-crio-socket\") pod \"insights-runtime-extractor-p9n8r\" (UID: \"f3a5efef-8d70-422c-9734-0da95678328e\") " pod="openshift-insights/insights-runtime-extractor-p9n8r"
Jul 09 00:56:06.852843 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-registry-certificates\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.853028 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-image-registry-private-configuration\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.853028 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-installation-pull-secrets\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.853028 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz8ft\" (UniqueName: \"kubernetes.io/projected/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-kube-api-access-cz8ft\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.853028 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852937    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3a5efef-8d70-422c-9734-0da95678328e-data-volume\") pod \"insights-runtime-extractor-p9n8r\" (UID: \"f3a5efef-8d70-422c-9734-0da95678328e\") " pod="openshift-insights/insights-runtime-extractor-p9n8r"
Jul 09 00:56:06.853028 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852955    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f3a5efef-8d70-422c-9734-0da95678328e-crio-socket\") pod \"insights-runtime-extractor-p9n8r\" (UID: \"f3a5efef-8d70-422c-9734-0da95678328e\") " pod="openshift-insights/insights-runtime-extractor-p9n8r"
Jul 09 00:56:06.853028 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.852986    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f3a5efef-8d70-422c-9734-0da95678328e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p9n8r\" (UID: \"f3a5efef-8d70-422c-9734-0da95678328e\") " pod="openshift-insights/insights-runtime-extractor-p9n8r"
Jul 09 00:56:06.853834 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.853807    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-registry-certificates\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.854067 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.854049    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-trusted-ca\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.856561 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.856538    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-installation-pull-secrets\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.856675 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.856538    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-image-registry-private-configuration\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.856675 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.856570    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f3a5efef-8d70-422c-9734-0da95678328e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9n8r\" (UID: \"f3a5efef-8d70-422c-9734-0da95678328e\") " pod="openshift-insights/insights-runtime-extractor-p9n8r"
Jul 09 00:56:06.856675 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.856585    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2475349-184c-40c1-8825-45e4b8c349fe-cert\") pod \"ingress-canary-dtmg6\" (UID: \"e2475349-184c-40c1-8825-45e4b8c349fe\") " pod="openshift-ingress-canary/ingress-canary-dtmg6"
Jul 09 00:56:06.856836 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.856686    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-registry-tls\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.859554 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.859535    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dqlb\" (UniqueName: \"kubernetes.io/projected/f3a5efef-8d70-422c-9734-0da95678328e-kube-api-access-4dqlb\") pod \"insights-runtime-extractor-p9n8r\" (UID: \"f3a5efef-8d70-422c-9734-0da95678328e\") " pod="openshift-insights/insights-runtime-extractor-p9n8r"
Jul 09 00:56:06.859689 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.859672    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-bound-sa-token\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.860114 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.860096    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz8ft\" (UniqueName: \"kubernetes.io/projected/88d009d0-16d5-47bc-84a7-6ef378bfa8ed-kube-api-access-cz8ft\") pod \"image-registry-7d7bb587-w4gzp\" (UID: \"88d009d0-16d5-47bc-84a7-6ef378bfa8ed\") " pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:06.860310 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.860291    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z57lc\" (UniqueName: \"kubernetes.io/projected/e2475349-184c-40c1-8825-45e4b8c349fe-kube-api-access-z57lc\") pod \"ingress-canary-dtmg6\" (UID: \"e2475349-184c-40c1-8825-45e4b8c349fe\") " pod="openshift-ingress-canary/ingress-canary-dtmg6"
Jul 09 00:56:06.953945 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.953906    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvfq6\" (UniqueName: \"kubernetes.io/projected/1a1651df-abf2-4c74-8783-5cc32699d298-kube-api-access-hvfq6\") pod \"dns-default-hmhcq\" (UID: \"1a1651df-abf2-4c74-8783-5cc32699d298\") " pod="openshift-dns/dns-default-hmhcq"
Jul 09 00:56:06.954116 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.953961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a1651df-abf2-4c74-8783-5cc32699d298-metrics-tls\") pod \"dns-default-hmhcq\" (UID: \"1a1651df-abf2-4c74-8783-5cc32699d298\") " pod="openshift-dns/dns-default-hmhcq"
Jul 09 00:56:06.954164 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.954143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a1651df-abf2-4c74-8783-5cc32699d298-tmp-dir\") pod \"dns-default-hmhcq\" (UID: \"1a1651df-abf2-4c74-8783-5cc32699d298\") " pod="openshift-dns/dns-default-hmhcq"
Jul 09 00:56:06.954251 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.954237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a1651df-abf2-4c74-8783-5cc32699d298-config-volume\") pod \"dns-default-hmhcq\" (UID: \"1a1651df-abf2-4c74-8783-5cc32699d298\") " pod="openshift-dns/dns-default-hmhcq"
Jul 09 00:56:06.954686 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.954666    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a1651df-abf2-4c74-8783-5cc32699d298-config-volume\") pod \"dns-default-hmhcq\" (UID: \"1a1651df-abf2-4c74-8783-5cc32699d298\") " pod="openshift-dns/dns-default-hmhcq"
Jul 09 00:56:06.956258 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.956238    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a1651df-abf2-4c74-8783-5cc32699d298-metrics-tls\") pod \"dns-default-hmhcq\" (UID: \"1a1651df-abf2-4c74-8783-5cc32699d298\") " pod="openshift-dns/dns-default-hmhcq"
Jul 09 00:56:06.961511 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.961491    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvfq6\" (UniqueName: \"kubernetes.io/projected/1a1651df-abf2-4c74-8783-5cc32699d298-kube-api-access-hvfq6\") pod \"dns-default-hmhcq\" (UID: \"1a1651df-abf2-4c74-8783-5cc32699d298\") " pod="openshift-dns/dns-default-hmhcq"
Jul 09 00:56:06.962498 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:06.962480    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a1651df-abf2-4c74-8783-5cc32699d298-tmp-dir\") pod \"dns-default-hmhcq\" (UID: \"1a1651df-abf2-4c74-8783-5cc32699d298\") " pod="openshift-dns/dns-default-hmhcq"
Jul 09 00:56:07.013564 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:07.013479    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:07.026609 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:07.026575    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dtmg6"
Jul 09 00:56:07.041905 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:07.041881    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p9n8r"
Jul 09 00:56:07.124519 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:07.122075    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmhcq"
Jul 09 00:56:07.208731 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:07.208518    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p9n8r"]
Jul 09 00:56:07.229733 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:07.229097    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dtmg6"]
Jul 09 00:56:07.234299 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:07.233200    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d7bb587-w4gzp"]
Jul 09 00:56:07.240467 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:56:07.240437    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d009d0_16d5_47bc_84a7_6ef378bfa8ed.slice/crio-20f1b70265bd88d40c5e8acd75a6df86d3b31f1b33ec4b03bdbc67b87763354b WatchSource:0}: Error finding container 20f1b70265bd88d40c5e8acd75a6df86d3b31f1b33ec4b03bdbc67b87763354b: Status 404 returned error can't find the container with id 20f1b70265bd88d40c5e8acd75a6df86d3b31f1b33ec4b03bdbc67b87763354b
Jul 09 00:56:07.302193 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:07.302154    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmhcq"]
Jul 09 00:56:07.305743 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:56:07.305713    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1651df_abf2_4c74_8783_5cc32699d298.slice/crio-71951c9f2bbb5d55f447d71a071ef46b54aa136773202b7cd57bbb7319bbdbe6 WatchSource:0}: Error finding container 71951c9f2bbb5d55f447d71a071ef46b54aa136773202b7cd57bbb7319bbdbe6: Status 404 returned error can't find the container with id 71951c9f2bbb5d55f447d71a071ef46b54aa136773202b7cd57bbb7319bbdbe6
Jul 09 00:56:07.895413 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:07.895381    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dtmg6" event={"ID":"e2475349-184c-40c1-8825-45e4b8c349fe","Type":"ContainerStarted","Data":"7d5c523f7f3bf6aad929d65fa5dc61d187a79dbc91e5992ca9497602227afd1f"}
Jul 09 00:56:07.896794 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:07.896762    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d7bb587-w4gzp" event={"ID":"88d009d0-16d5-47bc-84a7-6ef378bfa8ed","Type":"ContainerStarted","Data":"937a3968ea3d5fc29ed96fffa07712f37881e4a7a1c28d162cefab8f0dadb7d0"}
Jul 09 00:56:07.896900 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:07.896801    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d7bb587-w4gzp" event={"ID":"88d009d0-16d5-47bc-84a7-6ef378bfa8ed","Type":"ContainerStarted","Data":"20f1b70265bd88d40c5e8acd75a6df86d3b31f1b33ec4b03bdbc67b87763354b"}
Jul 09 00:56:07.896900 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:07.896835    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:07.897858 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:07.897839    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmhcq" event={"ID":"1a1651df-abf2-4c74-8783-5cc32699d298","Type":"ContainerStarted","Data":"71951c9f2bbb5d55f447d71a071ef46b54aa136773202b7cd57bbb7319bbdbe6"}
Jul 09 00:56:07.898852 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:07.898833    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p9n8r" event={"ID":"f3a5efef-8d70-422c-9734-0da95678328e","Type":"ContainerStarted","Data":"999cc3a4d02b5bd23ab2f4a70ddf3cfb3de7e75b38afad6fbb174dcd0ccebe17"}
Jul 09 00:56:07.917379 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:07.917324    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d7bb587-w4gzp" podStartSLOduration=2.917308337 podStartE2EDuration="2.917308337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:56:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:07.916231664 +0000 UTC m=+52.979726368" watchObservedRunningTime="2026-07-09 00:56:07.917308337 +0000 UTC m=+52.980803034"
Jul 09 00:56:08.500889 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:08.500648    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:56:08.511675 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:08.506144    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:56:08.511675 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:08.508191    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-htn6x\""
Jul 09 00:56:08.511675 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:08.508514    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 00:56:08.511675 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:08.508880    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 00:56:08.511675 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:08.510407    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:56:08.514230 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:08.513241    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 00:56:08.514230 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:08.513524    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 00:56:08.514230 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:08.513743    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jpd88\""
Jul 09 00:56:08.871980 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:08.871904    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntp5p"]
Jul 09 00:56:08.885012 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:08.884982    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntp5p"]
Jul 09 00:56:08.885173 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:08.885103    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntp5p"
Jul 09 00:56:08.887822 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:08.887797    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 09 00:56:08.888427 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:08.888238    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cg4p6\""
Jul 09 00:56:08.974454 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:08.974415    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c1306b82-e105-44f1-b1c9-bad475b4b691-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ntp5p\" (UID: \"c1306b82-e105-44f1-b1c9-bad475b4b691\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntp5p"
Jul 09 00:56:09.075819 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:09.075780    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c1306b82-e105-44f1-b1c9-bad475b4b691-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ntp5p\" (UID: \"c1306b82-e105-44f1-b1c9-bad475b4b691\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntp5p"
Jul 09 00:56:09.076008 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:09.075965    2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 09 00:56:09.076067 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:09.076048    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1306b82-e105-44f1-b1c9-bad475b4b691-tls-certificates podName:c1306b82-e105-44f1-b1c9-bad475b4b691 nodeName:}" failed. No retries permitted until 2026-07-09 00:56:09.576026571 +0000 UTC m=+54.639521263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/c1306b82-e105-44f1-b1c9-bad475b4b691-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-ntp5p" (UID: "c1306b82-e105-44f1-b1c9-bad475b4b691") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 09 00:56:09.579513 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:09.579477    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c1306b82-e105-44f1-b1c9-bad475b4b691-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ntp5p\" (UID: \"c1306b82-e105-44f1-b1c9-bad475b4b691\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntp5p"
Jul 09 00:56:09.579703 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:09.579658    2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 09 00:56:09.579770 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:09.579725    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1306b82-e105-44f1-b1c9-bad475b4b691-tls-certificates podName:c1306b82-e105-44f1-b1c9-bad475b4b691 nodeName:}" failed. No retries permitted until 2026-07-09 00:56:10.579709336 +0000 UTC m=+55.643204018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/c1306b82-e105-44f1-b1c9-bad475b4b691-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-ntp5p" (UID: "c1306b82-e105-44f1-b1c9-bad475b4b691") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 09 00:56:09.938933 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:09.938857    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-sjl6z"]
Jul 09 00:56:09.971473 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:09.971445    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-sjl6z"]
Jul 09 00:56:09.971644 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:09.971537    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-sjl6z"
Jul 09 00:56:09.975022 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:09.974984    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 00:56:09.975405 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:09.975096    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-krz2c\""
Jul 09 00:56:09.975405 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:09.975101    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 00:56:09.982880 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:09.982857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcb9c\" (UniqueName: \"kubernetes.io/projected/520c55e3-aabc-4449-8f91-f155b6fa6b5f-kube-api-access-qcb9c\") pod \"downloads-685bfb5f64-sjl6z\" (UID: \"520c55e3-aabc-4449-8f91-f155b6fa6b5f\") " pod="openshift-console/downloads-685bfb5f64-sjl6z"
Jul 09 00:56:10.083496 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:10.083459    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcb9c\" (UniqueName: \"kubernetes.io/projected/520c55e3-aabc-4449-8f91-f155b6fa6b5f-kube-api-access-qcb9c\") pod \"downloads-685bfb5f64-sjl6z\" (UID: \"520c55e3-aabc-4449-8f91-f155b6fa6b5f\") " pod="openshift-console/downloads-685bfb5f64-sjl6z"
Jul 09 00:56:10.091725 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:10.091697    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcb9c\" (UniqueName: \"kubernetes.io/projected/520c55e3-aabc-4449-8f91-f155b6fa6b5f-kube-api-access-qcb9c\") pod \"downloads-685bfb5f64-sjl6z\" (UID: \"520c55e3-aabc-4449-8f91-f155b6fa6b5f\") " pod="openshift-console/downloads-685bfb5f64-sjl6z"
Jul 09 00:56:10.282478 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:10.282434    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-sjl6z"
Jul 09 00:56:10.587993 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:10.587895    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c1306b82-e105-44f1-b1c9-bad475b4b691-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ntp5p\" (UID: \"c1306b82-e105-44f1-b1c9-bad475b4b691\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntp5p"
Jul 09 00:56:10.590391 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:10.590361    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c1306b82-e105-44f1-b1c9-bad475b4b691-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-ntp5p\" (UID: \"c1306b82-e105-44f1-b1c9-bad475b4b691\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntp5p"
Jul 09 00:56:10.697420 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:10.697387    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntp5p"
Jul 09 00:56:13.081763 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:13.081706    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntp5p"]
Jul 09 00:56:13.085650 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:56:13.085625    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1306b82_e105_44f1_b1c9_bad475b4b691.slice/crio-d8a2c8aa693c0dc748b2c7e3ef38a2069674329aff2cca7d21cf5ed594e1e8d0 WatchSource:0}: Error finding container d8a2c8aa693c0dc748b2c7e3ef38a2069674329aff2cca7d21cf5ed594e1e8d0: Status 404 returned error can't find the container with id d8a2c8aa693c0dc748b2c7e3ef38a2069674329aff2cca7d21cf5ed594e1e8d0
Jul 09 00:56:13.100654 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:13.100364    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-sjl6z"]
Jul 09 00:56:13.108354 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:56:13.108289    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod520c55e3_aabc_4449_8f91_f155b6fa6b5f.slice/crio-f5b3a6282e2e7189f79d9a782ebd5bc85f6f35fc5f26014268d6d0221f2bc76c WatchSource:0}: Error finding container f5b3a6282e2e7189f79d9a782ebd5bc85f6f35fc5f26014268d6d0221f2bc76c: Status 404 returned error can't find the container with id f5b3a6282e2e7189f79d9a782ebd5bc85f6f35fc5f26014268d6d0221f2bc76c
Jul 09 00:56:13.921500 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:13.921414    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p9n8r" event={"ID":"f3a5efef-8d70-422c-9734-0da95678328e","Type":"ContainerStarted","Data":"b57b7b1b085a92d754b587bdf2a3739cf58ed89d4a3cd2e2d8fcafefefcce0aa"}
Jul 09 00:56:13.921678 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:13.921491    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p9n8r" event={"ID":"f3a5efef-8d70-422c-9734-0da95678328e","Type":"ContainerStarted","Data":"388c2f7c4075975c03291c2ab450374bff7f5bd186b006a63adc716c104b605a"}
Jul 09 00:56:13.923104 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:13.923074    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-sjl6z" event={"ID":"520c55e3-aabc-4449-8f91-f155b6fa6b5f","Type":"ContainerStarted","Data":"f5b3a6282e2e7189f79d9a782ebd5bc85f6f35fc5f26014268d6d0221f2bc76c"}
Jul 09 00:56:13.925138 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:13.925112    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dtmg6" event={"ID":"e2475349-184c-40c1-8825-45e4b8c349fe","Type":"ContainerStarted","Data":"785c9034d70d04b00d9542f64f433d27b5947f447e3e86f14bc2a6478d41d127"}
Jul 09 00:56:13.926453 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:13.926426    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntp5p" event={"ID":"c1306b82-e105-44f1-b1c9-bad475b4b691","Type":"ContainerStarted","Data":"d8a2c8aa693c0dc748b2c7e3ef38a2069674329aff2cca7d21cf5ed594e1e8d0"}
Jul 09 00:56:13.928400 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:13.928376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmhcq" event={"ID":"1a1651df-abf2-4c74-8783-5cc32699d298","Type":"ContainerStarted","Data":"19fb06fee0d1104166c74370b0648d4008d7368323905befa5feeb93fb271272"}
Jul 09 00:56:13.928510 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:13.928423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmhcq" event={"ID":"1a1651df-abf2-4c74-8783-5cc32699d298","Type":"ContainerStarted","Data":"a02fb819c513727b63a2ad23284f3eacee574e933360eba65e98d579978febe3"}
Jul 09 00:56:13.928772 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:13.928753    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hmhcq"
Jul 09 00:56:13.941033 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:13.940989    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dtmg6" podStartSLOduration=2.248624548 podStartE2EDuration="7.94097235s" totalImagesPullingTime="5.692347802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:56:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:13.940190633 +0000 UTC m=+59.003685339" watchObservedRunningTime="2026-07-09 00:56:13.94097235 +0000 UTC m=+59.004467036"
Jul 09 00:56:13.955134 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:13.955080    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hmhcq" podStartSLOduration=2.333400093 podStartE2EDuration="7.955063861s" totalImagesPullingTime="5.621663768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:56:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:13.954306293 +0000 UTC m=+59.017801000" watchObservedRunningTime="2026-07-09 00:56:13.955063861 +0000 UTC m=+59.018558639"
Jul 09 00:56:14.934611 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:14.934567    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntp5p" event={"ID":"c1306b82-e105-44f1-b1c9-bad475b4b691","Type":"ContainerStarted","Data":"55f70f1c9d824702c351e7731f5daf603adc57f0ebf886c26f131cf7571dafbe"}
Jul 09 00:56:14.949540 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:14.949483    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntp5p" podStartSLOduration=5.546019887 podStartE2EDuration="6.949462729s" totalImagesPullingTime="1.403442842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:56:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:14.948647169 +0000 UTC m=+60.012141875" watchObservedRunningTime="2026-07-09 00:56:14.949462729 +0000 UTC m=+60.012957436"
Jul 09 00:56:15.844310 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:15.844276    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn6t5"
Jul 09 00:56:15.938389 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:15.938360    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntp5p"
Jul 09 00:56:15.944581 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:15.944554    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-ntp5p"
Jul 09 00:56:16.943975 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:16.943892    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p9n8r" event={"ID":"f3a5efef-8d70-422c-9734-0da95678328e","Type":"ContainerStarted","Data":"c2e75fe40eddbeae79ad7bdd865a4e56cf5f6b9b495826271b8a2197b748c7bf"}
Jul 09 00:56:16.964392 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:16.964336    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p9n8r" podStartSLOduration=1.849637567 podStartE2EDuration="10.964314155s" totalImagesPullingTime="9.114676588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:56:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:16.962982809 +0000 UTC m=+62.026477531" watchObservedRunningTime="2026-07-09 00:56:16.964314155 +0000 UTC m=+62.027808860"
Jul 09 00:56:21.179246 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.179187    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret\") pod \"global-pull-secret-syncer-8vx5f\" (UID: \"93c25998-c800-4bf5-90cb-173986d24386\") " pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:56:21.179689 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.179294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs\") pod \"network-metrics-daemon-6jcwt\" (UID: \"0c3cdb55-354c-454f-b498-64c2a1a329ee\") " pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:56:21.181651 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.181628    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 00:56:21.182411 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.182390    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 00:56:21.192518 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.192490    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3cdb55-354c-454f-b498-64c2a1a329ee-metrics-certs\") pod \"network-metrics-daemon-6jcwt\" (UID: \"0c3cdb55-354c-454f-b498-64c2a1a329ee\") " pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:56:21.192652 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.192555    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93c25998-c800-4bf5-90cb-173986d24386-original-pull-secret\") pod \"global-pull-secret-syncer-8vx5f\" (UID: \"93c25998-c800-4bf5-90cb-173986d24386\") " pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:56:21.279958 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.279914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdc6n\" (UniqueName: \"kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n\") pod \"network-check-target-bbw2n\" (UID: \"4544db24-d746-4f38-896b-bdda644ee5ce\") " pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:56:21.282819 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.282798    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 00:56:21.292871 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.292845    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 00:56:21.303642 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.303612    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdc6n\" (UniqueName: \"kubernetes.io/projected/4544db24-d746-4f38-896b-bdda644ee5ce-kube-api-access-vdc6n\") pod \"network-check-target-bbw2n\" (UID: \"4544db24-d746-4f38-896b-bdda644ee5ce\") " pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:56:21.431088 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.430999    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-htn6x\""
Jul 09 00:56:21.438812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.438781    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:56:21.442185 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.442157    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jpd88\""
Jul 09 00:56:21.446161 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.446133    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8vx5f"
Jul 09 00:56:21.450321 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.450232    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcwt"
Jul 09 00:56:21.601264 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.601033    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bbw2n"]
Jul 09 00:56:21.605267 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:56:21.605224    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4544db24_d746_4f38_896b_bdda644ee5ce.slice/crio-3deb1813d1dca387b37904f475c89a6b578849e8c8103ec3cf77bd57738f0e54 WatchSource:0}: Error finding container 3deb1813d1dca387b37904f475c89a6b578849e8c8103ec3cf77bd57738f0e54: Status 404 returned error can't find the container with id 3deb1813d1dca387b37904f475c89a6b578849e8c8103ec3cf77bd57738f0e54
Jul 09 00:56:21.614179 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.614141    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8vx5f"]
Jul 09 00:56:21.617115 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:56:21.617088    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c25998_c800_4bf5_90cb_173986d24386.slice/crio-430f54b27420a5d84a0bba092be11e29ccc831c7222b62531a8b56dcfcacd79e WatchSource:0}: Error finding container 430f54b27420a5d84a0bba092be11e29ccc831c7222b62531a8b56dcfcacd79e: Status 404 returned error can't find the container with id 430f54b27420a5d84a0bba092be11e29ccc831c7222b62531a8b56dcfcacd79e
Jul 09 00:56:21.631939 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.631917    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6jcwt"]
Jul 09 00:56:21.635137 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:56:21.635115    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3cdb55_354c_454f_b498_64c2a1a329ee.slice/crio-e6d778cd9d7a49f0fd477cb8a4d92c30bd088e18de0f7c3cb17c271f750d095b WatchSource:0}: Error finding container e6d778cd9d7a49f0fd477cb8a4d92c30bd088e18de0f7c3cb17c271f750d095b: Status 404 returned error can't find the container with id e6d778cd9d7a49f0fd477cb8a4d92c30bd088e18de0f7c3cb17c271f750d095b
Jul 09 00:56:21.962399 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.962363    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bbw2n" event={"ID":"4544db24-d746-4f38-896b-bdda644ee5ce","Type":"ContainerStarted","Data":"3deb1813d1dca387b37904f475c89a6b578849e8c8103ec3cf77bd57738f0e54"}
Jul 09 00:56:21.963690 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.963654    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6jcwt" event={"ID":"0c3cdb55-354c-454f-b498-64c2a1a329ee","Type":"ContainerStarted","Data":"e6d778cd9d7a49f0fd477cb8a4d92c30bd088e18de0f7c3cb17c271f750d095b"}
Jul 09 00:56:21.964978 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:21.964950    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8vx5f" event={"ID":"93c25998-c800-4bf5-90cb-173986d24386","Type":"ContainerStarted","Data":"430f54b27420a5d84a0bba092be11e29ccc831c7222b62531a8b56dcfcacd79e"}
Jul 09 00:56:22.980971 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:22.980931    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6jcwt" event={"ID":"0c3cdb55-354c-454f-b498-64c2a1a329ee","Type":"ContainerStarted","Data":"3a2041200323583f8cc423b220e6cc2bfbe68143273db87456dfce83ca14dad6"}
Jul 09 00:56:23.937274 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:23.937240    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hmhcq"
Jul 09 00:56:23.986650 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:23.986608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6jcwt" event={"ID":"0c3cdb55-354c-454f-b498-64c2a1a329ee","Type":"ContainerStarted","Data":"7e7d0a9e18208ebe6f2855f7cd5fa3142a18ce88411f54350f5ee56e124a7e0e"}
Jul 09 00:56:24.002921 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.002875    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6jcwt" podStartSLOduration=66.825881263 podStartE2EDuration="1m8.002856622s" totalImagesPullingTime="1.176975359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:24.002527077 +0000 UTC m=+69.066021784" watchObservedRunningTime="2026-07-09 00:56:24.002856622 +0000 UTC m=+69.066351327"
Jul 09 00:56:24.230823 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.230715    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c8d9588dc-ftkmx"]
Jul 09 00:56:24.248789 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.248734    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c8d9588dc-ftkmx"]
Jul 09 00:56:24.248958 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.248838    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.251182 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.251153    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 00:56:24.251628 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.251609    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 00:56:24.251951 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.251817    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-svrtq\""
Jul 09 00:56:24.252101 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.252078    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 00:56:24.252183 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.252078    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 00:56:24.252183 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.252127    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 00:56:24.261673 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.261648    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 00:56:24.305402 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.305348    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-console-config\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.305587 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.305408    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hf5c\" (UniqueName: \"kubernetes.io/projected/d21d96a0-a994-448c-86a6-ce2967c8e789-kube-api-access-5hf5c\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.305587 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.305440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d21d96a0-a994-448c-86a6-ce2967c8e789-console-oauth-config\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.305587 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.305556    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-service-ca\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.305748 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.305597    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-trusted-ca-bundle\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.305748 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.305634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d21d96a0-a994-448c-86a6-ce2967c8e789-console-serving-cert\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.305748 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.305658    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-oauth-serving-cert\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.406363 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.406322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hf5c\" (UniqueName: \"kubernetes.io/projected/d21d96a0-a994-448c-86a6-ce2967c8e789-kube-api-access-5hf5c\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.406566 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.406381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d21d96a0-a994-448c-86a6-ce2967c8e789-console-oauth-config\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.406566 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.406446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-service-ca\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.406566 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.406476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-trusted-ca-bundle\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.406920 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.406890    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d21d96a0-a994-448c-86a6-ce2967c8e789-console-serving-cert\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.407011 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.406940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-oauth-serving-cert\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.407011 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.406985    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-console-config\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.407300 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.407273    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-service-ca\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.407529 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.407504    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-trusted-ca-bundle\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.407671 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.407652    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-console-config\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.407897 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.407854    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-oauth-serving-cert\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.409853 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.409824    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d21d96a0-a994-448c-86a6-ce2967c8e789-console-oauth-config\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.409948 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.409901    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d21d96a0-a994-448c-86a6-ce2967c8e789-console-serving-cert\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.414192 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.414173    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hf5c\" (UniqueName: \"kubernetes.io/projected/d21d96a0-a994-448c-86a6-ce2967c8e789-kube-api-access-5hf5c\") pod \"console-7c8d9588dc-ftkmx\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") " pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:24.570075 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:24.570029    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:26.267899 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.267865    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"]
Jul 09 00:56:26.270326 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.270304    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"
Jul 09 00:56:26.273580 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.273464    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 00:56:26.273580 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.273475    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-hzmmh\""
Jul 09 00:56:26.273580 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.273522    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 09 00:56:26.273580 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.273533    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 09 00:56:26.273580 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.273480    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 00:56:26.273580 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.273474    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 00:56:26.281011 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.280988    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"]
Jul 09 00:56:26.315533 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.315503    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7chjs"]
Jul 09 00:56:26.318129 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.318110    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.320562 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.320524    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 00:56:26.320711 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.320573    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 00:56:26.320711 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.320605    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q82vn\""
Jul 09 00:56:26.320711 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.320574    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 00:56:26.322552 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.322529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2cn2\" (UniqueName: \"kubernetes.io/projected/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-kube-api-access-n2cn2\") pod \"openshift-state-metrics-54cf96dfcf-5g6jx\" (UID: \"1ccc9ff8-04d7-4272-b414-d60fd6a7f515\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"
Jul 09 00:56:26.322668 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.322599    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5g6jx\" (UID: \"1ccc9ff8-04d7-4272-b414-d60fd6a7f515\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"
Jul 09 00:56:26.322668 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.322648    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5g6jx\" (UID: \"1ccc9ff8-04d7-4272-b414-d60fd6a7f515\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"
Jul 09 00:56:26.322785 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.322698    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5g6jx\" (UID: \"1ccc9ff8-04d7-4272-b414-d60fd6a7f515\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"
Jul 09 00:56:26.423321 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.423289    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5g6jx\" (UID: \"1ccc9ff8-04d7-4272-b414-d60fd6a7f515\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"
Jul 09 00:56:26.423501 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.423342    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-tls\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.423501 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.423375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5g6jx\" (UID: \"1ccc9ff8-04d7-4272-b414-d60fd6a7f515\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"
Jul 09 00:56:26.423501 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.423419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2cn2\" (UniqueName: \"kubernetes.io/projected/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-kube-api-access-n2cn2\") pod \"openshift-state-metrics-54cf96dfcf-5g6jx\" (UID: \"1ccc9ff8-04d7-4272-b414-d60fd6a7f515\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"
Jul 09 00:56:26.423501 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:26.423432    2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 09 00:56:26.423501 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.423446    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e886194-d4ac-49cc-9f50-5f4717186857-metrics-client-ca\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.423740 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:26.423511    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-openshift-state-metrics-tls podName:1ccc9ff8-04d7-4272-b414-d60fd6a7f515 nodeName:}" failed. No retries permitted until 2026-07-09 00:56:26.9234877 +0000 UTC m=+71.986982386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-5g6jx" (UID: "1ccc9ff8-04d7-4272-b414-d60fd6a7f515") : secret "openshift-state-metrics-tls" not found
Jul 09 00:56:26.423740 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.423579    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.423740 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.423620    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-wtmp\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.423740 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.423668    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e886194-d4ac-49cc-9f50-5f4717186857-sys\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.423740 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.423704    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-accelerators-collector-config\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.423740 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.423730    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-textfile\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.424040 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.423774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5g6jx\" (UID: \"1ccc9ff8-04d7-4272-b414-d60fd6a7f515\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"
Jul 09 00:56:26.424040 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.423810    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89npf\" (UniqueName: \"kubernetes.io/projected/5e886194-d4ac-49cc-9f50-5f4717186857-kube-api-access-89npf\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.424040 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.423842    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5e886194-d4ac-49cc-9f50-5f4717186857-root\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.424480 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.424457    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5g6jx\" (UID: \"1ccc9ff8-04d7-4272-b414-d60fd6a7f515\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"
Jul 09 00:56:26.426145 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.426123    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5g6jx\" (UID: \"1ccc9ff8-04d7-4272-b414-d60fd6a7f515\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"
Jul 09 00:56:26.431973 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.431950    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2cn2\" (UniqueName: \"kubernetes.io/projected/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-kube-api-access-n2cn2\") pod \"openshift-state-metrics-54cf96dfcf-5g6jx\" (UID: \"1ccc9ff8-04d7-4272-b414-d60fd6a7f515\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"
Jul 09 00:56:26.524974 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.524885    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e886194-d4ac-49cc-9f50-5f4717186857-metrics-client-ca\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.524974 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.524946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.525194 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.524982    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-wtmp\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.525194 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.525010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e886194-d4ac-49cc-9f50-5f4717186857-sys\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.525194 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.525073    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e886194-d4ac-49cc-9f50-5f4717186857-sys\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.525194 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.525154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-accelerators-collector-config\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.525194 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.525178    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-wtmp\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.525469 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.525202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-textfile\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.525469 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.525260    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89npf\" (UniqueName: \"kubernetes.io/projected/5e886194-d4ac-49cc-9f50-5f4717186857-kube-api-access-89npf\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.525469 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.525296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5e886194-d4ac-49cc-9f50-5f4717186857-root\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.525469 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.525352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-tls\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.525691 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.525473    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5e886194-d4ac-49cc-9f50-5f4717186857-root\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.525691 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:26.525593    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 09 00:56:26.525691 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.525632    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e886194-d4ac-49cc-9f50-5f4717186857-metrics-client-ca\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.525691 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:26.525671    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-tls podName:5e886194-d4ac-49cc-9f50-5f4717186857 nodeName:}" failed. No retries permitted until 2026-07-09 00:56:27.025651547 +0000 UTC m=+72.089146245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-tls") pod "node-exporter-7chjs" (UID: "5e886194-d4ac-49cc-9f50-5f4717186857") : secret "node-exporter-tls" not found
Jul 09 00:56:26.525879 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.525663    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-textfile\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.525961 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.525941    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-accelerators-collector-config\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.527714 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.527690    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.535772 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.535739    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89npf\" (UniqueName: \"kubernetes.io/projected/5e886194-d4ac-49cc-9f50-5f4717186857-kube-api-access-89npf\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:26.929036 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:26.928937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5g6jx\" (UID: \"1ccc9ff8-04d7-4272-b414-d60fd6a7f515\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"
Jul 09 00:56:26.929226 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:26.929107    2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 09 00:56:26.929226 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:56:26.929202    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-openshift-state-metrics-tls podName:1ccc9ff8-04d7-4272-b414-d60fd6a7f515 nodeName:}" failed. No retries permitted until 2026-07-09 00:56:27.929182148 +0000 UTC m=+72.992676848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-5g6jx" (UID: "1ccc9ff8-04d7-4272-b414-d60fd6a7f515") : secret "openshift-state-metrics-tls" not found
Jul 09 00:56:27.019196 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:27.019154    2565 patch_prober.go:28] interesting pod/image-registry-7d7bb587-w4gzp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 09 00:56:27.019403 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:27.019249    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7d7bb587-w4gzp" podUID="88d009d0-16d5-47bc-84a7-6ef378bfa8ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 00:56:27.030266 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:27.030223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-tls\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:27.033228 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:27.033186    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e886194-d4ac-49cc-9f50-5f4717186857-node-exporter-tls\") pod \"node-exporter-7chjs\" (UID: \"5e886194-d4ac-49cc-9f50-5f4717186857\") " pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:27.229120 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:27.229044    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7chjs"
Jul 09 00:56:27.939983 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:27.939944    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5g6jx\" (UID: \"1ccc9ff8-04d7-4272-b414-d60fd6a7f515\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"
Jul 09 00:56:27.942567 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:27.942542    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ccc9ff8-04d7-4272-b414-d60fd6a7f515-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5g6jx\" (UID: \"1ccc9ff8-04d7-4272-b414-d60fd6a7f515\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"
Jul 09 00:56:28.081625 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:28.081584    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"
Jul 09 00:56:28.907809 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:28.907779    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d7bb587-w4gzp"
Jul 09 00:56:30.461818 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.461778    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5945849c67-6qwlr"]
Jul 09 00:56:30.478614 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.478574    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5945849c67-6qwlr"]
Jul 09 00:56:30.478775 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.478696    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.481983 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.481928    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 00:56:30.482148 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.481993    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ck849\""
Jul 09 00:56:30.482274 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.482256    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 00:56:30.482473 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.482453    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 00:56:30.482597 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.482578    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 00:56:30.487129 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.483518    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-eam4kup3dd67c\""
Jul 09 00:56:30.561714 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.561676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/189fe576-ca53-4362-aeb0-f807952b54f3-client-ca-bundle\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.561714 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.561719    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbmqs\" (UniqueName: \"kubernetes.io/projected/189fe576-ca53-4362-aeb0-f807952b54f3-kube-api-access-qbmqs\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.561972 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.561878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/189fe576-ca53-4362-aeb0-f807952b54f3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.561972 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.561916    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/189fe576-ca53-4362-aeb0-f807952b54f3-audit-log\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.561972 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.561945    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/189fe576-ca53-4362-aeb0-f807952b54f3-secret-metrics-server-client-certs\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.562111 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.561991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/189fe576-ca53-4362-aeb0-f807952b54f3-secret-metrics-server-tls\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.562111 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.562027    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/189fe576-ca53-4362-aeb0-f807952b54f3-metrics-server-audit-profiles\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.662976 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.662941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/189fe576-ca53-4362-aeb0-f807952b54f3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.663144 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.662986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/189fe576-ca53-4362-aeb0-f807952b54f3-audit-log\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.663144 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.663015    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/189fe576-ca53-4362-aeb0-f807952b54f3-secret-metrics-server-client-certs\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.663144 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.663058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/189fe576-ca53-4362-aeb0-f807952b54f3-secret-metrics-server-tls\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.663144 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.663092    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/189fe576-ca53-4362-aeb0-f807952b54f3-metrics-server-audit-profiles\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.663144 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.663135    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/189fe576-ca53-4362-aeb0-f807952b54f3-client-ca-bundle\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.663416 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.663173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbmqs\" (UniqueName: \"kubernetes.io/projected/189fe576-ca53-4362-aeb0-f807952b54f3-kube-api-access-qbmqs\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.663468 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.663435    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/189fe576-ca53-4362-aeb0-f807952b54f3-audit-log\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.663810 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.663781    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/189fe576-ca53-4362-aeb0-f807952b54f3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.664140 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.664113    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/189fe576-ca53-4362-aeb0-f807952b54f3-metrics-server-audit-profiles\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.665817 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.665793    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/189fe576-ca53-4362-aeb0-f807952b54f3-secret-metrics-server-client-certs\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.665969 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.665923    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/189fe576-ca53-4362-aeb0-f807952b54f3-client-ca-bundle\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.666189 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.666165    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/189fe576-ca53-4362-aeb0-f807952b54f3-secret-metrics-server-tls\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.670477 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.670454    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbmqs\" (UniqueName: \"kubernetes.io/projected/189fe576-ca53-4362-aeb0-f807952b54f3-kube-api-access-qbmqs\") pod \"metrics-server-5945849c67-6qwlr\" (UID: \"189fe576-ca53-4362-aeb0-f807952b54f3\") " pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:30.793449 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:30.793395    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:31.440087 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.440041    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"]
Jul 09 00:56:31.483777 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.483738    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"]
Jul 09 00:56:31.484203 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.483882    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.486403 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.486373    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 09 00:56:31.486594 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.486375    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 09 00:56:31.486689 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.486621    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wh7v8\""
Jul 09 00:56:31.486779 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.486719    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 09 00:56:31.486859 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.486774    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 09 00:56:31.486859 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.486789    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 09 00:56:31.491684 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.491632    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 09 00:56:31.571585 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.571437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a338da56-2c44-4535-a805-4729a1ad87bf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.571585 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.571495    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a338da56-2c44-4535-a805-4729a1ad87bf-secret-telemeter-client\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.571585 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.571525    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a338da56-2c44-4535-a805-4729a1ad87bf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.571585 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.571557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a338da56-2c44-4535-a805-4729a1ad87bf-serving-certs-ca-bundle\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.571917 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.571652    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a338da56-2c44-4535-a805-4729a1ad87bf-metrics-client-ca\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.571917 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.571713    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq56s\" (UniqueName: \"kubernetes.io/projected/a338da56-2c44-4535-a805-4729a1ad87bf-kube-api-access-cq56s\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.571917 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.571754    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a338da56-2c44-4535-a805-4729a1ad87bf-telemeter-client-tls\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.571917 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.571831    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a338da56-2c44-4535-a805-4729a1ad87bf-federate-client-tls\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.672869 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.672832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a338da56-2c44-4535-a805-4729a1ad87bf-federate-client-tls\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.672869 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.672875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a338da56-2c44-4535-a805-4729a1ad87bf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.673076 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.672898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a338da56-2c44-4535-a805-4729a1ad87bf-secret-telemeter-client\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.673076 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.673026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a338da56-2c44-4535-a805-4729a1ad87bf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.673076 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.673063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a338da56-2c44-4535-a805-4729a1ad87bf-serving-certs-ca-bundle\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.673253 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.673090    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a338da56-2c44-4535-a805-4729a1ad87bf-metrics-client-ca\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.673253 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.673130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq56s\" (UniqueName: \"kubernetes.io/projected/a338da56-2c44-4535-a805-4729a1ad87bf-kube-api-access-cq56s\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.673253 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.673163    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a338da56-2c44-4535-a805-4729a1ad87bf-telemeter-client-tls\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.673980 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.673931    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a338da56-2c44-4535-a805-4729a1ad87bf-metrics-client-ca\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.673980 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.673941    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a338da56-2c44-4535-a805-4729a1ad87bf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.673980 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.673973    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a338da56-2c44-4535-a805-4729a1ad87bf-serving-certs-ca-bundle\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.675688 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.675662    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a338da56-2c44-4535-a805-4729a1ad87bf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.675833 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.675818    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a338da56-2c44-4535-a805-4729a1ad87bf-telemeter-client-tls\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.675884 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.675866    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a338da56-2c44-4535-a805-4729a1ad87bf-secret-telemeter-client\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.676028 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.675990    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a338da56-2c44-4535-a805-4729a1ad87bf-federate-client-tls\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.680342 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.680323    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq56s\" (UniqueName: \"kubernetes.io/projected/a338da56-2c44-4535-a805-4729a1ad87bf-kube-api-access-cq56s\") pod \"telemeter-client-67ffcdccfb-vjcfk\" (UID: \"a338da56-2c44-4535-a805-4729a1ad87bf\") " pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:31.795886 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:31.795853    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"
Jul 09 00:56:33.467834 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.467803    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d7cdc7f6f-dpxzg"]
Jul 09 00:56:33.473569 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.473545    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.482416 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.481981    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7cdc7f6f-dpxzg"]
Jul 09 00:56:33.591167 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.589082    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-trusted-ca-bundle\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.591167 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.589156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-config\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.591167 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.589192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-oauth-config\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.591167 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.589261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-serving-cert\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.591167 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.589323    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddx2p\" (UniqueName: \"kubernetes.io/projected/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-kube-api-access-ddx2p\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.591167 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.589365    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-service-ca\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.591167 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.589404    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-oauth-serving-cert\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.691780 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.690631    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-service-ca\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.691780 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.690686    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-oauth-serving-cert\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.691780 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.690713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-trusted-ca-bundle\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.691780 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.690756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-config\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.691780 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.690874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-oauth-config\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.691780 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.690931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-serving-cert\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.691780 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.690995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddx2p\" (UniqueName: \"kubernetes.io/projected/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-kube-api-access-ddx2p\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.691780 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.691615    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-config\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.692303 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.692151    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-service-ca\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.692729 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.692657    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-oauth-serving-cert\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.693250 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.693225    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-trusted-ca-bundle\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.694101 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.694043    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-oauth-config\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.694983 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.694935    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-serving-cert\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.701365 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.701342    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddx2p\" (UniqueName: \"kubernetes.io/projected/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-kube-api-access-ddx2p\") pod \"console-5d7cdc7f6f-dpxzg\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") " pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.756950 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.756910    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk"]
Jul 09 00:56:33.759923 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:56:33.759888    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda338da56_2c44_4535_a805_4729a1ad87bf.slice/crio-a506afa9759d130229136aad417b644e5f9e539e728428d8c334bfc733f0edac WatchSource:0}: Error finding container a506afa9759d130229136aad417b644e5f9e539e728428d8c334bfc733f0edac: Status 404 returned error can't find the container with id a506afa9759d130229136aad417b644e5f9e539e728428d8c334bfc733f0edac
Jul 09 00:56:33.815249 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.815186    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:33.921740 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.920491    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5945849c67-6qwlr"]
Jul 09 00:56:33.922793 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.922709    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx"]
Jul 09 00:56:33.927364 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.927042    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c8d9588dc-ftkmx"]
Jul 09 00:56:33.931050 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:56:33.930778    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ccc9ff8_04d7_4272_b414_d60fd6a7f515.slice/crio-96c289ddc575e57c53684f718460b25673094ea8bc3b333cfe58a90c72ad1562 WatchSource:0}: Error finding container 96c289ddc575e57c53684f718460b25673094ea8bc3b333cfe58a90c72ad1562: Status 404 returned error can't find the container with id 96c289ddc575e57c53684f718460b25673094ea8bc3b333cfe58a90c72ad1562
Jul 09 00:56:33.994111 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:33.994082    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7cdc7f6f-dpxzg"]
Jul 09 00:56:33.996566 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:56:33.996518    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f8675e0_1a97_4f57_bf5d_e7ceb99b47a5.slice/crio-2018ac8c209dd7696cb85104ac1370071fb7b9f0dade130faba86137eaacc3ed WatchSource:0}: Error finding container 2018ac8c209dd7696cb85104ac1370071fb7b9f0dade130faba86137eaacc3ed: Status 404 returned error can't find the container with id 2018ac8c209dd7696cb85104ac1370071fb7b9f0dade130faba86137eaacc3ed
Jul 09 00:56:34.026256 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:34.025965    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-sjl6z" event={"ID":"520c55e3-aabc-4449-8f91-f155b6fa6b5f","Type":"ContainerStarted","Data":"b2d5f9bc479a35bf6934da87b1557231a3a53aea3623c3f935b95706292e3aaf"}
Jul 09 00:56:34.027111 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:34.027059    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-sjl6z"
Jul 09 00:56:34.029112 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:34.028509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8vx5f" event={"ID":"93c25998-c800-4bf5-90cb-173986d24386","Type":"ContainerStarted","Data":"bcd62b8aaf2aec7a1cda5e8859dc7afc1b01db789e156c25927769568dd42799"}
Jul 09 00:56:34.031273 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:34.031248    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7cdc7f6f-dpxzg" event={"ID":"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5","Type":"ContainerStarted","Data":"2018ac8c209dd7696cb85104ac1370071fb7b9f0dade130faba86137eaacc3ed"}
Jul 09 00:56:34.032613 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:34.032591    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8d9588dc-ftkmx" event={"ID":"d21d96a0-a994-448c-86a6-ce2967c8e789","Type":"ContainerStarted","Data":"43a1483ed5fc964169b6c1f2b77a6afe7d5a7b0b0a61047d47dcbce49bea09c2"}
Jul 09 00:56:34.033755 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:34.033737    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-sjl6z"
Jul 09 00:56:34.034094 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:34.034061    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7chjs" event={"ID":"5e886194-d4ac-49cc-9f50-5f4717186857","Type":"ContainerStarted","Data":"17f6da67852d037c8e97268d079cd2bf6a9493dcafd811e1de3c0e6e5d855e1f"}
Jul 09 00:56:34.035915 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:34.035830    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx" event={"ID":"1ccc9ff8-04d7-4272-b414-d60fd6a7f515","Type":"ContainerStarted","Data":"2d3a393b243c1def50d67ebca0d30c056e22498996f77ccfc66f054903e9d6ca"}
Jul 09 00:56:34.035915 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:34.035886    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx" event={"ID":"1ccc9ff8-04d7-4272-b414-d60fd6a7f515","Type":"ContainerStarted","Data":"96c289ddc575e57c53684f718460b25673094ea8bc3b333cfe58a90c72ad1562"}
Jul 09 00:56:34.037843 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:34.037591    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk" event={"ID":"a338da56-2c44-4535-a805-4729a1ad87bf","Type":"ContainerStarted","Data":"a506afa9759d130229136aad417b644e5f9e539e728428d8c334bfc733f0edac"}
Jul 09 00:56:34.039888 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:34.039551    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bbw2n" event={"ID":"4544db24-d746-4f38-896b-bdda644ee5ce","Type":"ContainerStarted","Data":"10bfe178ba914cf001791cd6cd2aee518e5924588c8b08d7887d9f3140b19aeb"}
Jul 09 00:56:34.040002 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:34.039957    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:56:34.041311 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:34.041275    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5945849c67-6qwlr" event={"ID":"189fe576-ca53-4362-aeb0-f807952b54f3","Type":"ContainerStarted","Data":"f260a92433b1d2a0d0bcd6aa007479cc258f3dd98f5f79a576d2dadb3cc01c0d"}
Jul 09 00:56:34.043551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:34.043429    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-sjl6z" podStartSLOduration=4.669035782 podStartE2EDuration="25.04341241s" totalImagesPullingTime="20.374376628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:56:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:34.042057963 +0000 UTC m=+79.105552669" watchObservedRunningTime="2026-07-09 00:56:34.04341241 +0000 UTC m=+79.106907184"
Jul 09 00:56:34.071885 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:34.071828    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8vx5f" podStartSLOduration=66.194777639 podStartE2EDuration="1m18.071808413s" totalImagesPullingTime="11.877030774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 00:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:34.071245439 +0000 UTC m=+79.134740145" watchObservedRunningTime="2026-07-09 00:56:34.071808413 +0000 UTC m=+79.135303121"
Jul 09 00:56:34.086241 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:34.086053    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bbw2n" podStartSLOduration=66.200619367 podStartE2EDuration="1m18.086031782s" totalImagesPullingTime="11.885412415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:34.08433996 +0000 UTC m=+79.147834667" watchObservedRunningTime="2026-07-09 00:56:34.086031782 +0000 UTC m=+79.149526488"
Jul 09 00:56:35.050131 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:35.050096    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx" event={"ID":"1ccc9ff8-04d7-4272-b414-d60fd6a7f515","Type":"ContainerStarted","Data":"e831e522193668a53685d1fdcea10e2fc5b7ab04e168d5e58ceb204eca424ff6"}
Jul 09 00:56:36.062520 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:36.062121    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7chjs" event={"ID":"5e886194-d4ac-49cc-9f50-5f4717186857","Type":"ContainerStarted","Data":"15951c00c862db6d2192cb64dfd91366124f9dc7d0ab024ceb5bef4c8e259aba"}
Jul 09 00:56:37.071923 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:37.071037    2565 generic.go:356] "Generic (PLEG): container finished" podID="5e886194-d4ac-49cc-9f50-5f4717186857" containerID="15951c00c862db6d2192cb64dfd91366124f9dc7d0ab024ceb5bef4c8e259aba" exitCode=0
Jul 09 00:56:37.071923 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:37.071091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7chjs" event={"ID":"5e886194-d4ac-49cc-9f50-5f4717186857","Type":"ContainerDied","Data":"15951c00c862db6d2192cb64dfd91366124f9dc7d0ab024ceb5bef4c8e259aba"}
Jul 09 00:56:41.093120 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:41.093066    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7cdc7f6f-dpxzg" event={"ID":"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5","Type":"ContainerStarted","Data":"e697c6b39bb9b3ed83e575d3352c524c47afda2cab7d2bdbc1c25a0174d650b4"}
Jul 09 00:56:41.095975 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:41.095941    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8d9588dc-ftkmx" event={"ID":"d21d96a0-a994-448c-86a6-ce2967c8e789","Type":"ContainerStarted","Data":"effe370e1e26d53fbc35bd4d93d17dba0feb5f7e2843973491a4902f6e402a48"}
Jul 09 00:56:41.100881 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:41.100662    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7chjs" event={"ID":"5e886194-d4ac-49cc-9f50-5f4717186857","Type":"ContainerStarted","Data":"56fab08958cb97d21c04f4d5cb9296372ce6d67702293d6db27022faf59d996d"}
Jul 09 00:56:41.100881 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:41.100712    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7chjs" event={"ID":"5e886194-d4ac-49cc-9f50-5f4717186857","Type":"ContainerStarted","Data":"227a7564714ebcd3059d45781d8211694b40874813ccc0fda04967ace530b657"}
Jul 09 00:56:41.104493 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:41.104464    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx" event={"ID":"1ccc9ff8-04d7-4272-b414-d60fd6a7f515","Type":"ContainerStarted","Data":"c5de9d66e297476ec3491e9a173cf6e29cddd619c855d55d065a7a3da6ffb4a8"}
Jul 09 00:56:41.107552 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:41.107489    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk" event={"ID":"a338da56-2c44-4535-a805-4729a1ad87bf","Type":"ContainerStarted","Data":"1cca5a899d3171baef3b81fcdcb94b32a073a02b8c732fd3a565cd25b3ddfa94"}
Jul 09 00:56:41.112754 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:41.112708    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d7cdc7f6f-dpxzg" podStartSLOduration=1.962581706 podStartE2EDuration="8.112689593s" totalImagesPullingTime="6.150107887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:56:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:41.111401188 +0000 UTC m=+86.174895894" watchObservedRunningTime="2026-07-09 00:56:41.112689593 +0000 UTC m=+86.176184300"
Jul 09 00:56:41.113841 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:41.113819    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5945849c67-6qwlr" event={"ID":"189fe576-ca53-4362-aeb0-f807952b54f3","Type":"ContainerStarted","Data":"8533a365686c170f64eb38759a78ab185ff7e111b730cecec4fa4b16987d6c6b"}
Jul 09 00:56:41.145556 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:41.145495    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c8d9588dc-ftkmx" podStartSLOduration=10.942534433 podStartE2EDuration="17.14547166s" totalImagesPullingTime="6.202937227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:56:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:41.127767274 +0000 UTC m=+86.191261979" watchObservedRunningTime="2026-07-09 00:56:41.14547166 +0000 UTC m=+86.208966346"
Jul 09 00:56:41.145864 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:41.145833    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5g6jx" podStartSLOduration=9.09764827 podStartE2EDuration="15.145822666s" totalImagesPullingTime="6.048174396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:41.143798957 +0000 UTC m=+86.207293677" watchObservedRunningTime="2026-07-09 00:56:41.145822666 +0000 UTC m=+86.209317372"
Jul 09 00:56:41.185561 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:41.185499    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7chjs" podStartSLOduration=12.925774393 podStartE2EDuration="15.18547786s" totalImagesPullingTime="2.120009152s" totalInitContainerRuntime="139.694315ms" isStatefulPod=true podCreationTimestamp="2026-07-09 00:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:41.165321858 +0000 UTC m=+86.228816565" watchObservedRunningTime="2026-07-09 00:56:41.18547786 +0000 UTC m=+86.248972550"
Jul 09 00:56:41.186839 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:41.186791    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5945849c67-6qwlr" podStartSLOduration=4.978145352 podStartE2EDuration="11.186777669s" totalImagesPullingTime="6.208632317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:56:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:41.185329795 +0000 UTC m=+86.248824500" watchObservedRunningTime="2026-07-09 00:56:41.186777669 +0000 UTC m=+86.250272371"
Jul 09 00:56:43.124964 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:43.124931    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk" event={"ID":"a338da56-2c44-4535-a805-4729a1ad87bf","Type":"ContainerStarted","Data":"f85df112069beff2a351264338aa9c0f5b98334b5d233df181857895615da996"}
Jul 09 00:56:43.125424 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:43.124984    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk" event={"ID":"a338da56-2c44-4535-a805-4729a1ad87bf","Type":"ContainerStarted","Data":"ad1f4794e2c5a54b3d9aebf336d6282be06563e8b738da6557353611ab16fb0b"}
Jul 09 00:56:43.150195 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:43.150121    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67ffcdccfb-vjcfk" podStartSLOduration=3.954412366 podStartE2EDuration="12.150103829s" totalImagesPullingTime="8.195691463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:56:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:56:43.148513023 +0000 UTC m=+88.212007730" watchObservedRunningTime="2026-07-09 00:56:43.150103829 +0000 UTC m=+88.213598534"
Jul 09 00:56:43.815737 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:43.815698    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:43.815933 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:43.815759    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:43.820352 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:43.820325    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:43.869634 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:43.869601    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c8d9588dc-ftkmx"]
Jul 09 00:56:44.133273 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:44.133177    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:56:44.570959 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:44.570920    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:56:50.793743 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:50.793704    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:50.794199 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:50.793804    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:56:54.542479 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:56:54.542446    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7cdc7f6f-dpxzg"]
Jul 09 00:57:05.052912 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:05.052882    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bbw2n"
Jul 09 00:57:08.889204 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:08.889155    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c8d9588dc-ftkmx" podUID="d21d96a0-a994-448c-86a6-ce2967c8e789" containerName="console" containerID="cri-o://effe370e1e26d53fbc35bd4d93d17dba0feb5f7e2843973491a4902f6e402a48" gracePeriod=15
Jul 09 00:57:09.149424 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.149347    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:57:09.196954 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.196917    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-service-ca\") pod \"d21d96a0-a994-448c-86a6-ce2967c8e789\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") "
Jul 09 00:57:09.197118 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.196964    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-oauth-serving-cert\") pod \"d21d96a0-a994-448c-86a6-ce2967c8e789\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") "
Jul 09 00:57:09.197118 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.196985    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hf5c\" (UniqueName: \"kubernetes.io/projected/d21d96a0-a994-448c-86a6-ce2967c8e789-kube-api-access-5hf5c\") pod \"d21d96a0-a994-448c-86a6-ce2967c8e789\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") "
Jul 09 00:57:09.197118 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.197021    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-trusted-ca-bundle\") pod \"d21d96a0-a994-448c-86a6-ce2967c8e789\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") "
Jul 09 00:57:09.197298 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.197242    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-console-config\") pod \"d21d96a0-a994-448c-86a6-ce2967c8e789\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") "
Jul 09 00:57:09.197354 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.197295    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d21d96a0-a994-448c-86a6-ce2967c8e789-console-oauth-config\") pod \"d21d96a0-a994-448c-86a6-ce2967c8e789\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") "
Jul 09 00:57:09.197354 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.197338    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d21d96a0-a994-448c-86a6-ce2967c8e789-console-serving-cert\") pod \"d21d96a0-a994-448c-86a6-ce2967c8e789\" (UID: \"d21d96a0-a994-448c-86a6-ce2967c8e789\") "
Jul 09 00:57:09.197537 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.197489    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d21d96a0-a994-448c-86a6-ce2967c8e789" (UID: "d21d96a0-a994-448c-86a6-ce2967c8e789"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 00:57:09.197537 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.197512    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d21d96a0-a994-448c-86a6-ce2967c8e789" (UID: "d21d96a0-a994-448c-86a6-ce2967c8e789"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 00:57:09.197693 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.197529    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-service-ca" (OuterVolumeSpecName: "service-ca") pod "d21d96a0-a994-448c-86a6-ce2967c8e789" (UID: "d21d96a0-a994-448c-86a6-ce2967c8e789"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 00:57:09.197693 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.197624    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-console-config" (OuterVolumeSpecName: "console-config") pod "d21d96a0-a994-448c-86a6-ce2967c8e789" (UID: "d21d96a0-a994-448c-86a6-ce2967c8e789"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 00:57:09.197693 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.197649    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-trusted-ca-bundle\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:57:09.197693 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.197669    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-service-ca\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:57:09.197693 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.197684    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-oauth-serving-cert\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:57:09.199516 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.199475    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d21d96a0-a994-448c-86a6-ce2967c8e789-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d21d96a0-a994-448c-86a6-ce2967c8e789" (UID: "d21d96a0-a994-448c-86a6-ce2967c8e789"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 00:57:09.199645 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.199534    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d21d96a0-a994-448c-86a6-ce2967c8e789-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d21d96a0-a994-448c-86a6-ce2967c8e789" (UID: "d21d96a0-a994-448c-86a6-ce2967c8e789"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 00:57:09.199645 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.199572    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d21d96a0-a994-448c-86a6-ce2967c8e789-kube-api-access-5hf5c" (OuterVolumeSpecName: "kube-api-access-5hf5c") pod "d21d96a0-a994-448c-86a6-ce2967c8e789" (UID: "d21d96a0-a994-448c-86a6-ce2967c8e789"). InnerVolumeSpecName "kube-api-access-5hf5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 00:57:09.224883 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.224849    2565 generic.go:356] "Generic (PLEG): container finished" podID="d21d96a0-a994-448c-86a6-ce2967c8e789" containerID="effe370e1e26d53fbc35bd4d93d17dba0feb5f7e2843973491a4902f6e402a48" exitCode=0
Jul 09 00:57:09.225020 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.224888    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8d9588dc-ftkmx"
Jul 09 00:57:09.225020 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.224931    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8d9588dc-ftkmx" event={"ID":"d21d96a0-a994-448c-86a6-ce2967c8e789","Type":"ContainerDied","Data":"effe370e1e26d53fbc35bd4d93d17dba0feb5f7e2843973491a4902f6e402a48"}
Jul 09 00:57:09.225020 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.224983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8d9588dc-ftkmx" event={"ID":"d21d96a0-a994-448c-86a6-ce2967c8e789","Type":"ContainerDied","Data":"43a1483ed5fc964169b6c1f2b77a6afe7d5a7b0b0a61047d47dcbce49bea09c2"}
Jul 09 00:57:09.225020 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.225004    2565 scope.go:117] "RemoveContainer" containerID="effe370e1e26d53fbc35bd4d93d17dba0feb5f7e2843973491a4902f6e402a48"
Jul 09 00:57:09.235656 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.235639    2565 scope.go:117] "RemoveContainer" containerID="effe370e1e26d53fbc35bd4d93d17dba0feb5f7e2843973491a4902f6e402a48"
Jul 09 00:57:09.235977 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:57:09.235956    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"effe370e1e26d53fbc35bd4d93d17dba0feb5f7e2843973491a4902f6e402a48\": container with ID starting with effe370e1e26d53fbc35bd4d93d17dba0feb5f7e2843973491a4902f6e402a48 not found: ID does not exist" containerID="effe370e1e26d53fbc35bd4d93d17dba0feb5f7e2843973491a4902f6e402a48"
Jul 09 00:57:09.236033 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.235986    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"effe370e1e26d53fbc35bd4d93d17dba0feb5f7e2843973491a4902f6e402a48"} err="failed to get container status \"effe370e1e26d53fbc35bd4d93d17dba0feb5f7e2843973491a4902f6e402a48\": rpc error: code = NotFound desc = could not find container \"effe370e1e26d53fbc35bd4d93d17dba0feb5f7e2843973491a4902f6e402a48\": container with ID starting with effe370e1e26d53fbc35bd4d93d17dba0feb5f7e2843973491a4902f6e402a48 not found: ID does not exist"
Jul 09 00:57:09.246024 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.245995    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c8d9588dc-ftkmx"]
Jul 09 00:57:09.248658 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.248633    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c8d9588dc-ftkmx"]
Jul 09 00:57:09.298975 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.298936    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hf5c\" (UniqueName: \"kubernetes.io/projected/d21d96a0-a994-448c-86a6-ce2967c8e789-kube-api-access-5hf5c\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:57:09.298975 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.298969    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d21d96a0-a994-448c-86a6-ce2967c8e789-console-config\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:57:09.298975 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.298979    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d21d96a0-a994-448c-86a6-ce2967c8e789-console-oauth-config\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:57:09.298975 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.298987    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d21d96a0-a994-448c-86a6-ce2967c8e789-console-serving-cert\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:57:09.504646 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:09.504612    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d21d96a0-a994-448c-86a6-ce2967c8e789" path="/var/lib/kubelet/pods/d21d96a0-a994-448c-86a6-ce2967c8e789/volumes"
Jul 09 00:57:10.344628 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:10.344591    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dtmg6_e2475349-184c-40c1-8825-45e4b8c349fe/serve-healthcheck-canary/0.log"
Jul 09 00:57:10.799148 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:10.799121    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:57:10.804427 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:10.804404    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5945849c67-6qwlr"
Jul 09 00:57:19.568007 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.567946    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d7cdc7f6f-dpxzg" podUID="3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5" containerName="console" containerID="cri-o://e697c6b39bb9b3ed83e575d3352c524c47afda2cab7d2bdbc1c25a0174d650b4" gracePeriod=15
Jul 09 00:57:19.838842 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.838761    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:57:19.879680 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.879643    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-oauth-serving-cert\") pod \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") "
Jul 09 00:57:19.879837 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.879688    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-config\") pod \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") "
Jul 09 00:57:19.879837 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.879720    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-trusted-ca-bundle\") pod \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") "
Jul 09 00:57:19.879837 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.879776    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddx2p\" (UniqueName: \"kubernetes.io/projected/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-kube-api-access-ddx2p\") pod \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") "
Jul 09 00:57:19.879837 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.879810    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-oauth-config\") pod \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") "
Jul 09 00:57:19.879837 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.879835    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-serving-cert\") pod \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") "
Jul 09 00:57:19.880037 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.879884    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-service-ca\") pod \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\" (UID: \"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5\") "
Jul 09 00:57:19.880124 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.880102    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5" (UID: "3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 00:57:19.880186 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.880154    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-config" (OuterVolumeSpecName: "console-config") pod "3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5" (UID: "3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 00:57:19.880422 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.880393    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5" (UID: "3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 00:57:19.880503 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.880443    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-service-ca" (OuterVolumeSpecName: "service-ca") pod "3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5" (UID: "3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 00:57:19.882068 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.882038    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5" (UID: "3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 00:57:19.882167 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.882094    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5" (UID: "3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 00:57:19.882167 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.882118    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-kube-api-access-ddx2p" (OuterVolumeSpecName: "kube-api-access-ddx2p") pod "3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5" (UID: "3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5"). InnerVolumeSpecName "kube-api-access-ddx2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 00:57:19.981299 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.981263    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddx2p\" (UniqueName: \"kubernetes.io/projected/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-kube-api-access-ddx2p\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:57:19.981299 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.981294    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-oauth-config\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:57:19.981299 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.981303    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-serving-cert\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:57:19.981533 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.981313    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-service-ca\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:57:19.981533 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.981322    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-oauth-serving-cert\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:57:19.981533 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.981330    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-console-config\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:57:19.981533 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:19.981338    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5-trusted-ca-bundle\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:57:20.265253 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:20.265196    2565 generic.go:356] "Generic (PLEG): container finished" podID="3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5" containerID="e697c6b39bb9b3ed83e575d3352c524c47afda2cab7d2bdbc1c25a0174d650b4" exitCode=0
Jul 09 00:57:20.265253 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:20.265240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7cdc7f6f-dpxzg" event={"ID":"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5","Type":"ContainerDied","Data":"e697c6b39bb9b3ed83e575d3352c524c47afda2cab7d2bdbc1c25a0174d650b4"}
Jul 09 00:57:20.265463 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:20.265300    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7cdc7f6f-dpxzg" event={"ID":"3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5","Type":"ContainerDied","Data":"2018ac8c209dd7696cb85104ac1370071fb7b9f0dade130faba86137eaacc3ed"}
Jul 09 00:57:20.265463 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:20.265250    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7cdc7f6f-dpxzg"
Jul 09 00:57:20.265463 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:20.265328    2565 scope.go:117] "RemoveContainer" containerID="e697c6b39bb9b3ed83e575d3352c524c47afda2cab7d2bdbc1c25a0174d650b4"
Jul 09 00:57:20.282967 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:20.282945    2565 scope.go:117] "RemoveContainer" containerID="e697c6b39bb9b3ed83e575d3352c524c47afda2cab7d2bdbc1c25a0174d650b4"
Jul 09 00:57:20.283640 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:57:20.283483    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e697c6b39bb9b3ed83e575d3352c524c47afda2cab7d2bdbc1c25a0174d650b4\": container with ID starting with e697c6b39bb9b3ed83e575d3352c524c47afda2cab7d2bdbc1c25a0174d650b4 not found: ID does not exist" containerID="e697c6b39bb9b3ed83e575d3352c524c47afda2cab7d2bdbc1c25a0174d650b4"
Jul 09 00:57:20.283640 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:20.283525    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e697c6b39bb9b3ed83e575d3352c524c47afda2cab7d2bdbc1c25a0174d650b4"} err="failed to get container status \"e697c6b39bb9b3ed83e575d3352c524c47afda2cab7d2bdbc1c25a0174d650b4\": rpc error: code = NotFound desc = could not find container \"e697c6b39bb9b3ed83e575d3352c524c47afda2cab7d2bdbc1c25a0174d650b4\": container with ID starting with e697c6b39bb9b3ed83e575d3352c524c47afda2cab7d2bdbc1c25a0174d650b4 not found: ID does not exist"
Jul 09 00:57:20.285240 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:20.285197    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7cdc7f6f-dpxzg"]
Jul 09 00:57:20.288317 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:20.288298    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d7cdc7f6f-dpxzg"]
Jul 09 00:57:21.507853 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:21.507807    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5" path="/var/lib/kubelet/pods/3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5/volumes"
Jul 09 00:57:28.701575 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.701541    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 00:57:28.702016 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.701823    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d21d96a0-a994-448c-86a6-ce2967c8e789" containerName="console"
Jul 09 00:57:28.702016 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.701834    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d21d96a0-a994-448c-86a6-ce2967c8e789" containerName="console"
Jul 09 00:57:28.702016 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.701852    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5" containerName="console"
Jul 09 00:57:28.702016 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.701857    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5" containerName="console"
Jul 09 00:57:28.702016 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.701921    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f8675e0-1a97-4f57-bf5d-e7ceb99b47a5" containerName="console"
Jul 09 00:57:28.702016 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.701928    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d21d96a0-a994-448c-86a6-ce2967c8e789" containerName="console"
Jul 09 00:57:28.705395 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.705376    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.707750 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.707726    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 00:57:28.707928 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.707906    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 00:57:28.707994 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.707918    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 00:57:28.708154 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.708140    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 00:57:28.708364 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.708346    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 00:57:28.708468 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.708372    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 00:57:28.708468 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.708413    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 00:57:28.708583 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.708533    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-z6wbb\""
Jul 09 00:57:28.708821 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.708803    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 00:57:28.713390 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.713376    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 00:57:28.718085 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.718065    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 00:57:28.747717 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.747684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a846d095-6946-47c7-b08e-caa445825afa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.747850 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.747720    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.747850 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.747755    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a846d095-6946-47c7-b08e-caa445825afa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.747850 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.747794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a846d095-6946-47c7-b08e-caa445825afa-config-out\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.747850 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.747828    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km8c2\" (UniqueName: \"kubernetes.io/projected/a846d095-6946-47c7-b08e-caa445825afa-kube-api-access-km8c2\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.747980 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.747860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.747980 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.747892    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a846d095-6946-47c7-b08e-caa445825afa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.747980 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.747914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-config-volume\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.747980 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.747932    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a846d095-6946-47c7-b08e-caa445825afa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.747980 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.747954    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.747980 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.747971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.748172 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.747987    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-web-config\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.748172 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.748030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.849260 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.849235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a846d095-6946-47c7-b08e-caa445825afa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.849386 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.849269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a846d095-6946-47c7-b08e-caa445825afa-config-out\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.849386 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.849289    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km8c2\" (UniqueName: \"kubernetes.io/projected/a846d095-6946-47c7-b08e-caa445825afa-kube-api-access-km8c2\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.849386 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.849312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.849386 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.849348    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a846d095-6946-47c7-b08e-caa445825afa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.849386 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.849368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-config-volume\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.849636 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.849387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a846d095-6946-47c7-b08e-caa445825afa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.849636 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.849420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.849736 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.849634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.849736 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.849671    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-web-config\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.849736 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.849718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.849890 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.849753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a846d095-6946-47c7-b08e-caa445825afa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.849890 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.849780    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.849890 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.849843    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a846d095-6946-47c7-b08e-caa445825afa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.850344 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.850322    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a846d095-6946-47c7-b08e-caa445825afa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.851748 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.851704    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a846d095-6946-47c7-b08e-caa445825afa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.852122 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.852078    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a846d095-6946-47c7-b08e-caa445825afa-config-out\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.852294 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.852256    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a846d095-6946-47c7-b08e-caa445825afa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.852674 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.852636    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.852837 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.852793    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.853225 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.853191    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.853294 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.853271    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-config-volume\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.853460 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.853438    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.853507 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.853486    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-web-config\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.854336 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.854314    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a846d095-6946-47c7-b08e-caa445825afa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:28.857620 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:28.857589    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-km8c2\" (UniqueName: \"kubernetes.io/projected/a846d095-6946-47c7-b08e-caa445825afa-kube-api-access-km8c2\") pod \"alertmanager-main-0\" (UID: \"a846d095-6946-47c7-b08e-caa445825afa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:29.014788 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:29.014754    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 00:57:29.151366 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:29.151235    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 00:57:29.154071 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:57:29.154046    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda846d095_6946_47c7_b08e_caa445825afa.slice/crio-896542d60de1d002823ed7c3c56370480c3ef0f87cb58b2ab2cc02c607ae7dd8 WatchSource:0}: Error finding container 896542d60de1d002823ed7c3c56370480c3ef0f87cb58b2ab2cc02c607ae7dd8: Status 404 returned error can't find the container with id 896542d60de1d002823ed7c3c56370480c3ef0f87cb58b2ab2cc02c607ae7dd8
Jul 09 00:57:29.302022 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:29.301933    2565 generic.go:356] "Generic (PLEG): container finished" podID="a846d095-6946-47c7-b08e-caa445825afa" containerID="2f1e5c57c94a20c8f66ab233edca7ac66f8973cb50fbb2ce482cf6533c258ebb" exitCode=0
Jul 09 00:57:29.302022 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:29.301974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a846d095-6946-47c7-b08e-caa445825afa","Type":"ContainerDied","Data":"2f1e5c57c94a20c8f66ab233edca7ac66f8973cb50fbb2ce482cf6533c258ebb"}
Jul 09 00:57:29.302274 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:29.302041    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a846d095-6946-47c7-b08e-caa445825afa","Type":"ContainerStarted","Data":"896542d60de1d002823ed7c3c56370480c3ef0f87cb58b2ab2cc02c607ae7dd8"}
Jul 09 00:57:31.312204 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:31.312171    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a846d095-6946-47c7-b08e-caa445825afa","Type":"ContainerStarted","Data":"9a87d352f2b834e522b730b7c49190fd794527d8a989e777333fb8e1ed3add0c"}
Jul 09 00:57:31.312604 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:31.312289    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a846d095-6946-47c7-b08e-caa445825afa","Type":"ContainerStarted","Data":"2f7104b8a42acc07fe81bd7e2e132b7935c037d33f3566ec1b8ef44059e550be"}
Jul 09 00:57:31.312604 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:31.312317    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a846d095-6946-47c7-b08e-caa445825afa","Type":"ContainerStarted","Data":"b69fbaccd8b90730b9ef718f5326ef035a405f53b9857e05392379514fb699cd"}
Jul 09 00:57:31.312604 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:31.312342    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a846d095-6946-47c7-b08e-caa445825afa","Type":"ContainerStarted","Data":"1bafebc735bb32c8b6bf7af1cec7297bb3de3336d8a6b70fd16bf83cb462d51d"}
Jul 09 00:57:31.312604 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:31.312367    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a846d095-6946-47c7-b08e-caa445825afa","Type":"ContainerStarted","Data":"8998d09ed46d3129f43ffa7cf8abf96a545f788b6d942068e91170a5098fabde"}
Jul 09 00:57:32.318583 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:32.318540    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a846d095-6946-47c7-b08e-caa445825afa","Type":"ContainerStarted","Data":"2d2b2b160aa230d5ee0ab8ebd7a5f4a0d1922b20f8de15c8f8a9c90f17e72740"}
Jul 09 00:57:32.344048 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:32.343683    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.218051269 podStartE2EDuration="4.34366197s" totalImagesPullingTime="2.109549679s" totalInitContainerRuntime="16.061022ms" isStatefulPod=false podCreationTimestamp="2026-07-09 00:57:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:57:32.341839282 +0000 UTC m=+137.405333988" watchObservedRunningTime="2026-07-09 00:57:32.34366197 +0000 UTC m=+137.407156677"
Jul 09 00:57:47.972130 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:47.972095    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f697db6c5-r72s4"]
Jul 09 00:57:47.974352 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:47.974334    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:47.976703 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:47.976673    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 00:57:47.977117 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:47.977094    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 00:57:47.977232 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:47.977129    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 00:57:47.977232 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:47.977128    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 00:57:47.977232 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:47.977133    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 00:57:47.977387 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:47.977374    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-svrtq\""
Jul 09 00:57:47.982004 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:47.981987    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 00:57:47.984899 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:47.984879    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f697db6c5-r72s4"]
Jul 09 00:57:48.108973 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.108937    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-service-ca\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.108973 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.108973    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-oauth-serving-cert\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.109180 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.109004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-config\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.109180 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.109031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-trusted-ca-bundle\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.109180 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.109088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-serving-cert\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.109180 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.109133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-oauth-config\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.109180 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.109173    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tmqk\" (UniqueName: \"kubernetes.io/projected/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-kube-api-access-9tmqk\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.210315 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.210266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-service-ca\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.210315 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.210313    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-oauth-serving-cert\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.210556 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.210343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-config\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.210556 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.210373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-trusted-ca-bundle\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.210556 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.210401    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-serving-cert\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.210556 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.210443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-oauth-config\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.210556 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.210477    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tmqk\" (UniqueName: \"kubernetes.io/projected/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-kube-api-access-9tmqk\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.211067 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.211044    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-service-ca\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.211485 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.211461    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-oauth-serving-cert\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.211618 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.211590    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-config\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.211776 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.211757    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-trusted-ca-bundle\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.212812 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.212794    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-serving-cert\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.213007 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.212989    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-oauth-config\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.218147 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.218122    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tmqk\" (UniqueName: \"kubernetes.io/projected/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-kube-api-access-9tmqk\") pod \"console-f697db6c5-r72s4\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") " pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.283191 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.283157    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:48.412669 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:48.412638    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f697db6c5-r72s4"]
Jul 09 00:57:48.416115 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:57:48.416084    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9ec3cc_c0ed_4f4b_950f_6e7e77bbe71f.slice/crio-6ea1c29f9b405936d5b99bd9c6134ce58884d1e4e4e6f1e3ee2cc608b5d8b523 WatchSource:0}: Error finding container 6ea1c29f9b405936d5b99bd9c6134ce58884d1e4e4e6f1e3ee2cc608b5d8b523: Status 404 returned error can't find the container with id 6ea1c29f9b405936d5b99bd9c6134ce58884d1e4e4e6f1e3ee2cc608b5d8b523
Jul 09 00:57:49.383032 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:49.382998    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f697db6c5-r72s4" event={"ID":"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f","Type":"ContainerStarted","Data":"192b4036e209afd8931aa354f1a6a493207fee97ecbc1cbced8504238472e23f"}
Jul 09 00:57:49.383420 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:49.383047    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f697db6c5-r72s4" event={"ID":"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f","Type":"ContainerStarted","Data":"6ea1c29f9b405936d5b99bd9c6134ce58884d1e4e4e6f1e3ee2cc608b5d8b523"}
Jul 09 00:57:49.401708 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:49.401656    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f697db6c5-r72s4" podStartSLOduration=2.401642073 podStartE2EDuration="2.401642073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:57:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:57:49.400331485 +0000 UTC m=+154.463826190" watchObservedRunningTime="2026-07-09 00:57:49.401642073 +0000 UTC m=+154.465136778"
Jul 09 00:57:58.283814 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:58.283770    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:58.284285 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:58.283836    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:58.288269 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:58.288246    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:57:58.418255 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:57:58.418203    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 00:58:02.726127 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:02.726089    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh"]
Jul 09 00:58:02.729037 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:02.729021    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh"
Jul 09 00:58:02.731224 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:02.731190    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 00:58:02.731322 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:02.731241    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 00:58:02.732068 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:02.732054    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cgghp\""
Jul 09 00:58:02.736801 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:02.736780    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh"]
Jul 09 00:58:02.824028 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:02.823992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8755q\" (UniqueName: \"kubernetes.io/projected/c1e059e3-4a65-45e0-827b-3a7e0cd01181-kube-api-access-8755q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh\" (UID: \"c1e059e3-4a65-45e0-827b-3a7e0cd01181\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh"
Jul 09 00:58:02.824195 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:02.824045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1e059e3-4a65-45e0-827b-3a7e0cd01181-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh\" (UID: \"c1e059e3-4a65-45e0-827b-3a7e0cd01181\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh"
Jul 09 00:58:02.824195 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:02.824096    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1e059e3-4a65-45e0-827b-3a7e0cd01181-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh\" (UID: \"c1e059e3-4a65-45e0-827b-3a7e0cd01181\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh"
Jul 09 00:58:02.925462 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:02.925423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8755q\" (UniqueName: \"kubernetes.io/projected/c1e059e3-4a65-45e0-827b-3a7e0cd01181-kube-api-access-8755q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh\" (UID: \"c1e059e3-4a65-45e0-827b-3a7e0cd01181\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh"
Jul 09 00:58:02.925590 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:02.925473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1e059e3-4a65-45e0-827b-3a7e0cd01181-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh\" (UID: \"c1e059e3-4a65-45e0-827b-3a7e0cd01181\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh"
Jul 09 00:58:02.925590 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:02.925498    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1e059e3-4a65-45e0-827b-3a7e0cd01181-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh\" (UID: \"c1e059e3-4a65-45e0-827b-3a7e0cd01181\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh"
Jul 09 00:58:02.925865 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:02.925847    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1e059e3-4a65-45e0-827b-3a7e0cd01181-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh\" (UID: \"c1e059e3-4a65-45e0-827b-3a7e0cd01181\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh"
Jul 09 00:58:02.925902 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:02.925879    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1e059e3-4a65-45e0-827b-3a7e0cd01181-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh\" (UID: \"c1e059e3-4a65-45e0-827b-3a7e0cd01181\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh"
Jul 09 00:58:02.933681 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:02.933664    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8755q\" (UniqueName: \"kubernetes.io/projected/c1e059e3-4a65-45e0-827b-3a7e0cd01181-kube-api-access-8755q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh\" (UID: \"c1e059e3-4a65-45e0-827b-3a7e0cd01181\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh"
Jul 09 00:58:03.039248 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:03.039192    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh"
Jul 09 00:58:03.165590 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:03.165500    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh"]
Jul 09 00:58:03.168276 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:58:03.168251    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e059e3_4a65_45e0_827b_3a7e0cd01181.slice/crio-4dce9b93e06f67d1751cd23ea246e2be605f5abcb30f234094214e53239526e1 WatchSource:0}: Error finding container 4dce9b93e06f67d1751cd23ea246e2be605f5abcb30f234094214e53239526e1: Status 404 returned error can't find the container with id 4dce9b93e06f67d1751cd23ea246e2be605f5abcb30f234094214e53239526e1
Jul 09 00:58:03.433244 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:03.433148    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh" event={"ID":"c1e059e3-4a65-45e0-827b-3a7e0cd01181","Type":"ContainerStarted","Data":"4dce9b93e06f67d1751cd23ea246e2be605f5abcb30f234094214e53239526e1"}
Jul 09 00:58:11.467842 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:11.467804    2565 generic.go:356] "Generic (PLEG): container finished" podID="c1e059e3-4a65-45e0-827b-3a7e0cd01181" containerID="5d99ff674a755af6113cf61d2f50a69457317aaf10b12999604bd1fd563cc931" exitCode=0
Jul 09 00:58:11.468226 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:11.467854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh" event={"ID":"c1e059e3-4a65-45e0-827b-3a7e0cd01181","Type":"ContainerDied","Data":"5d99ff674a755af6113cf61d2f50a69457317aaf10b12999604bd1fd563cc931"}
Jul 09 00:58:14.482684 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:14.482651    2565 generic.go:356] "Generic (PLEG): container finished" podID="c1e059e3-4a65-45e0-827b-3a7e0cd01181" containerID="8181f13aa7a59f0a526810421613b623d4eafb6318ff5ae6656e17484f8a43c0" exitCode=0
Jul 09 00:58:14.483070 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:14.482692    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh" event={"ID":"c1e059e3-4a65-45e0-827b-3a7e0cd01181","Type":"ContainerDied","Data":"8181f13aa7a59f0a526810421613b623d4eafb6318ff5ae6656e17484f8a43c0"}
Jul 09 00:58:22.517076 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:22.516989    2565 generic.go:356] "Generic (PLEG): container finished" podID="c1e059e3-4a65-45e0-827b-3a7e0cd01181" containerID="c8d21d8cbedd835480fe3bc33bc6f5c10cded2dd578e4432afd3205fff774015" exitCode=0
Jul 09 00:58:22.517076 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:22.517036    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh" event={"ID":"c1e059e3-4a65-45e0-827b-3a7e0cd01181","Type":"ContainerDied","Data":"c8d21d8cbedd835480fe3bc33bc6f5c10cded2dd578e4432afd3205fff774015"}
Jul 09 00:58:23.651354 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:23.651327    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh"
Jul 09 00:58:23.710551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:23.710511    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1e059e3-4a65-45e0-827b-3a7e0cd01181-util\") pod \"c1e059e3-4a65-45e0-827b-3a7e0cd01181\" (UID: \"c1e059e3-4a65-45e0-827b-3a7e0cd01181\") "
Jul 09 00:58:23.710710 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:23.710567    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1e059e3-4a65-45e0-827b-3a7e0cd01181-bundle\") pod \"c1e059e3-4a65-45e0-827b-3a7e0cd01181\" (UID: \"c1e059e3-4a65-45e0-827b-3a7e0cd01181\") "
Jul 09 00:58:23.710710 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:23.710623    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8755q\" (UniqueName: \"kubernetes.io/projected/c1e059e3-4a65-45e0-827b-3a7e0cd01181-kube-api-access-8755q\") pod \"c1e059e3-4a65-45e0-827b-3a7e0cd01181\" (UID: \"c1e059e3-4a65-45e0-827b-3a7e0cd01181\") "
Jul 09 00:58:23.711198 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:23.711174    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1e059e3-4a65-45e0-827b-3a7e0cd01181-bundle" (OuterVolumeSpecName: "bundle") pod "c1e059e3-4a65-45e0-827b-3a7e0cd01181" (UID: "c1e059e3-4a65-45e0-827b-3a7e0cd01181"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 00:58:23.712855 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:23.712830    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1e059e3-4a65-45e0-827b-3a7e0cd01181-kube-api-access-8755q" (OuterVolumeSpecName: "kube-api-access-8755q") pod "c1e059e3-4a65-45e0-827b-3a7e0cd01181" (UID: "c1e059e3-4a65-45e0-827b-3a7e0cd01181"). InnerVolumeSpecName "kube-api-access-8755q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 00:58:23.714793 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:23.714775    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1e059e3-4a65-45e0-827b-3a7e0cd01181-util" (OuterVolumeSpecName: "util") pod "c1e059e3-4a65-45e0-827b-3a7e0cd01181" (UID: "c1e059e3-4a65-45e0-827b-3a7e0cd01181"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 00:58:23.811246 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:23.811124    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1e059e3-4a65-45e0-827b-3a7e0cd01181-bundle\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:58:23.811246 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:23.811174    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8755q\" (UniqueName: \"kubernetes.io/projected/c1e059e3-4a65-45e0-827b-3a7e0cd01181-kube-api-access-8755q\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:58:23.811246 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:23.811189    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1e059e3-4a65-45e0-827b-3a7e0cd01181-util\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:58:24.526358 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:24.526322    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh" event={"ID":"c1e059e3-4a65-45e0-827b-3a7e0cd01181","Type":"ContainerDied","Data":"4dce9b93e06f67d1751cd23ea246e2be605f5abcb30f234094214e53239526e1"}
Jul 09 00:58:24.526606 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:24.526364    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxbh"
Jul 09 00:58:24.526606 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:24.526372    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4dce9b93e06f67d1751cd23ea246e2be605f5abcb30f234094214e53239526e1"
Jul 09 00:58:30.467586 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.467541    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dpz2c"]
Jul 09 00:58:30.467972 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.467826    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e059e3-4a65-45e0-827b-3a7e0cd01181" containerName="extract"
Jul 09 00:58:30.467972 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.467837    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e059e3-4a65-45e0-827b-3a7e0cd01181" containerName="extract"
Jul 09 00:58:30.467972 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.467845    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e059e3-4a65-45e0-827b-3a7e0cd01181" containerName="util"
Jul 09 00:58:30.467972 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.467851    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e059e3-4a65-45e0-827b-3a7e0cd01181" containerName="util"
Jul 09 00:58:30.467972 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.467867    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e059e3-4a65-45e0-827b-3a7e0cd01181" containerName="pull"
Jul 09 00:58:30.467972 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.467873    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e059e3-4a65-45e0-827b-3a7e0cd01181" containerName="pull"
Jul 09 00:58:30.467972 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.467924    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1e059e3-4a65-45e0-827b-3a7e0cd01181" containerName="extract"
Jul 09 00:58:30.471266 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.471247    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dpz2c"
Jul 09 00:58:30.473846 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.473815    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 09 00:58:30.473979 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.473944    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 09 00:58:30.474036 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.473977    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rqfft\""
Jul 09 00:58:30.481474 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.481439    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dpz2c"]
Jul 09 00:58:30.566966 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.566936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt6fb\" (UniqueName: \"kubernetes.io/projected/38450633-98b4-43eb-b4c8-e38ffde3dbe3-kube-api-access-pt6fb\") pod \"cert-manager-operator-controller-manager-55c444bf86-dpz2c\" (UID: \"38450633-98b4-43eb-b4c8-e38ffde3dbe3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dpz2c"
Jul 09 00:58:30.567128 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.566990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38450633-98b4-43eb-b4c8-e38ffde3dbe3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dpz2c\" (UID: \"38450633-98b4-43eb-b4c8-e38ffde3dbe3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dpz2c"
Jul 09 00:58:30.667790 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.667753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38450633-98b4-43eb-b4c8-e38ffde3dbe3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dpz2c\" (UID: \"38450633-98b4-43eb-b4c8-e38ffde3dbe3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dpz2c"
Jul 09 00:58:30.667962 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.667831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt6fb\" (UniqueName: \"kubernetes.io/projected/38450633-98b4-43eb-b4c8-e38ffde3dbe3-kube-api-access-pt6fb\") pod \"cert-manager-operator-controller-manager-55c444bf86-dpz2c\" (UID: \"38450633-98b4-43eb-b4c8-e38ffde3dbe3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dpz2c"
Jul 09 00:58:30.668162 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.668144    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38450633-98b4-43eb-b4c8-e38ffde3dbe3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dpz2c\" (UID: \"38450633-98b4-43eb-b4c8-e38ffde3dbe3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dpz2c"
Jul 09 00:58:30.678313 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.678281    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt6fb\" (UniqueName: \"kubernetes.io/projected/38450633-98b4-43eb-b4c8-e38ffde3dbe3-kube-api-access-pt6fb\") pod \"cert-manager-operator-controller-manager-55c444bf86-dpz2c\" (UID: \"38450633-98b4-43eb-b4c8-e38ffde3dbe3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dpz2c"
Jul 09 00:58:30.780086 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.780058    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dpz2c"
Jul 09 00:58:30.910861 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:30.910837    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dpz2c"]
Jul 09 00:58:30.913262 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:58:30.913239    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38450633_98b4_43eb_b4c8_e38ffde3dbe3.slice/crio-f45739e02c2025fa7399ee81223dec4d8418871bddb5639b30261e804c58726b WatchSource:0}: Error finding container f45739e02c2025fa7399ee81223dec4d8418871bddb5639b30261e804c58726b: Status 404 returned error can't find the container with id f45739e02c2025fa7399ee81223dec4d8418871bddb5639b30261e804c58726b
Jul 09 00:58:31.552989 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:31.552960    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dpz2c" event={"ID":"38450633-98b4-43eb-b4c8-e38ffde3dbe3","Type":"ContainerStarted","Data":"f45739e02c2025fa7399ee81223dec4d8418871bddb5639b30261e804c58726b"}
Jul 09 00:58:33.563246 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:33.563197    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dpz2c" event={"ID":"38450633-98b4-43eb-b4c8-e38ffde3dbe3","Type":"ContainerStarted","Data":"cc00d635f01772bce8c6a290e52c684d5f20e4e3aa14cd0dafee7f4cfc34463a"}
Jul 09 00:58:33.587770 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:33.587716    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dpz2c" podStartSLOduration=1.9836272209999999 podStartE2EDuration="3.587698649s" totalImagesPullingTime="1.604071428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:58:33.585348449 +0000 UTC m=+198.648843157" watchObservedRunningTime="2026-07-09 00:58:33.587698649 +0000 UTC m=+198.651193354"
Jul 09 00:58:34.612663 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:34.612632    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf"]
Jul 09 00:58:34.615308 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:34.615292    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf"
Jul 09 00:58:34.617632 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:34.617607    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cgghp\""
Jul 09 00:58:34.617733 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:34.617708    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 00:58:34.618490 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:34.618462    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 00:58:34.623653 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:34.623631    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf"]
Jul 09 00:58:34.703112 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:34.703064    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg56n\" (UniqueName: \"kubernetes.io/projected/ba59cf76-ed37-49a0-ad91-e3b595acdf39-kube-api-access-pg56n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf\" (UID: \"ba59cf76-ed37-49a0-ad91-e3b595acdf39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf"
Jul 09 00:58:34.703315 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:34.703131    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba59cf76-ed37-49a0-ad91-e3b595acdf39-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf\" (UID: \"ba59cf76-ed37-49a0-ad91-e3b595acdf39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf"
Jul 09 00:58:34.703315 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:34.703161    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba59cf76-ed37-49a0-ad91-e3b595acdf39-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf\" (UID: \"ba59cf76-ed37-49a0-ad91-e3b595acdf39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf"
Jul 09 00:58:34.804279 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:34.804238    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg56n\" (UniqueName: \"kubernetes.io/projected/ba59cf76-ed37-49a0-ad91-e3b595acdf39-kube-api-access-pg56n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf\" (UID: \"ba59cf76-ed37-49a0-ad91-e3b595acdf39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf"
Jul 09 00:58:34.804514 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:34.804294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba59cf76-ed37-49a0-ad91-e3b595acdf39-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf\" (UID: \"ba59cf76-ed37-49a0-ad91-e3b595acdf39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf"
Jul 09 00:58:34.804514 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:34.804317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba59cf76-ed37-49a0-ad91-e3b595acdf39-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf\" (UID: \"ba59cf76-ed37-49a0-ad91-e3b595acdf39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf"
Jul 09 00:58:34.804668 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:34.804650    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba59cf76-ed37-49a0-ad91-e3b595acdf39-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf\" (UID: \"ba59cf76-ed37-49a0-ad91-e3b595acdf39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf"
Jul 09 00:58:34.804745 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:34.804718    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba59cf76-ed37-49a0-ad91-e3b595acdf39-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf\" (UID: \"ba59cf76-ed37-49a0-ad91-e3b595acdf39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf"
Jul 09 00:58:34.815480 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:34.815452    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg56n\" (UniqueName: \"kubernetes.io/projected/ba59cf76-ed37-49a0-ad91-e3b595acdf39-kube-api-access-pg56n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf\" (UID: \"ba59cf76-ed37-49a0-ad91-e3b595acdf39\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf"
Jul 09 00:58:34.924890 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:34.924799    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf"
Jul 09 00:58:35.053674 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:35.053593    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf"]
Jul 09 00:58:35.056182 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:58:35.056155    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba59cf76_ed37_49a0_ad91_e3b595acdf39.slice/crio-482176dd0b187f9d37cd169cabded6a26da02f0d23127e3010d88d1915145171 WatchSource:0}: Error finding container 482176dd0b187f9d37cd169cabded6a26da02f0d23127e3010d88d1915145171: Status 404 returned error can't find the container with id 482176dd0b187f9d37cd169cabded6a26da02f0d23127e3010d88d1915145171
Jul 09 00:58:35.573225 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:35.573178    2565 generic.go:356] "Generic (PLEG): container finished" podID="ba59cf76-ed37-49a0-ad91-e3b595acdf39" containerID="f7ec3c57ad52eb381dc21381110abec71aac83951d30968b007eeb950bfc7700" exitCode=0
Jul 09 00:58:35.573407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:35.573230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf" event={"ID":"ba59cf76-ed37-49a0-ad91-e3b595acdf39","Type":"ContainerDied","Data":"f7ec3c57ad52eb381dc21381110abec71aac83951d30968b007eeb950bfc7700"}
Jul 09 00:58:35.573407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:35.573283    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf" event={"ID":"ba59cf76-ed37-49a0-ad91-e3b595acdf39","Type":"ContainerStarted","Data":"482176dd0b187f9d37cd169cabded6a26da02f0d23127e3010d88d1915145171"}
Jul 09 00:58:37.199277 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:37.199236    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wtdb4"]
Jul 09 00:58:37.205246 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:37.205222    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wtdb4"
Jul 09 00:58:37.207576 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:37.207551    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 00:58:37.208358 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:37.208340    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-g8n67\""
Jul 09 00:58:37.208451 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:37.208346    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 00:58:37.211906 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:37.211883    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wtdb4"]
Jul 09 00:58:37.326458 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:37.326420    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/baee9a1b-9081-4694-9536-c2f27652dca5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wtdb4\" (UID: \"baee9a1b-9081-4694-9536-c2f27652dca5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wtdb4"
Jul 09 00:58:37.326627 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:37.326476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j8mv\" (UniqueName: \"kubernetes.io/projected/baee9a1b-9081-4694-9536-c2f27652dca5-kube-api-access-8j8mv\") pod \"cert-manager-cainjector-559cdd8c87-wtdb4\" (UID: \"baee9a1b-9081-4694-9536-c2f27652dca5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wtdb4"
Jul 09 00:58:37.427536 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:37.427502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/baee9a1b-9081-4694-9536-c2f27652dca5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wtdb4\" (UID: \"baee9a1b-9081-4694-9536-c2f27652dca5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wtdb4"
Jul 09 00:58:37.427724 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:37.427545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j8mv\" (UniqueName: \"kubernetes.io/projected/baee9a1b-9081-4694-9536-c2f27652dca5-kube-api-access-8j8mv\") pod \"cert-manager-cainjector-559cdd8c87-wtdb4\" (UID: \"baee9a1b-9081-4694-9536-c2f27652dca5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wtdb4"
Jul 09 00:58:37.435406 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:37.435374    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/baee9a1b-9081-4694-9536-c2f27652dca5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wtdb4\" (UID: \"baee9a1b-9081-4694-9536-c2f27652dca5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wtdb4"
Jul 09 00:58:37.435571 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:37.435554    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j8mv\" (UniqueName: \"kubernetes.io/projected/baee9a1b-9081-4694-9536-c2f27652dca5-kube-api-access-8j8mv\") pod \"cert-manager-cainjector-559cdd8c87-wtdb4\" (UID: \"baee9a1b-9081-4694-9536-c2f27652dca5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wtdb4"
Jul 09 00:58:37.526162 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:37.526137    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wtdb4"
Jul 09 00:58:37.655439 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:37.655418    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wtdb4"]
Jul 09 00:58:37.673077 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:58:37.673046    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbaee9a1b_9081_4694_9536_c2f27652dca5.slice/crio-d4c6460bdc2be12958f4f3378d953580cc42dab5ed166fc12c30bd4ba603c62b WatchSource:0}: Error finding container d4c6460bdc2be12958f4f3378d953580cc42dab5ed166fc12c30bd4ba603c62b: Status 404 returned error can't find the container with id d4c6460bdc2be12958f4f3378d953580cc42dab5ed166fc12c30bd4ba603c62b
Jul 09 00:58:38.591488 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:38.591448    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wtdb4" event={"ID":"baee9a1b-9081-4694-9536-c2f27652dca5","Type":"ContainerStarted","Data":"d4c6460bdc2be12958f4f3378d953580cc42dab5ed166fc12c30bd4ba603c62b"}
Jul 09 00:58:38.593143 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:38.593119    2565 generic.go:356] "Generic (PLEG): container finished" podID="ba59cf76-ed37-49a0-ad91-e3b595acdf39" containerID="46b3a8de5c68de771d33f45ccc987559ec424fece440c1b749f99bcce4feb42f" exitCode=0
Jul 09 00:58:38.593268 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:38.593221    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf" event={"ID":"ba59cf76-ed37-49a0-ad91-e3b595acdf39","Type":"ContainerDied","Data":"46b3a8de5c68de771d33f45ccc987559ec424fece440c1b749f99bcce4feb42f"}
Jul 09 00:58:39.600532 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:39.600497    2565 generic.go:356] "Generic (PLEG): container finished" podID="ba59cf76-ed37-49a0-ad91-e3b595acdf39" containerID="33d52fd43a1cdbfc66425926781a7013882ea7b6c56b7d6f19988236ad6e9382" exitCode=0
Jul 09 00:58:39.600988 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:39.600599    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf" event={"ID":"ba59cf76-ed37-49a0-ad91-e3b595acdf39","Type":"ContainerDied","Data":"33d52fd43a1cdbfc66425926781a7013882ea7b6c56b7d6f19988236ad6e9382"}
Jul 09 00:58:40.815638 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:40.815616    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf"
Jul 09 00:58:40.957149 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:40.957116    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba59cf76-ed37-49a0-ad91-e3b595acdf39-bundle\") pod \"ba59cf76-ed37-49a0-ad91-e3b595acdf39\" (UID: \"ba59cf76-ed37-49a0-ad91-e3b595acdf39\") "
Jul 09 00:58:40.957318 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:40.957172    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg56n\" (UniqueName: \"kubernetes.io/projected/ba59cf76-ed37-49a0-ad91-e3b595acdf39-kube-api-access-pg56n\") pod \"ba59cf76-ed37-49a0-ad91-e3b595acdf39\" (UID: \"ba59cf76-ed37-49a0-ad91-e3b595acdf39\") "
Jul 09 00:58:40.957318 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:40.957285    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba59cf76-ed37-49a0-ad91-e3b595acdf39-util\") pod \"ba59cf76-ed37-49a0-ad91-e3b595acdf39\" (UID: \"ba59cf76-ed37-49a0-ad91-e3b595acdf39\") "
Jul 09 00:58:40.957650 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:40.957621    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba59cf76-ed37-49a0-ad91-e3b595acdf39-bundle" (OuterVolumeSpecName: "bundle") pod "ba59cf76-ed37-49a0-ad91-e3b595acdf39" (UID: "ba59cf76-ed37-49a0-ad91-e3b595acdf39"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 00:58:40.959433 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:40.959404    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba59cf76-ed37-49a0-ad91-e3b595acdf39-kube-api-access-pg56n" (OuterVolumeSpecName: "kube-api-access-pg56n") pod "ba59cf76-ed37-49a0-ad91-e3b595acdf39" (UID: "ba59cf76-ed37-49a0-ad91-e3b595acdf39"). InnerVolumeSpecName "kube-api-access-pg56n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 00:58:40.962439 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:40.962413    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba59cf76-ed37-49a0-ad91-e3b595acdf39-util" (OuterVolumeSpecName: "util") pod "ba59cf76-ed37-49a0-ad91-e3b595acdf39" (UID: "ba59cf76-ed37-49a0-ad91-e3b595acdf39"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 00:58:41.010973 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.010938    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bvtg4"]
Jul 09 00:58:41.011280 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.011267    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba59cf76-ed37-49a0-ad91-e3b595acdf39" containerName="util"
Jul 09 00:58:41.011336 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.011282    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba59cf76-ed37-49a0-ad91-e3b595acdf39" containerName="util"
Jul 09 00:58:41.011336 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.011299    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba59cf76-ed37-49a0-ad91-e3b595acdf39" containerName="pull"
Jul 09 00:58:41.011336 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.011304    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba59cf76-ed37-49a0-ad91-e3b595acdf39" containerName="pull"
Jul 09 00:58:41.011336 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.011319    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba59cf76-ed37-49a0-ad91-e3b595acdf39" containerName="extract"
Jul 09 00:58:41.011336 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.011325    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba59cf76-ed37-49a0-ad91-e3b595acdf39" containerName="extract"
Jul 09 00:58:41.011473 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.011368    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba59cf76-ed37-49a0-ad91-e3b595acdf39" containerName="extract"
Jul 09 00:58:41.014414 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.014398    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bvtg4"
Jul 09 00:58:41.016476 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.016454    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-kx66f\""
Jul 09 00:58:41.022529 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.022505    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bvtg4"]
Jul 09 00:58:41.058839 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.058806    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba59cf76-ed37-49a0-ad91-e3b595acdf39-util\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:58:41.058839 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.058833    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba59cf76-ed37-49a0-ad91-e3b595acdf39-bundle\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:58:41.058839 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.058843    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg56n\" (UniqueName: \"kubernetes.io/projected/ba59cf76-ed37-49a0-ad91-e3b595acdf39-kube-api-access-pg56n\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:58:41.160079 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.159982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/edb7debb-e23b-49bc-8dd8-fc1a088dc8f9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bvtg4\" (UID: \"edb7debb-e23b-49bc-8dd8-fc1a088dc8f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bvtg4"
Jul 09 00:58:41.160079 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.160049    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz8rd\" (UniqueName: \"kubernetes.io/projected/edb7debb-e23b-49bc-8dd8-fc1a088dc8f9-kube-api-access-bz8rd\") pod \"cert-manager-webhook-6486ffd997-bvtg4\" (UID: \"edb7debb-e23b-49bc-8dd8-fc1a088dc8f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bvtg4"
Jul 09 00:58:41.260633 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.260595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz8rd\" (UniqueName: \"kubernetes.io/projected/edb7debb-e23b-49bc-8dd8-fc1a088dc8f9-kube-api-access-bz8rd\") pod \"cert-manager-webhook-6486ffd997-bvtg4\" (UID: \"edb7debb-e23b-49bc-8dd8-fc1a088dc8f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bvtg4"
Jul 09 00:58:41.260829 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.260670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/edb7debb-e23b-49bc-8dd8-fc1a088dc8f9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bvtg4\" (UID: \"edb7debb-e23b-49bc-8dd8-fc1a088dc8f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bvtg4"
Jul 09 00:58:41.269235 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.269193    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/edb7debb-e23b-49bc-8dd8-fc1a088dc8f9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bvtg4\" (UID: \"edb7debb-e23b-49bc-8dd8-fc1a088dc8f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bvtg4"
Jul 09 00:58:41.269341 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.269261    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz8rd\" (UniqueName: \"kubernetes.io/projected/edb7debb-e23b-49bc-8dd8-fc1a088dc8f9-kube-api-access-bz8rd\") pod \"cert-manager-webhook-6486ffd997-bvtg4\" (UID: \"edb7debb-e23b-49bc-8dd8-fc1a088dc8f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bvtg4"
Jul 09 00:58:41.324474 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.324435    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bvtg4"
Jul 09 00:58:41.455674 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.455463    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bvtg4"]
Jul 09 00:58:41.458085 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:58:41.458055    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedb7debb_e23b_49bc_8dd8_fc1a088dc8f9.slice/crio-5499e56dd19183c60238ee557bfb06fe3959080b0bfb5fde57b6444419ac8510 WatchSource:0}: Error finding container 5499e56dd19183c60238ee557bfb06fe3959080b0bfb5fde57b6444419ac8510: Status 404 returned error can't find the container with id 5499e56dd19183c60238ee557bfb06fe3959080b0bfb5fde57b6444419ac8510
Jul 09 00:58:41.611745 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.611716    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf"
Jul 09 00:58:41.611928 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.611716    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc7wrf" event={"ID":"ba59cf76-ed37-49a0-ad91-e3b595acdf39","Type":"ContainerDied","Data":"482176dd0b187f9d37cd169cabded6a26da02f0d23127e3010d88d1915145171"}
Jul 09 00:58:41.611928 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.611898    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="482176dd0b187f9d37cd169cabded6a26da02f0d23127e3010d88d1915145171"
Jul 09 00:58:41.615001 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.614961    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bvtg4" event={"ID":"edb7debb-e23b-49bc-8dd8-fc1a088dc8f9","Type":"ContainerStarted","Data":"6ca7c251f1d1e37a6551ec20a0810e8ad5b11fb6202a682f2b445a3cc6ee226e"}
Jul 09 00:58:41.615165 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.615015    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bvtg4" event={"ID":"edb7debb-e23b-49bc-8dd8-fc1a088dc8f9","Type":"ContainerStarted","Data":"5499e56dd19183c60238ee557bfb06fe3959080b0bfb5fde57b6444419ac8510"}
Jul 09 00:58:41.615165 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.615040    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bvtg4"
Jul 09 00:58:41.616956 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.616933    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wtdb4" event={"ID":"baee9a1b-9081-4694-9536-c2f27652dca5","Type":"ContainerStarted","Data":"365f5e109b6f562314ea5144cd41d1696bf61fde671ed515729da8d5b2fd578c"}
Jul 09 00:58:41.641906 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.641851    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-bvtg4" podStartSLOduration=1.641834005 podStartE2EDuration="1.641834005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:58:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:58:41.628645124 +0000 UTC m=+206.692139829" watchObservedRunningTime="2026-07-09 00:58:41.641834005 +0000 UTC m=+206.705328711"
Jul 09 00:58:41.643072 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:41.643039    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wtdb4" podStartSLOduration=1.449782556 podStartE2EDuration="4.643030692s" totalImagesPullingTime="3.193248136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:58:41.641272787 +0000 UTC m=+206.704767492" watchObservedRunningTime="2026-07-09 00:58:41.643030692 +0000 UTC m=+206.706525397"
Jul 09 00:58:47.623933 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:47.623906    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bvtg4"
Jul 09 00:58:55.035269 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.035235    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz"]
Jul 09 00:58:55.060164 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.060136    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz"]
Jul 09 00:58:55.060341 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.060262    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz"
Jul 09 00:58:55.062797 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.062776    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 00:58:55.063437 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.063414    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 00:58:55.063512 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.063414    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cgghp\""
Jul 09 00:58:55.066914 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.066894    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/193ebcb0-334d-4bb1-8d0e-b35947211db4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz\" (UID: \"193ebcb0-334d-4bb1-8d0e-b35947211db4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz"
Jul 09 00:58:55.066996 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.066942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/193ebcb0-334d-4bb1-8d0e-b35947211db4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz\" (UID: \"193ebcb0-334d-4bb1-8d0e-b35947211db4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz"
Jul 09 00:58:55.066996 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.066972    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq88s\" (UniqueName: \"kubernetes.io/projected/193ebcb0-334d-4bb1-8d0e-b35947211db4-kube-api-access-gq88s\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz\" (UID: \"193ebcb0-334d-4bb1-8d0e-b35947211db4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz"
Jul 09 00:58:55.168183 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.168144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/193ebcb0-334d-4bb1-8d0e-b35947211db4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz\" (UID: \"193ebcb0-334d-4bb1-8d0e-b35947211db4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz"
Jul 09 00:58:55.168183 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.168187    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq88s\" (UniqueName: \"kubernetes.io/projected/193ebcb0-334d-4bb1-8d0e-b35947211db4-kube-api-access-gq88s\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz\" (UID: \"193ebcb0-334d-4bb1-8d0e-b35947211db4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz"
Jul 09 00:58:55.168422 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.168250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/193ebcb0-334d-4bb1-8d0e-b35947211db4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz\" (UID: \"193ebcb0-334d-4bb1-8d0e-b35947211db4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz"
Jul 09 00:58:55.168568 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.168548    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/193ebcb0-334d-4bb1-8d0e-b35947211db4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz\" (UID: \"193ebcb0-334d-4bb1-8d0e-b35947211db4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz"
Jul 09 00:58:55.168620 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.168581    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/193ebcb0-334d-4bb1-8d0e-b35947211db4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz\" (UID: \"193ebcb0-334d-4bb1-8d0e-b35947211db4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz"
Jul 09 00:58:55.175807 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.175780    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq88s\" (UniqueName: \"kubernetes.io/projected/193ebcb0-334d-4bb1-8d0e-b35947211db4-kube-api-access-gq88s\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz\" (UID: \"193ebcb0-334d-4bb1-8d0e-b35947211db4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz"
Jul 09 00:58:55.370126 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.370041    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz"
Jul 09 00:58:55.527501 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.527478    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz"]
Jul 09 00:58:55.530079 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:58:55.530057    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod193ebcb0_334d_4bb1_8d0e_b35947211db4.slice/crio-abf839f28986e1673aeba1a94ecebb2bc326e5912c5349420f4304bd6b189321 WatchSource:0}: Error finding container abf839f28986e1673aeba1a94ecebb2bc326e5912c5349420f4304bd6b189321: Status 404 returned error can't find the container with id abf839f28986e1673aeba1a94ecebb2bc326e5912c5349420f4304bd6b189321
Jul 09 00:58:55.676073 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.676033    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz" event={"ID":"193ebcb0-334d-4bb1-8d0e-b35947211db4","Type":"ContainerStarted","Data":"345e8d7be410ab7c677355169297964c856d7c4d79723bc2e61ee4ce128e77be"}
Jul 09 00:58:55.676227 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:55.676087    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz" event={"ID":"193ebcb0-334d-4bb1-8d0e-b35947211db4","Type":"ContainerStarted","Data":"abf839f28986e1673aeba1a94ecebb2bc326e5912c5349420f4304bd6b189321"}
Jul 09 00:58:56.681566 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:56.681527    2565 generic.go:356] "Generic (PLEG): container finished" podID="193ebcb0-334d-4bb1-8d0e-b35947211db4" containerID="345e8d7be410ab7c677355169297964c856d7c4d79723bc2e61ee4ce128e77be" exitCode=0
Jul 09 00:58:56.681992 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:56.681623    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz" event={"ID":"193ebcb0-334d-4bb1-8d0e-b35947211db4","Type":"ContainerDied","Data":"345e8d7be410ab7c677355169297964c856d7c4d79723bc2e61ee4ce128e77be"}
Jul 09 00:58:57.687404 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:57.687369    2565 generic.go:356] "Generic (PLEG): container finished" podID="193ebcb0-334d-4bb1-8d0e-b35947211db4" containerID="d02376638f38a4c2eaf115013f75cfac52bd8e0678d9212a0d906b586f1c2989" exitCode=0
Jul 09 00:58:57.687798 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:57.687443    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz" event={"ID":"193ebcb0-334d-4bb1-8d0e-b35947211db4","Type":"ContainerDied","Data":"d02376638f38a4c2eaf115013f75cfac52bd8e0678d9212a0d906b586f1c2989"}
Jul 09 00:58:58.693106 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:58.693067    2565 generic.go:356] "Generic (PLEG): container finished" podID="193ebcb0-334d-4bb1-8d0e-b35947211db4" containerID="3eb20f61ec31e913be78ff482fa6ac5626ad345f1bf0c84e9ea4f54f4de4278b" exitCode=0
Jul 09 00:58:58.693538 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:58.693153    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz" event={"ID":"193ebcb0-334d-4bb1-8d0e-b35947211db4","Type":"ContainerDied","Data":"3eb20f61ec31e913be78ff482fa6ac5626ad345f1bf0c84e9ea4f54f4de4278b"}
Jul 09 00:58:59.833901 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:59.833876    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz"
Jul 09 00:58:59.912789 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:59.912751    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/193ebcb0-334d-4bb1-8d0e-b35947211db4-bundle\") pod \"193ebcb0-334d-4bb1-8d0e-b35947211db4\" (UID: \"193ebcb0-334d-4bb1-8d0e-b35947211db4\") "
Jul 09 00:58:59.912977 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:59.912806    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/193ebcb0-334d-4bb1-8d0e-b35947211db4-util\") pod \"193ebcb0-334d-4bb1-8d0e-b35947211db4\" (UID: \"193ebcb0-334d-4bb1-8d0e-b35947211db4\") "
Jul 09 00:58:59.912977 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:59.912831    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq88s\" (UniqueName: \"kubernetes.io/projected/193ebcb0-334d-4bb1-8d0e-b35947211db4-kube-api-access-gq88s\") pod \"193ebcb0-334d-4bb1-8d0e-b35947211db4\" (UID: \"193ebcb0-334d-4bb1-8d0e-b35947211db4\") "
Jul 09 00:58:59.913676 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:59.913625    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193ebcb0-334d-4bb1-8d0e-b35947211db4-bundle" (OuterVolumeSpecName: "bundle") pod "193ebcb0-334d-4bb1-8d0e-b35947211db4" (UID: "193ebcb0-334d-4bb1-8d0e-b35947211db4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 00:58:59.915017 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:59.914990    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/193ebcb0-334d-4bb1-8d0e-b35947211db4-kube-api-access-gq88s" (OuterVolumeSpecName: "kube-api-access-gq88s") pod "193ebcb0-334d-4bb1-8d0e-b35947211db4" (UID: "193ebcb0-334d-4bb1-8d0e-b35947211db4"). InnerVolumeSpecName "kube-api-access-gq88s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 00:58:59.918760 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:58:59.918723    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193ebcb0-334d-4bb1-8d0e-b35947211db4-util" (OuterVolumeSpecName: "util") pod "193ebcb0-334d-4bb1-8d0e-b35947211db4" (UID: "193ebcb0-334d-4bb1-8d0e-b35947211db4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 00:59:00.013773 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:00.013731    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/193ebcb0-334d-4bb1-8d0e-b35947211db4-bundle\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:59:00.013773 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:00.013764    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/193ebcb0-334d-4bb1-8d0e-b35947211db4-util\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:59:00.013773 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:00.013773    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq88s\" (UniqueName: \"kubernetes.io/projected/193ebcb0-334d-4bb1-8d0e-b35947211db4-kube-api-access-gq88s\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:59:00.703917 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:00.703895    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz"
Jul 09 00:59:00.703917 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:00.703898    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7x6vz" event={"ID":"193ebcb0-334d-4bb1-8d0e-b35947211db4","Type":"ContainerDied","Data":"abf839f28986e1673aeba1a94ecebb2bc326e5912c5349420f4304bd6b189321"}
Jul 09 00:59:00.704149 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:00.703937    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="abf839f28986e1673aeba1a94ecebb2bc326e5912c5349420f4304bd6b189321"
Jul 09 00:59:12.540956 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.540915    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"]
Jul 09 00:59:12.541439 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.541377    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="193ebcb0-334d-4bb1-8d0e-b35947211db4" containerName="extract"
Jul 09 00:59:12.541439 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.541394    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="193ebcb0-334d-4bb1-8d0e-b35947211db4" containerName="extract"
Jul 09 00:59:12.541439 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.541419    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="193ebcb0-334d-4bb1-8d0e-b35947211db4" containerName="util"
Jul 09 00:59:12.541439 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.541427    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="193ebcb0-334d-4bb1-8d0e-b35947211db4" containerName="util"
Jul 09 00:59:12.541646 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.541449    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="193ebcb0-334d-4bb1-8d0e-b35947211db4" containerName="pull"
Jul 09 00:59:12.541646 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.541458    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="193ebcb0-334d-4bb1-8d0e-b35947211db4" containerName="pull"
Jul 09 00:59:12.541646 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.541545    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="193ebcb0-334d-4bb1-8d0e-b35947211db4" containerName="extract"
Jul 09 00:59:12.594180 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.594108    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"]
Jul 09 00:59:12.594362 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.594259    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:12.597200 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.597141    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 00:59:12.597200 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.597190    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 00:59:12.597407 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.597344    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-h7fwd\""
Jul 09 00:59:12.597475 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.597453    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 00:59:12.597667 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.597646    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 00:59:12.616043 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.616013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bh84\" (UniqueName: \"kubernetes.io/projected/ef98fd89-f041-420d-9447-31ec62d8fefb-kube-api-access-8bh84\") pod \"opendatahub-operator-controller-manager-85699f56b9-tt2xl\" (UID: \"ef98fd89-f041-420d-9447-31ec62d8fefb\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:12.616159 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.616058    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef98fd89-f041-420d-9447-31ec62d8fefb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85699f56b9-tt2xl\" (UID: \"ef98fd89-f041-420d-9447-31ec62d8fefb\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:12.616159 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.616121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef98fd89-f041-420d-9447-31ec62d8fefb-tmp\") pod \"opendatahub-operator-controller-manager-85699f56b9-tt2xl\" (UID: \"ef98fd89-f041-420d-9447-31ec62d8fefb\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:12.616159 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.616144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef98fd89-f041-420d-9447-31ec62d8fefb-manifests\") pod \"opendatahub-operator-controller-manager-85699f56b9-tt2xl\" (UID: \"ef98fd89-f041-420d-9447-31ec62d8fefb\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:12.616290 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.616159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef98fd89-f041-420d-9447-31ec62d8fefb-webhook-cert\") pod \"opendatahub-operator-controller-manager-85699f56b9-tt2xl\" (UID: \"ef98fd89-f041-420d-9447-31ec62d8fefb\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:12.717004 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.716966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef98fd89-f041-420d-9447-31ec62d8fefb-manifests\") pod \"opendatahub-operator-controller-manager-85699f56b9-tt2xl\" (UID: \"ef98fd89-f041-420d-9447-31ec62d8fefb\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:12.717004 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.717000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef98fd89-f041-420d-9447-31ec62d8fefb-webhook-cert\") pod \"opendatahub-operator-controller-manager-85699f56b9-tt2xl\" (UID: \"ef98fd89-f041-420d-9447-31ec62d8fefb\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:12.717198 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.717047    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bh84\" (UniqueName: \"kubernetes.io/projected/ef98fd89-f041-420d-9447-31ec62d8fefb-kube-api-access-8bh84\") pod \"opendatahub-operator-controller-manager-85699f56b9-tt2xl\" (UID: \"ef98fd89-f041-420d-9447-31ec62d8fefb\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:12.717198 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.717076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef98fd89-f041-420d-9447-31ec62d8fefb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85699f56b9-tt2xl\" (UID: \"ef98fd89-f041-420d-9447-31ec62d8fefb\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:12.717198 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.717136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef98fd89-f041-420d-9447-31ec62d8fefb-tmp\") pod \"opendatahub-operator-controller-manager-85699f56b9-tt2xl\" (UID: \"ef98fd89-f041-420d-9447-31ec62d8fefb\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:12.717438 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.717415    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef98fd89-f041-420d-9447-31ec62d8fefb-manifests\") pod \"opendatahub-operator-controller-manager-85699f56b9-tt2xl\" (UID: \"ef98fd89-f041-420d-9447-31ec62d8fefb\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:12.719425 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.719395    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef98fd89-f041-420d-9447-31ec62d8fefb-tmp\") pod \"opendatahub-operator-controller-manager-85699f56b9-tt2xl\" (UID: \"ef98fd89-f041-420d-9447-31ec62d8fefb\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:12.719592 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.719574    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef98fd89-f041-420d-9447-31ec62d8fefb-webhook-cert\") pod \"opendatahub-operator-controller-manager-85699f56b9-tt2xl\" (UID: \"ef98fd89-f041-420d-9447-31ec62d8fefb\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:12.719657 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.719644    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef98fd89-f041-420d-9447-31ec62d8fefb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85699f56b9-tt2xl\" (UID: \"ef98fd89-f041-420d-9447-31ec62d8fefb\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:12.725008 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.724985    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bh84\" (UniqueName: \"kubernetes.io/projected/ef98fd89-f041-420d-9447-31ec62d8fefb-kube-api-access-8bh84\") pod \"opendatahub-operator-controller-manager-85699f56b9-tt2xl\" (UID: \"ef98fd89-f041-420d-9447-31ec62d8fefb\") " pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:12.904833 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:12.904747    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:13.061327 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:13.061295    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"]
Jul 09 00:59:13.063819 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:59:13.063798    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef98fd89_f041_420d_9447_31ec62d8fefb.slice/crio-46544a0cae322a2c7b5e7cf585a76e82c710851e09860696650760d54411c173 WatchSource:0}: Error finding container 46544a0cae322a2c7b5e7cf585a76e82c710851e09860696650760d54411c173: Status 404 returned error can't find the container with id 46544a0cae322a2c7b5e7cf585a76e82c710851e09860696650760d54411c173
Jul 09 00:59:13.759576 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:13.759533    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl" event={"ID":"ef98fd89-f041-420d-9447-31ec62d8fefb","Type":"ContainerStarted","Data":"46544a0cae322a2c7b5e7cf585a76e82c710851e09860696650760d54411c173"}
Jul 09 00:59:16.775861 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:16.775818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl" event={"ID":"ef98fd89-f041-420d-9447-31ec62d8fefb","Type":"ContainerStarted","Data":"9d81ae2ca1fe41d5cb30957652966a7aaacf296de0bc9c8a3d33e5534f3d1e22"}
Jul 09 00:59:17.781881 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:17.781847    2565 generic.go:356] "Generic (PLEG): container finished" podID="ef98fd89-f041-420d-9447-31ec62d8fefb" containerID="9d81ae2ca1fe41d5cb30957652966a7aaacf296de0bc9c8a3d33e5534f3d1e22" exitCode=0
Jul 09 00:59:17.782259 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:17.781905    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl" event={"ID":"ef98fd89-f041-420d-9447-31ec62d8fefb","Type":"ContainerDied","Data":"9d81ae2ca1fe41d5cb30957652966a7aaacf296de0bc9c8a3d33e5534f3d1e22"}
Jul 09 00:59:18.788615 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:18.788581    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl" event={"ID":"ef98fd89-f041-420d-9447-31ec62d8fefb","Type":"ContainerStarted","Data":"2f9b275414c4b438059346cc3eae69618d534896d98348bf52b11eddb3b8841e"}
Jul 09 00:59:18.788959 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:18.788654    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:18.810460 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:18.810404    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl" podStartSLOduration=2.457503632 podStartE2EDuration="6.810387189s" totalImagesPullingTime="3.22434968s" totalInitContainerRuntime="1.128533877s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:59:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:59:18.809154771 +0000 UTC m=+243.872649477" watchObservedRunningTime="2026-07-09 00:59:18.810387189 +0000 UTC m=+243.873881893"
Jul 09 00:59:29.795653 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:29.795626    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85699f56b9-tt2xl"
Jul 09 00:59:32.383043 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.383002    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bm452"]
Jul 09 00:59:32.391446 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.391418    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bm452"
Jul 09 00:59:32.397796 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.397337    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qpvm4\""
Jul 09 00:59:32.397796 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.397381    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 09 00:59:32.401669 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.401649    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bm452"]
Jul 09 00:59:32.495661 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.495620    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqgqs\" (UniqueName: \"kubernetes.io/projected/61f2de59-b173-49be-9f17-28f0eb661091-kube-api-access-mqgqs\") pod \"odh-model-controller-7998c67dc4-bm452\" (UID: \"61f2de59-b173-49be-9f17-28f0eb661091\") " pod="opendatahub/odh-model-controller-7998c67dc4-bm452"
Jul 09 00:59:32.495832 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.495769    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61f2de59-b173-49be-9f17-28f0eb661091-cert\") pod \"odh-model-controller-7998c67dc4-bm452\" (UID: \"61f2de59-b173-49be-9f17-28f0eb661091\") " pod="opendatahub/odh-model-controller-7998c67dc4-bm452"
Jul 09 00:59:32.597035 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.596995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61f2de59-b173-49be-9f17-28f0eb661091-cert\") pod \"odh-model-controller-7998c67dc4-bm452\" (UID: \"61f2de59-b173-49be-9f17-28f0eb661091\") " pod="opendatahub/odh-model-controller-7998c67dc4-bm452"
Jul 09 00:59:32.597199 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.597064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqgqs\" (UniqueName: \"kubernetes.io/projected/61f2de59-b173-49be-9f17-28f0eb661091-kube-api-access-mqgqs\") pod \"odh-model-controller-7998c67dc4-bm452\" (UID: \"61f2de59-b173-49be-9f17-28f0eb661091\") " pod="opendatahub/odh-model-controller-7998c67dc4-bm452"
Jul 09 00:59:32.597199 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:59:32.597147    2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 09 00:59:32.597308 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:59:32.597247    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61f2de59-b173-49be-9f17-28f0eb661091-cert podName:61f2de59-b173-49be-9f17-28f0eb661091 nodeName:}" failed. No retries permitted until 2026-07-09 00:59:33.097206075 +0000 UTC m=+258.160700757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/61f2de59-b173-49be-9f17-28f0eb661091-cert") pod "odh-model-controller-7998c67dc4-bm452" (UID: "61f2de59-b173-49be-9f17-28f0eb661091") : secret "odh-model-controller-webhook-cert" not found
Jul 09 00:59:32.606453 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.606425    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqgqs\" (UniqueName: \"kubernetes.io/projected/61f2de59-b173-49be-9f17-28f0eb661091-kube-api-access-mqgqs\") pod \"odh-model-controller-7998c67dc4-bm452\" (UID: \"61f2de59-b173-49be-9f17-28f0eb661091\") " pod="opendatahub/odh-model-controller-7998c67dc4-bm452"
Jul 09 00:59:32.698023 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.697934    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7556c75c9b-848b5"]
Jul 09 00:59:32.701187 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.701167    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7556c75c9b-848b5"
Jul 09 00:59:32.703364 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.703344    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 00:59:32.703610 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.703596    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 00:59:32.703782 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.703767    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 00:59:32.703848 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.703784    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tqfz8\""
Jul 09 00:59:32.703848 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.703789    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 00:59:32.713035 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.713009    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7556c75c9b-848b5"]
Jul 09 00:59:32.798810 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.798771    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b8296be-5aa0-44ed-8285-930b05703c81-tls-certs\") pod \"kube-auth-proxy-7556c75c9b-848b5\" (UID: \"5b8296be-5aa0-44ed-8285-930b05703c81\") " pod="openshift-ingress/kube-auth-proxy-7556c75c9b-848b5"
Jul 09 00:59:32.798810 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.798814    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b8296be-5aa0-44ed-8285-930b05703c81-tmp\") pod \"kube-auth-proxy-7556c75c9b-848b5\" (UID: \"5b8296be-5aa0-44ed-8285-930b05703c81\") " pod="openshift-ingress/kube-auth-proxy-7556c75c9b-848b5"
Jul 09 00:59:32.799073 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.798941    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn94k\" (UniqueName: \"kubernetes.io/projected/5b8296be-5aa0-44ed-8285-930b05703c81-kube-api-access-kn94k\") pod \"kube-auth-proxy-7556c75c9b-848b5\" (UID: \"5b8296be-5aa0-44ed-8285-930b05703c81\") " pod="openshift-ingress/kube-auth-proxy-7556c75c9b-848b5"
Jul 09 00:59:32.899903 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.899867    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b8296be-5aa0-44ed-8285-930b05703c81-tmp\") pod \"kube-auth-proxy-7556c75c9b-848b5\" (UID: \"5b8296be-5aa0-44ed-8285-930b05703c81\") " pod="openshift-ingress/kube-auth-proxy-7556c75c9b-848b5"
Jul 09 00:59:32.900074 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.899925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn94k\" (UniqueName: \"kubernetes.io/projected/5b8296be-5aa0-44ed-8285-930b05703c81-kube-api-access-kn94k\") pod \"kube-auth-proxy-7556c75c9b-848b5\" (UID: \"5b8296be-5aa0-44ed-8285-930b05703c81\") " pod="openshift-ingress/kube-auth-proxy-7556c75c9b-848b5"
Jul 09 00:59:32.900074 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.899995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b8296be-5aa0-44ed-8285-930b05703c81-tls-certs\") pod \"kube-auth-proxy-7556c75c9b-848b5\" (UID: \"5b8296be-5aa0-44ed-8285-930b05703c81\") " pod="openshift-ingress/kube-auth-proxy-7556c75c9b-848b5"
Jul 09 00:59:32.902363 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.902334    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b8296be-5aa0-44ed-8285-930b05703c81-tmp\") pod \"kube-auth-proxy-7556c75c9b-848b5\" (UID: \"5b8296be-5aa0-44ed-8285-930b05703c81\") " pod="openshift-ingress/kube-auth-proxy-7556c75c9b-848b5"
Jul 09 00:59:32.902469 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.902436    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b8296be-5aa0-44ed-8285-930b05703c81-tls-certs\") pod \"kube-auth-proxy-7556c75c9b-848b5\" (UID: \"5b8296be-5aa0-44ed-8285-930b05703c81\") " pod="openshift-ingress/kube-auth-proxy-7556c75c9b-848b5"
Jul 09 00:59:32.907965 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:32.907938    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn94k\" (UniqueName: \"kubernetes.io/projected/5b8296be-5aa0-44ed-8285-930b05703c81-kube-api-access-kn94k\") pod \"kube-auth-proxy-7556c75c9b-848b5\" (UID: \"5b8296be-5aa0-44ed-8285-930b05703c81\") " pod="openshift-ingress/kube-auth-proxy-7556c75c9b-848b5"
Jul 09 00:59:33.010995 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.010963    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7556c75c9b-848b5"
Jul 09 00:59:33.101940 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.101901    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61f2de59-b173-49be-9f17-28f0eb661091-cert\") pod \"odh-model-controller-7998c67dc4-bm452\" (UID: \"61f2de59-b173-49be-9f17-28f0eb661091\") " pod="opendatahub/odh-model-controller-7998c67dc4-bm452"
Jul 09 00:59:33.104429 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.104395    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61f2de59-b173-49be-9f17-28f0eb661091-cert\") pod \"odh-model-controller-7998c67dc4-bm452\" (UID: \"61f2de59-b173-49be-9f17-28f0eb661091\") " pod="opendatahub/odh-model-controller-7998c67dc4-bm452"
Jul 09 00:59:33.152738 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.152705    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7556c75c9b-848b5"]
Jul 09 00:59:33.155481 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:59:33.155455    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b8296be_5aa0_44ed_8285_930b05703c81.slice/crio-5a37915573b99e497372e481ff9b91933f43806cc604324c248596f9fb725ab9 WatchSource:0}: Error finding container 5a37915573b99e497372e481ff9b91933f43806cc604324c248596f9fb725ab9: Status 404 returned error can't find the container with id 5a37915573b99e497372e481ff9b91933f43806cc604324c248596f9fb725ab9
Jul 09 00:59:33.181318 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.181290    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-m9bgh"]
Jul 09 00:59:33.185840 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.185818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-m9bgh"
Jul 09 00:59:33.188011 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.187995    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 09 00:59:33.188103 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.188086    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-xbzkd\""
Jul 09 00:59:33.196930 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.196908    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-m9bgh"]
Jul 09 00:59:33.301614 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.301528    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bm452"
Jul 09 00:59:33.303864 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.303836    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b454l\" (UniqueName: \"kubernetes.io/projected/a4e85460-41a3-43e3-a960-e080183b6a87-kube-api-access-b454l\") pod \"model-serving-api-54d89bd5fc-m9bgh\" (UID: \"a4e85460-41a3-43e3-a960-e080183b6a87\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9bgh"
Jul 09 00:59:33.303952 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.303873    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4e85460-41a3-43e3-a960-e080183b6a87-tls-certs\") pod \"model-serving-api-54d89bd5fc-m9bgh\" (UID: \"a4e85460-41a3-43e3-a960-e080183b6a87\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9bgh"
Jul 09 00:59:33.404909 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.404879    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b454l\" (UniqueName: \"kubernetes.io/projected/a4e85460-41a3-43e3-a960-e080183b6a87-kube-api-access-b454l\") pod \"model-serving-api-54d89bd5fc-m9bgh\" (UID: \"a4e85460-41a3-43e3-a960-e080183b6a87\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9bgh"
Jul 09 00:59:33.405369 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.404918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4e85460-41a3-43e3-a960-e080183b6a87-tls-certs\") pod \"model-serving-api-54d89bd5fc-m9bgh\" (UID: \"a4e85460-41a3-43e3-a960-e080183b6a87\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9bgh"
Jul 09 00:59:33.405369 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:59:33.405114    2565 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 09 00:59:33.405369 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:59:33.405193    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e85460-41a3-43e3-a960-e080183b6a87-tls-certs podName:a4e85460-41a3-43e3-a960-e080183b6a87 nodeName:}" failed. No retries permitted until 2026-07-09 00:59:33.905169722 +0000 UTC m=+258.968664411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a4e85460-41a3-43e3-a960-e080183b6a87-tls-certs") pod "model-serving-api-54d89bd5fc-m9bgh" (UID: "a4e85460-41a3-43e3-a960-e080183b6a87") : secret "model-serving-api-tls" not found
Jul 09 00:59:33.417136 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.417111    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b454l\" (UniqueName: \"kubernetes.io/projected/a4e85460-41a3-43e3-a960-e080183b6a87-kube-api-access-b454l\") pod \"model-serving-api-54d89bd5fc-m9bgh\" (UID: \"a4e85460-41a3-43e3-a960-e080183b6a87\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9bgh"
Jul 09 00:59:33.435185 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.435159    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bm452"]
Jul 09 00:59:33.437711 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:59:33.437689    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f2de59_b173_49be_9f17_28f0eb661091.slice/crio-3e4ef75f35ad7333918df89c2a1515f0106936169dee1e01324d2de8246fbb60 WatchSource:0}: Error finding container 3e4ef75f35ad7333918df89c2a1515f0106936169dee1e01324d2de8246fbb60: Status 404 returned error can't find the container with id 3e4ef75f35ad7333918df89c2a1515f0106936169dee1e01324d2de8246fbb60
Jul 09 00:59:33.729292 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.729186    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"]
Jul 09 00:59:33.733786 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.733762    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.736028 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.736005    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 00:59:33.736133 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.736050    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xndvk\""
Jul 09 00:59:33.736133 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.736005    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 00:59:33.736296 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.736281    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 00:59:33.736346 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.736309    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 00:59:33.744861 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.744841    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"]
Jul 09 00:59:33.808820 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.808786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-cacerts\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.809018 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.808829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4kvr\" (UniqueName: \"kubernetes.io/projected/6f912f21-2351-480e-9f88-ebc464ec593d-kube-api-access-w4kvr\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.809018 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.808860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f912f21-2351-480e-9f88-ebc464ec593d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.809018 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.808979    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.809176 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.809018    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.809176 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.809050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f912f21-2351-480e-9f88-ebc464ec593d-local-certs\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.809176 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.809089    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f912f21-2351-480e-9f88-ebc464ec593d-istio-token\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.855156 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.855120    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bm452" event={"ID":"61f2de59-b173-49be-9f17-28f0eb661091","Type":"ContainerStarted","Data":"3e4ef75f35ad7333918df89c2a1515f0106936169dee1e01324d2de8246fbb60"}
Jul 09 00:59:33.856194 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.856170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7556c75c9b-848b5" event={"ID":"5b8296be-5aa0-44ed-8285-930b05703c81","Type":"ContainerStarted","Data":"5a37915573b99e497372e481ff9b91933f43806cc604324c248596f9fb725ab9"}
Jul 09 00:59:33.910551 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.910508    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4kvr\" (UniqueName: \"kubernetes.io/projected/6f912f21-2351-480e-9f88-ebc464ec593d-kube-api-access-w4kvr\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.910725 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.910573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f912f21-2351-480e-9f88-ebc464ec593d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.910725 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.910646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4e85460-41a3-43e3-a960-e080183b6a87-tls-certs\") pod \"model-serving-api-54d89bd5fc-m9bgh\" (UID: \"a4e85460-41a3-43e3-a960-e080183b6a87\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9bgh"
Jul 09 00:59:33.910725 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.910668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.910725 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.910689    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.910933 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.910713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f912f21-2351-480e-9f88-ebc464ec593d-local-certs\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.910984 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.910934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f912f21-2351-480e-9f88-ebc464ec593d-istio-token\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.911037 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.910999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-cacerts\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.911352 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.911304    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f912f21-2351-480e-9f88-ebc464ec593d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.913862 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.913834    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f912f21-2351-480e-9f88-ebc464ec593d-local-certs\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.913982 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.913897    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4e85460-41a3-43e3-a960-e080183b6a87-tls-certs\") pod \"model-serving-api-54d89bd5fc-m9bgh\" (UID: \"a4e85460-41a3-43e3-a960-e080183b6a87\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9bgh"
Jul 09 00:59:33.914152 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.914125    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.914255 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.914129    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.914324 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.914287    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-cacerts\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.918855 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.918827    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f912f21-2351-480e-9f88-ebc464ec593d-istio-token\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:33.919142 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:33.919124    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4kvr\" (UniqueName: \"kubernetes.io/projected/6f912f21-2351-480e-9f88-ebc464ec593d-kube-api-access-w4kvr\") pod \"istiod-openshift-gateway-7574459656-49v8q\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:34.043775 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:34.043733    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:34.096262 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:34.096221    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-m9bgh"
Jul 09 00:59:34.216914 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:34.216689    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"]
Jul 09 00:59:34.221452 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:59:34.221421    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f912f21_2351_480e_9f88_ebc464ec593d.slice/crio-ffa2ccd357054fa24d019dda417cf7b381ea0f40565dcceeb8823dff1cedc4f6 WatchSource:0}: Error finding container ffa2ccd357054fa24d019dda417cf7b381ea0f40565dcceeb8823dff1cedc4f6: Status 404 returned error can't find the container with id ffa2ccd357054fa24d019dda417cf7b381ea0f40565dcceeb8823dff1cedc4f6
Jul 09 00:59:34.284933 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:34.284906    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-m9bgh"]
Jul 09 00:59:34.287432 ip-10-0-134-227 kubenswrapper[2565]: W0709 00:59:34.287397    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e85460_41a3_43e3_a960_e080183b6a87.slice/crio-bf1c79ddf65a97ba15b69ca76f4efd01349d95f4146a5a1983a7915fb1fad668 WatchSource:0}: Error finding container bf1c79ddf65a97ba15b69ca76f4efd01349d95f4146a5a1983a7915fb1fad668: Status 404 returned error can't find the container with id bf1c79ddf65a97ba15b69ca76f4efd01349d95f4146a5a1983a7915fb1fad668
Jul 09 00:59:34.864323 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:34.864246    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q" event={"ID":"6f912f21-2351-480e-9f88-ebc464ec593d","Type":"ContainerStarted","Data":"ffa2ccd357054fa24d019dda417cf7b381ea0f40565dcceeb8823dff1cedc4f6"}
Jul 09 00:59:34.865763 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:34.865723    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-m9bgh" event={"ID":"a4e85460-41a3-43e3-a960-e080183b6a87","Type":"ContainerStarted","Data":"bf1c79ddf65a97ba15b69ca76f4efd01349d95f4146a5a1983a7915fb1fad668"}
Jul 09 00:59:38.825976 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:38.825938    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 00:59:38.826292 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:38.826053    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 00:59:39.895063 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:39.895022    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q" event={"ID":"6f912f21-2351-480e-9f88-ebc464ec593d","Type":"ContainerStarted","Data":"b1420fad7b3857f60c6be3e646663b2dc9c34cfdbec3de54cc23bb6c1f9a583a"}
Jul 09 00:59:39.895625 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:39.895149    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:39.896831 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:39.896805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bm452" event={"ID":"61f2de59-b173-49be-9f17-28f0eb661091","Type":"ContainerStarted","Data":"c03423c3f3779da8dc535c9e7f01e53822f2bcf7780ef34e324d2d98a654ecfd"}
Jul 09 00:59:39.896983 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:39.896874    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-bm452"
Jul 09 00:59:39.897093 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:39.897070    2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-49v8q container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 00:59:39.897161 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:39.897118    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q" podUID="6f912f21-2351-480e-9f88-ebc464ec593d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 00:59:39.898655 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:39.898624    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-m9bgh" event={"ID":"a4e85460-41a3-43e3-a960-e080183b6a87","Type":"ContainerStarted","Data":"3c9204bcbe6b072164cabd7780bf3761c136b8672841f0738958f21591cd7ff0"}
Jul 09 00:59:39.898770 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:39.898671    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-m9bgh"
Jul 09 00:59:39.900257 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:39.900229    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7556c75c9b-848b5" event={"ID":"5b8296be-5aa0-44ed-8285-930b05703c81","Type":"ContainerStarted","Data":"4d760503d6570f81263efe844b139a1b512db8ca80916e0657be86971c0f4e42"}
Jul 09 00:59:39.945072 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:39.945011    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q" podStartSLOduration=2.343628658 podStartE2EDuration="6.944995358s" totalImagesPullingTime="4.6013667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:59:39.944873353 +0000 UTC m=+265.008368057" watchObservedRunningTime="2026-07-09 00:59:39.944995358 +0000 UTC m=+265.008490062"
Jul 09 00:59:40.002929 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:40.002866    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7556c75c9b-848b5" podStartSLOduration=2.33885092 podStartE2EDuration="8.002850271s" totalImagesPullingTime="5.663999351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:59:40.000741816 +0000 UTC m=+265.064236548" watchObservedRunningTime="2026-07-09 00:59:40.002850271 +0000 UTC m=+265.066344976"
Jul 09 00:59:40.045926 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:40.045869    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-m9bgh" podStartSLOduration=2.526536048 podStartE2EDuration="7.04584915s" totalImagesPullingTime="4.519313102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:59:40.045264025 +0000 UTC m=+265.108758734" watchObservedRunningTime="2026-07-09 00:59:40.04584915 +0000 UTC m=+265.109343857"
Jul 09 00:59:40.084631 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:40.084570    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-bm452" podStartSLOduration=2.711405909 podStartE2EDuration="8.084556348s" totalImagesPullingTime="5.373150439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 00:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 00:59:40.081747279 +0000 UTC m=+265.145241985" watchObservedRunningTime="2026-07-09 00:59:40.084556348 +0000 UTC m=+265.148051052"
Jul 09 00:59:40.905305 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:40.905272    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:46.248395 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.248355    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"]
Jul 09 00:59:46.248843 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.248589    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q" podUID="6f912f21-2351-480e-9f88-ebc464ec593d" containerName="discovery" containerID="cri-o://b1420fad7b3857f60c6be3e646663b2dc9c34cfdbec3de54cc23bb6c1f9a583a" gracePeriod=30
Jul 09 00:59:46.498490 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.498426    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:46.635757 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.635712    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f912f21-2351-480e-9f88-ebc464ec593d-local-certs\") pod \"6f912f21-2351-480e-9f88-ebc464ec593d\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") "
Jul 09 00:59:46.635757 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.635765    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4kvr\" (UniqueName: \"kubernetes.io/projected/6f912f21-2351-480e-9f88-ebc464ec593d-kube-api-access-w4kvr\") pod \"6f912f21-2351-480e-9f88-ebc464ec593d\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") "
Jul 09 00:59:46.636002 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.635789    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f912f21-2351-480e-9f88-ebc464ec593d-istio-token\") pod \"6f912f21-2351-480e-9f88-ebc464ec593d\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") "
Jul 09 00:59:46.636002 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.635837    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f912f21-2351-480e-9f88-ebc464ec593d-istio-csr-ca-configmap\") pod \"6f912f21-2351-480e-9f88-ebc464ec593d\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") "
Jul 09 00:59:46.636002 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.635867    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-istio-csr-dns-cert\") pod \"6f912f21-2351-480e-9f88-ebc464ec593d\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") "
Jul 09 00:59:46.636002 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.635896    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-istio-kubeconfig\") pod \"6f912f21-2351-480e-9f88-ebc464ec593d\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") "
Jul 09 00:59:46.636002 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.635922    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-cacerts\") pod \"6f912f21-2351-480e-9f88-ebc464ec593d\" (UID: \"6f912f21-2351-480e-9f88-ebc464ec593d\") "
Jul 09 00:59:46.636459 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.636402    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f912f21-2351-480e-9f88-ebc464ec593d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "6f912f21-2351-480e-9f88-ebc464ec593d" (UID: "6f912f21-2351-480e-9f88-ebc464ec593d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 00:59:46.636577 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.636532    2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f912f21-2351-480e-9f88-ebc464ec593d-istio-csr-ca-configmap\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:59:46.638727 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.638696    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f912f21-2351-480e-9f88-ebc464ec593d-local-certs" (OuterVolumeSpecName: "local-certs") pod "6f912f21-2351-480e-9f88-ebc464ec593d" (UID: "6f912f21-2351-480e-9f88-ebc464ec593d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 00:59:46.638727 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.638713    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "6f912f21-2351-480e-9f88-ebc464ec593d" (UID: "6f912f21-2351-480e-9f88-ebc464ec593d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 00:59:46.638853 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.638726    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "6f912f21-2351-480e-9f88-ebc464ec593d" (UID: "6f912f21-2351-480e-9f88-ebc464ec593d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 00:59:46.638853 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.638756    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f912f21-2351-480e-9f88-ebc464ec593d-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f912f21-2351-480e-9f88-ebc464ec593d" (UID: "6f912f21-2351-480e-9f88-ebc464ec593d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 00:59:46.638853 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.638770    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-cacerts" (OuterVolumeSpecName: "cacerts") pod "6f912f21-2351-480e-9f88-ebc464ec593d" (UID: "6f912f21-2351-480e-9f88-ebc464ec593d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 00:59:46.638853 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.638754    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f912f21-2351-480e-9f88-ebc464ec593d-kube-api-access-w4kvr" (OuterVolumeSpecName: "kube-api-access-w4kvr") pod "6f912f21-2351-480e-9f88-ebc464ec593d" (UID: "6f912f21-2351-480e-9f88-ebc464ec593d"). InnerVolumeSpecName "kube-api-access-w4kvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 00:59:46.737870 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.737834    2565 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-istio-kubeconfig\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:59:46.737870 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.737861    2565 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-cacerts\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:59:46.737870 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.737871    2565 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f912f21-2351-480e-9f88-ebc464ec593d-local-certs\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:59:46.738097 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.737881    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4kvr\" (UniqueName: \"kubernetes.io/projected/6f912f21-2351-480e-9f88-ebc464ec593d-kube-api-access-w4kvr\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:59:46.738097 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.737890    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f912f21-2351-480e-9f88-ebc464ec593d-istio-token\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:59:46.738097 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.737899    2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f912f21-2351-480e-9f88-ebc464ec593d-istio-csr-dns-cert\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 00:59:46.932664 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.932578    2565 generic.go:356] "Generic (PLEG): container finished" podID="6f912f21-2351-480e-9f88-ebc464ec593d" containerID="b1420fad7b3857f60c6be3e646663b2dc9c34cfdbec3de54cc23bb6c1f9a583a" exitCode=0
Jul 09 00:59:46.932664 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.932621    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"
Jul 09 00:59:46.932834 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.932660    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q" event={"ID":"6f912f21-2351-480e-9f88-ebc464ec593d","Type":"ContainerDied","Data":"b1420fad7b3857f60c6be3e646663b2dc9c34cfdbec3de54cc23bb6c1f9a583a"}
Jul 09 00:59:46.932834 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.932712    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-49v8q" event={"ID":"6f912f21-2351-480e-9f88-ebc464ec593d","Type":"ContainerDied","Data":"ffa2ccd357054fa24d019dda417cf7b381ea0f40565dcceeb8823dff1cedc4f6"}
Jul 09 00:59:46.932834 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.932732    2565 scope.go:117] "RemoveContainer" containerID="b1420fad7b3857f60c6be3e646663b2dc9c34cfdbec3de54cc23bb6c1f9a583a"
Jul 09 00:59:46.941824 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.941805    2565 scope.go:117] "RemoveContainer" containerID="b1420fad7b3857f60c6be3e646663b2dc9c34cfdbec3de54cc23bb6c1f9a583a"
Jul 09 00:59:46.942064 ip-10-0-134-227 kubenswrapper[2565]: E0709 00:59:46.942046    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1420fad7b3857f60c6be3e646663b2dc9c34cfdbec3de54cc23bb6c1f9a583a\": container with ID starting with b1420fad7b3857f60c6be3e646663b2dc9c34cfdbec3de54cc23bb6c1f9a583a not found: ID does not exist" containerID="b1420fad7b3857f60c6be3e646663b2dc9c34cfdbec3de54cc23bb6c1f9a583a"
Jul 09 00:59:46.942126 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.942071    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1420fad7b3857f60c6be3e646663b2dc9c34cfdbec3de54cc23bb6c1f9a583a"} err="failed to get container status \"b1420fad7b3857f60c6be3e646663b2dc9c34cfdbec3de54cc23bb6c1f9a583a\": rpc error: code = NotFound desc = could not find container \"b1420fad7b3857f60c6be3e646663b2dc9c34cfdbec3de54cc23bb6c1f9a583a\": container with ID starting with b1420fad7b3857f60c6be3e646663b2dc9c34cfdbec3de54cc23bb6c1f9a583a not found: ID does not exist"
Jul 09 00:59:46.954205 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.954175    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"]
Jul 09 00:59:46.958038 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:46.958012    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-49v8q"]
Jul 09 00:59:47.505714 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:47.505677    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f912f21-2351-480e-9f88-ebc464ec593d" path="/var/lib/kubelet/pods/6f912f21-2351-480e-9f88-ebc464ec593d/volumes"
Jul 09 00:59:50.911023 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:50.910988    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-m9bgh"
Jul 09 00:59:50.937710 ip-10-0-134-227 kubenswrapper[2565]: I0709 00:59:50.937679    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-bm452"
Jul 09 01:00:15.386375 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:15.386350    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 01:00:33.180847 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.180807    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dkt7q"]
Jul 09 01:00:33.183476 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.181150    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f912f21-2351-480e-9f88-ebc464ec593d" containerName="discovery"
Jul 09 01:00:33.183476 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.181165    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f912f21-2351-480e-9f88-ebc464ec593d" containerName="discovery"
Jul 09 01:00:33.183476 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.181255    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f912f21-2351-480e-9f88-ebc464ec593d" containerName="discovery"
Jul 09 01:00:33.183718 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.183701    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dkt7q"
Jul 09 01:00:33.186316 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.186286    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-hd98m\""
Jul 09 01:00:33.186456 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.186340    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 01:00:33.186984 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.186965    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 01:00:33.192238 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.192198    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dkt7q"]
Jul 09 01:00:33.334029 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.333986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp88j\" (UniqueName: \"kubernetes.io/projected/1e59233c-bf69-461a-92c3-c7443971044d-kube-api-access-xp88j\") pod \"kuadrant-operator-catalog-dkt7q\" (UID: \"1e59233c-bf69-461a-92c3-c7443971044d\") " pod="kuadrant-system/kuadrant-operator-catalog-dkt7q"
Jul 09 01:00:33.434981 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.434878    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp88j\" (UniqueName: \"kubernetes.io/projected/1e59233c-bf69-461a-92c3-c7443971044d-kube-api-access-xp88j\") pod \"kuadrant-operator-catalog-dkt7q\" (UID: \"1e59233c-bf69-461a-92c3-c7443971044d\") " pod="kuadrant-system/kuadrant-operator-catalog-dkt7q"
Jul 09 01:00:33.443380 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.443350    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp88j\" (UniqueName: \"kubernetes.io/projected/1e59233c-bf69-461a-92c3-c7443971044d-kube-api-access-xp88j\") pod \"kuadrant-operator-catalog-dkt7q\" (UID: \"1e59233c-bf69-461a-92c3-c7443971044d\") " pod="kuadrant-system/kuadrant-operator-catalog-dkt7q"
Jul 09 01:00:33.495025 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.494988    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dkt7q"
Jul 09 01:00:33.568591 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.568561    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dkt7q"]
Jul 09 01:00:33.625271 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.625247    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dkt7q"]
Jul 09 01:00:33.627960 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:00:33.627934    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e59233c_bf69_461a_92c3_c7443971044d.slice/crio-3e0460b4dd33e08df7c330a445548475166a7544e35070d915623ab7fc4377bd WatchSource:0}: Error finding container 3e0460b4dd33e08df7c330a445548475166a7544e35070d915623ab7fc4377bd: Status 404 returned error can't find the container with id 3e0460b4dd33e08df7c330a445548475166a7544e35070d915623ab7fc4377bd
Jul 09 01:00:33.629598 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.629573    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 01:00:33.763847 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.763813    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d5wj7"]
Jul 09 01:00:33.767239 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.767200    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d5wj7"
Jul 09 01:00:33.774297 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.774263    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d5wj7"]
Jul 09 01:00:33.938601 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:33.938563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lw7z\" (UniqueName: \"kubernetes.io/projected/894202e1-6dff-439f-970a-a4103d29c493-kube-api-access-8lw7z\") pod \"kuadrant-operator-catalog-d5wj7\" (UID: \"894202e1-6dff-439f-970a-a4103d29c493\") " pod="kuadrant-system/kuadrant-operator-catalog-d5wj7"
Jul 09 01:00:34.039569 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:34.039484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lw7z\" (UniqueName: \"kubernetes.io/projected/894202e1-6dff-439f-970a-a4103d29c493-kube-api-access-8lw7z\") pod \"kuadrant-operator-catalog-d5wj7\" (UID: \"894202e1-6dff-439f-970a-a4103d29c493\") " pod="kuadrant-system/kuadrant-operator-catalog-d5wj7"
Jul 09 01:00:34.047062 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:34.047034    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lw7z\" (UniqueName: \"kubernetes.io/projected/894202e1-6dff-439f-970a-a4103d29c493-kube-api-access-8lw7z\") pod \"kuadrant-operator-catalog-d5wj7\" (UID: \"894202e1-6dff-439f-970a-a4103d29c493\") " pod="kuadrant-system/kuadrant-operator-catalog-d5wj7"
Jul 09 01:00:34.077148 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:34.077110    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d5wj7"
Jul 09 01:00:34.150883 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:34.150849    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dkt7q" event={"ID":"1e59233c-bf69-461a-92c3-c7443971044d","Type":"ContainerStarted","Data":"3e0460b4dd33e08df7c330a445548475166a7544e35070d915623ab7fc4377bd"}
Jul 09 01:00:34.211457 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:34.211430    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d5wj7"]
Jul 09 01:00:34.213508 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:00:34.213482    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod894202e1_6dff_439f_970a_a4103d29c493.slice/crio-c8cf314680b1dd4c018056d76975a807b24a332c68aa68dc96ea6b1cafc77aab WatchSource:0}: Error finding container c8cf314680b1dd4c018056d76975a807b24a332c68aa68dc96ea6b1cafc77aab: Status 404 returned error can't find the container with id c8cf314680b1dd4c018056d76975a807b24a332c68aa68dc96ea6b1cafc77aab
Jul 09 01:00:35.157937 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:35.157898    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d5wj7" event={"ID":"894202e1-6dff-439f-970a-a4103d29c493","Type":"ContainerStarted","Data":"c8cf314680b1dd4c018056d76975a807b24a332c68aa68dc96ea6b1cafc77aab"}
Jul 09 01:00:36.164489 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:36.164395    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dkt7q" event={"ID":"1e59233c-bf69-461a-92c3-c7443971044d","Type":"ContainerStarted","Data":"270aa471c9bcdfcecf40f15f444844a14bb77cde4a315dc06b965f0dc992a415"}
Jul 09 01:00:36.164489 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:36.164437    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-dkt7q" podUID="1e59233c-bf69-461a-92c3-c7443971044d" containerName="registry-server" containerID="cri-o://270aa471c9bcdfcecf40f15f444844a14bb77cde4a315dc06b965f0dc992a415" gracePeriod=2
Jul 09 01:00:36.166029 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:36.166000    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d5wj7" event={"ID":"894202e1-6dff-439f-970a-a4103d29c493","Type":"ContainerStarted","Data":"f7a514177df5441c873b8e1c40d853e42cb48ea163477a404608c837e0bb5579"}
Jul 09 01:00:36.180250 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:36.180181    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dkt7q" podStartSLOduration=0.914772325 podStartE2EDuration="3.180162027s" totalImagesPullingTime="2.265389702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:00:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:00:36.179501719 +0000 UTC m=+321.242996446" watchObservedRunningTime="2026-07-09 01:00:36.180162027 +0000 UTC m=+321.243656732"
Jul 09 01:00:36.192427 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:00:36.192395    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e59233c_bf69_461a_92c3_c7443971044d.slice/crio-270aa471c9bcdfcecf40f15f444844a14bb77cde4a315dc06b965f0dc992a415.scope\": RecentStats: unable to find data in memory cache]"
Jul 09 01:00:36.194868 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:36.194817    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-d5wj7" podStartSLOduration=1.511602133 podStartE2EDuration="3.194801967s" totalImagesPullingTime="1.683199834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:00:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:00:36.192761845 +0000 UTC m=+321.256256552" watchObservedRunningTime="2026-07-09 01:00:36.194801967 +0000 UTC m=+321.258296673"
Jul 09 01:00:36.422497 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:36.422439    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dkt7q"
Jul 09 01:00:36.563420 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:36.563379    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xp88j\" (UniqueName: \"kubernetes.io/projected/1e59233c-bf69-461a-92c3-c7443971044d-kube-api-access-xp88j\") pod \"1e59233c-bf69-461a-92c3-c7443971044d\" (UID: \"1e59233c-bf69-461a-92c3-c7443971044d\") "
Jul 09 01:00:36.565560 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:36.565532    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e59233c-bf69-461a-92c3-c7443971044d-kube-api-access-xp88j" (OuterVolumeSpecName: "kube-api-access-xp88j") pod "1e59233c-bf69-461a-92c3-c7443971044d" (UID: "1e59233c-bf69-461a-92c3-c7443971044d"). InnerVolumeSpecName "kube-api-access-xp88j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:00:36.664229 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:36.664186    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp88j\" (UniqueName: \"kubernetes.io/projected/1e59233c-bf69-461a-92c3-c7443971044d-kube-api-access-xp88j\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:00:37.171760 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:37.171675    2565 generic.go:356] "Generic (PLEG): container finished" podID="1e59233c-bf69-461a-92c3-c7443971044d" containerID="270aa471c9bcdfcecf40f15f444844a14bb77cde4a315dc06b965f0dc992a415" exitCode=0
Jul 09 01:00:37.171760 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:37.171719    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dkt7q"
Jul 09 01:00:37.172229 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:37.171764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dkt7q" event={"ID":"1e59233c-bf69-461a-92c3-c7443971044d","Type":"ContainerDied","Data":"270aa471c9bcdfcecf40f15f444844a14bb77cde4a315dc06b965f0dc992a415"}
Jul 09 01:00:37.172229 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:37.171813    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dkt7q" event={"ID":"1e59233c-bf69-461a-92c3-c7443971044d","Type":"ContainerDied","Data":"3e0460b4dd33e08df7c330a445548475166a7544e35070d915623ab7fc4377bd"}
Jul 09 01:00:37.172229 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:37.171837    2565 scope.go:117] "RemoveContainer" containerID="270aa471c9bcdfcecf40f15f444844a14bb77cde4a315dc06b965f0dc992a415"
Jul 09 01:00:37.199486 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:37.199349    2565 scope.go:117] "RemoveContainer" containerID="270aa471c9bcdfcecf40f15f444844a14bb77cde4a315dc06b965f0dc992a415"
Jul 09 01:00:37.200349 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:00:37.200321    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"270aa471c9bcdfcecf40f15f444844a14bb77cde4a315dc06b965f0dc992a415\": container with ID starting with 270aa471c9bcdfcecf40f15f444844a14bb77cde4a315dc06b965f0dc992a415 not found: ID does not exist" containerID="270aa471c9bcdfcecf40f15f444844a14bb77cde4a315dc06b965f0dc992a415"
Jul 09 01:00:37.200483 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:37.200362    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"270aa471c9bcdfcecf40f15f444844a14bb77cde4a315dc06b965f0dc992a415"} err="failed to get container status \"270aa471c9bcdfcecf40f15f444844a14bb77cde4a315dc06b965f0dc992a415\": rpc error: code = NotFound desc = could not find container \"270aa471c9bcdfcecf40f15f444844a14bb77cde4a315dc06b965f0dc992a415\": container with ID starting with 270aa471c9bcdfcecf40f15f444844a14bb77cde4a315dc06b965f0dc992a415 not found: ID does not exist"
Jul 09 01:00:37.211825 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:37.211793    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dkt7q"]
Jul 09 01:00:37.215502 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:37.215478    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dkt7q"]
Jul 09 01:00:37.505622 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:37.505583    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e59233c-bf69-461a-92c3-c7443971044d" path="/var/lib/kubelet/pods/1e59233c-bf69-461a-92c3-c7443971044d/volumes"
Jul 09 01:00:44.077854 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:44.077811    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-d5wj7"
Jul 09 01:00:44.078298 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:44.077908    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-d5wj7"
Jul 09 01:00:44.101400 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:44.101372    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-d5wj7"
Jul 09 01:00:44.227528 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:44.227503    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-d5wj7"
Jul 09 01:00:48.968274 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:48.968236    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r"]
Jul 09 01:00:48.968658 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:48.968547    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e59233c-bf69-461a-92c3-c7443971044d" containerName="registry-server"
Jul 09 01:00:48.968658 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:48.968557    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e59233c-bf69-461a-92c3-c7443971044d" containerName="registry-server"
Jul 09 01:00:48.968658 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:48.968628    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e59233c-bf69-461a-92c3-c7443971044d" containerName="registry-server"
Jul 09 01:00:48.970671 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:48.970655    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r"
Jul 09 01:00:48.972918 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:48.972897    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6z7x6\""
Jul 09 01:00:48.979042 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:48.979019    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r"]
Jul 09 01:00:49.061250 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.061183    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72fc3db9-fce7-4ef6-a7b4-319083194991-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r\" (UID: \"72fc3db9-fce7-4ef6-a7b4-319083194991\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r"
Jul 09 01:00:49.061430 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.061265    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72fc3db9-fce7-4ef6-a7b4-319083194991-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r\" (UID: \"72fc3db9-fce7-4ef6-a7b4-319083194991\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r"
Jul 09 01:00:49.061430 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.061292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgpp4\" (UniqueName: \"kubernetes.io/projected/72fc3db9-fce7-4ef6-a7b4-319083194991-kube-api-access-zgpp4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r\" (UID: \"72fc3db9-fce7-4ef6-a7b4-319083194991\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r"
Jul 09 01:00:49.162181 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.162145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72fc3db9-fce7-4ef6-a7b4-319083194991-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r\" (UID: \"72fc3db9-fce7-4ef6-a7b4-319083194991\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r"
Jul 09 01:00:49.162373 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.162200    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72fc3db9-fce7-4ef6-a7b4-319083194991-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r\" (UID: \"72fc3db9-fce7-4ef6-a7b4-319083194991\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r"
Jul 09 01:00:49.162373 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.162258    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgpp4\" (UniqueName: \"kubernetes.io/projected/72fc3db9-fce7-4ef6-a7b4-319083194991-kube-api-access-zgpp4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r\" (UID: \"72fc3db9-fce7-4ef6-a7b4-319083194991\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r"
Jul 09 01:00:49.162584 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.162564    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72fc3db9-fce7-4ef6-a7b4-319083194991-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r\" (UID: \"72fc3db9-fce7-4ef6-a7b4-319083194991\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r"
Jul 09 01:00:49.162625 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.162596    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72fc3db9-fce7-4ef6-a7b4-319083194991-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r\" (UID: \"72fc3db9-fce7-4ef6-a7b4-319083194991\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r"
Jul 09 01:00:49.169936 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.169901    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgpp4\" (UniqueName: \"kubernetes.io/projected/72fc3db9-fce7-4ef6-a7b4-319083194991-kube-api-access-zgpp4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r\" (UID: \"72fc3db9-fce7-4ef6-a7b4-319083194991\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r"
Jul 09 01:00:49.280262 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.280229    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r"
Jul 09 01:00:49.416010 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.415951    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r"]
Jul 09 01:00:49.418442 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:00:49.418411    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72fc3db9_fce7_4ef6_a7b4_319083194991.slice/crio-003ae6325eccaf013a09aa07142e7235c06092cdf5ed47b547ddc3ebd89da44c WatchSource:0}: Error finding container 003ae6325eccaf013a09aa07142e7235c06092cdf5ed47b547ddc3ebd89da44c: Status 404 returned error can't find the container with id 003ae6325eccaf013a09aa07142e7235c06092cdf5ed47b547ddc3ebd89da44c
Jul 09 01:00:49.762476 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.762441    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt"]
Jul 09 01:00:49.765193 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.765179    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt"
Jul 09 01:00:49.773623 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.773598    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt"]
Jul 09 01:00:49.869948 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.869849    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmzsw\" (UniqueName: \"kubernetes.io/projected/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-kube-api-access-rmzsw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt\" (UID: \"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt"
Jul 09 01:00:49.869948 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.869896    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt\" (UID: \"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt"
Jul 09 01:00:49.869948 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.869922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt\" (UID: \"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt"
Jul 09 01:00:49.970760 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.970720    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt\" (UID: \"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt"
Jul 09 01:00:49.971137 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.970816    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmzsw\" (UniqueName: \"kubernetes.io/projected/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-kube-api-access-rmzsw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt\" (UID: \"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt"
Jul 09 01:00:49.971137 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.970844    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt\" (UID: \"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt"
Jul 09 01:00:49.971137 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.971106    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt\" (UID: \"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt"
Jul 09 01:00:49.971265 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.971167    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt\" (UID: \"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt"
Jul 09 01:00:49.978710 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:49.978680    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmzsw\" (UniqueName: \"kubernetes.io/projected/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-kube-api-access-rmzsw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt\" (UID: \"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt"
Jul 09 01:00:50.074407 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.074364    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt"
Jul 09 01:00:50.206032 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.206003    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt"]
Jul 09 01:00:50.208093 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:00:50.208068    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5d8ae8f_4a16_4930_a20f_a0badef1f5e3.slice/crio-f01d60db167954d526886bf07ebc256e099bf0182d6cc0103782046ed01800b2 WatchSource:0}: Error finding container f01d60db167954d526886bf07ebc256e099bf0182d6cc0103782046ed01800b2: Status 404 returned error can't find the container with id f01d60db167954d526886bf07ebc256e099bf0182d6cc0103782046ed01800b2
Jul 09 01:00:50.233941 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.233915    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt" event={"ID":"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3","Type":"ContainerStarted","Data":"f01d60db167954d526886bf07ebc256e099bf0182d6cc0103782046ed01800b2"}
Jul 09 01:00:50.235204 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.235182    2565 generic.go:356] "Generic (PLEG): container finished" podID="72fc3db9-fce7-4ef6-a7b4-319083194991" containerID="b8a7109691e021fb76ab57e2391a0dba13bcdb9394f8358fc44b16dae7fd3dc9" exitCode=0
Jul 09 01:00:50.235321 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.235250    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r" event={"ID":"72fc3db9-fce7-4ef6-a7b4-319083194991","Type":"ContainerDied","Data":"b8a7109691e021fb76ab57e2391a0dba13bcdb9394f8358fc44b16dae7fd3dc9"}
Jul 09 01:00:50.235321 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.235298    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r" event={"ID":"72fc3db9-fce7-4ef6-a7b4-319083194991","Type":"ContainerStarted","Data":"003ae6325eccaf013a09aa07142e7235c06092cdf5ed47b547ddc3ebd89da44c"}
Jul 09 01:00:50.368025 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.367987    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz"]
Jul 09 01:00:50.370430 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.370413    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz"
Jul 09 01:00:50.378305 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.378268    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz"]
Jul 09 01:00:50.475347 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.475307    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a62333e8-afef-40a0-b55f-5d4ac4f51c30-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz\" (UID: \"a62333e8-afef-40a0-b55f-5d4ac4f51c30\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz"
Jul 09 01:00:50.475518 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.475354    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwwsn\" (UniqueName: \"kubernetes.io/projected/a62333e8-afef-40a0-b55f-5d4ac4f51c30-kube-api-access-dwwsn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz\" (UID: \"a62333e8-afef-40a0-b55f-5d4ac4f51c30\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz"
Jul 09 01:00:50.475518 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.475383    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a62333e8-afef-40a0-b55f-5d4ac4f51c30-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz\" (UID: \"a62333e8-afef-40a0-b55f-5d4ac4f51c30\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz"
Jul 09 01:00:50.576350 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.576305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a62333e8-afef-40a0-b55f-5d4ac4f51c30-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz\" (UID: \"a62333e8-afef-40a0-b55f-5d4ac4f51c30\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz"
Jul 09 01:00:50.576350 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.576352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwwsn\" (UniqueName: \"kubernetes.io/projected/a62333e8-afef-40a0-b55f-5d4ac4f51c30-kube-api-access-dwwsn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz\" (UID: \"a62333e8-afef-40a0-b55f-5d4ac4f51c30\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz"
Jul 09 01:00:50.576552 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.576380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a62333e8-afef-40a0-b55f-5d4ac4f51c30-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz\" (UID: \"a62333e8-afef-40a0-b55f-5d4ac4f51c30\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz"
Jul 09 01:00:50.576740 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.576722    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a62333e8-afef-40a0-b55f-5d4ac4f51c30-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz\" (UID: \"a62333e8-afef-40a0-b55f-5d4ac4f51c30\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz"
Jul 09 01:00:50.576782 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.576763    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a62333e8-afef-40a0-b55f-5d4ac4f51c30-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz\" (UID: \"a62333e8-afef-40a0-b55f-5d4ac4f51c30\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz"
Jul 09 01:00:50.585083 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.585046    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwwsn\" (UniqueName: \"kubernetes.io/projected/a62333e8-afef-40a0-b55f-5d4ac4f51c30-kube-api-access-dwwsn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz\" (UID: \"a62333e8-afef-40a0-b55f-5d4ac4f51c30\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz"
Jul 09 01:00:50.680464 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.680376    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz"
Jul 09 01:00:50.764562 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.764528    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd"]
Jul 09 01:00:50.770963 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.770938    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd"
Jul 09 01:00:50.774642 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.774617    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd"]
Jul 09 01:00:50.813203 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.813126    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz"]
Jul 09 01:00:50.815318 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:00:50.815289    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda62333e8_afef_40a0_b55f_5d4ac4f51c30.slice/crio-85c6ca43d2b53fadf8d73e14ef7837b77d5a3fbf7e5097cc93b8a2291e2a1e59 WatchSource:0}: Error finding container 85c6ca43d2b53fadf8d73e14ef7837b77d5a3fbf7e5097cc93b8a2291e2a1e59: Status 404 returned error can't find the container with id 85c6ca43d2b53fadf8d73e14ef7837b77d5a3fbf7e5097cc93b8a2291e2a1e59
Jul 09 01:00:50.879577 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.879535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4lfk\" (UniqueName: \"kubernetes.io/projected/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-kube-api-access-q4lfk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd\" (UID: \"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd"
Jul 09 01:00:50.879724 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.879710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd\" (UID: \"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd"
Jul 09 01:00:50.879786 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.879750    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd\" (UID: \"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd"
Jul 09 01:00:50.980245 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.980147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd\" (UID: \"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd"
Jul 09 01:00:50.980245 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.980197    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4lfk\" (UniqueName: \"kubernetes.io/projected/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-kube-api-access-q4lfk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd\" (UID: \"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd"
Jul 09 01:00:50.980675 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.980349    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd\" (UID: \"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd"
Jul 09 01:00:50.980675 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.980584    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd\" (UID: \"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd"
Jul 09 01:00:50.980790 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.980765    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd\" (UID: \"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd"
Jul 09 01:00:50.989063 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:50.989029    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4lfk\" (UniqueName: \"kubernetes.io/projected/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-kube-api-access-q4lfk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd\" (UID: \"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd"
Jul 09 01:00:51.084126 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:51.084098    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd"
Jul 09 01:00:51.223625 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:51.223591    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd"]
Jul 09 01:00:51.226335 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:00:51.226305    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda833c14c_962c_4d13_8fd0_fdcb5d8ea5a7.slice/crio-4200e5c5b14fa52015aa24c9e4688a101dfc9a36eef5bd60d1514fecf85afb3d WatchSource:0}: Error finding container 4200e5c5b14fa52015aa24c9e4688a101dfc9a36eef5bd60d1514fecf85afb3d: Status 404 returned error can't find the container with id 4200e5c5b14fa52015aa24c9e4688a101dfc9a36eef5bd60d1514fecf85afb3d
Jul 09 01:00:51.241348 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:51.241320    2565 generic.go:356] "Generic (PLEG): container finished" podID="72fc3db9-fce7-4ef6-a7b4-319083194991" containerID="215ac2280070dd88518c4e515284bc6cb229d861edccf8e4c788fe317e7c1def" exitCode=0
Jul 09 01:00:51.241449 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:51.241400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r" event={"ID":"72fc3db9-fce7-4ef6-a7b4-319083194991","Type":"ContainerDied","Data":"215ac2280070dd88518c4e515284bc6cb229d861edccf8e4c788fe317e7c1def"}
Jul 09 01:00:51.242799 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:51.242767    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd" event={"ID":"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7","Type":"ContainerStarted","Data":"4200e5c5b14fa52015aa24c9e4688a101dfc9a36eef5bd60d1514fecf85afb3d"}
Jul 09 01:00:51.244378 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:51.244355    2565 generic.go:356] "Generic (PLEG): container finished" podID="a62333e8-afef-40a0-b55f-5d4ac4f51c30" containerID="5842b9b8acc5f5d9d74d5eb0bb2a1dae1d1b2b27148221202a02c12915798f7d" exitCode=0
Jul 09 01:00:51.244462 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:51.244440    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz" event={"ID":"a62333e8-afef-40a0-b55f-5d4ac4f51c30","Type":"ContainerDied","Data":"5842b9b8acc5f5d9d74d5eb0bb2a1dae1d1b2b27148221202a02c12915798f7d"}
Jul 09 01:00:51.244532 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:51.244489    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz" event={"ID":"a62333e8-afef-40a0-b55f-5d4ac4f51c30","Type":"ContainerStarted","Data":"85c6ca43d2b53fadf8d73e14ef7837b77d5a3fbf7e5097cc93b8a2291e2a1e59"}
Jul 09 01:00:51.246063 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:51.246005    2565 generic.go:356] "Generic (PLEG): container finished" podID="b5d8ae8f-4a16-4930-a20f-a0badef1f5e3" containerID="be89a61d3c5493b26b1d84ed81ff6dc41e2d2f0dccbe0e1d046e8a704092b570" exitCode=0
Jul 09 01:00:51.246063 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:51.246030    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt" event={"ID":"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3","Type":"ContainerDied","Data":"be89a61d3c5493b26b1d84ed81ff6dc41e2d2f0dccbe0e1d046e8a704092b570"}
Jul 09 01:00:52.254397 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:52.254365    2565 generic.go:356] "Generic (PLEG): container finished" podID="72fc3db9-fce7-4ef6-a7b4-319083194991" containerID="2679b2231a40fc7266c168eaf90fb0d693990b053d44b20963bb29566fabccd3" exitCode=0
Jul 09 01:00:52.254739 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:52.254440    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r" event={"ID":"72fc3db9-fce7-4ef6-a7b4-319083194991","Type":"ContainerDied","Data":"2679b2231a40fc7266c168eaf90fb0d693990b053d44b20963bb29566fabccd3"}
Jul 09 01:00:52.255918 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:52.255897    2565 generic.go:356] "Generic (PLEG): container finished" podID="a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7" containerID="15be2ff6f529ab98357d664cc6eaff30def7a2fcb2532948141bb6e5601397d2" exitCode=0
Jul 09 01:00:52.256022 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:52.255981    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd" event={"ID":"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7","Type":"ContainerDied","Data":"15be2ff6f529ab98357d664cc6eaff30def7a2fcb2532948141bb6e5601397d2"}
Jul 09 01:00:53.263838 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:53.263799    2565 generic.go:356] "Generic (PLEG): container finished" podID="a62333e8-afef-40a0-b55f-5d4ac4f51c30" containerID="e1e64d5b4820af1b33c941d24e3dfdd6e769e9ba8a7fefa33572439d108e5488" exitCode=0
Jul 09 01:00:53.264320 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:53.263895    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz" event={"ID":"a62333e8-afef-40a0-b55f-5d4ac4f51c30","Type":"ContainerDied","Data":"e1e64d5b4820af1b33c941d24e3dfdd6e769e9ba8a7fefa33572439d108e5488"}
Jul 09 01:00:53.265752 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:53.265729    2565 generic.go:356] "Generic (PLEG): container finished" podID="b5d8ae8f-4a16-4930-a20f-a0badef1f5e3" containerID="1c1eccf0f790a7aaa1d6b41e3b495adacfc5a46bc762adcf19da1333a99a8863" exitCode=0
Jul 09 01:00:53.265862 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:53.265816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt" event={"ID":"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3","Type":"ContainerDied","Data":"1c1eccf0f790a7aaa1d6b41e3b495adacfc5a46bc762adcf19da1333a99a8863"}
Jul 09 01:00:53.412147 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:53.412116    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r"
Jul 09 01:00:53.500474 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:53.500439    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72fc3db9-fce7-4ef6-a7b4-319083194991-bundle\") pod \"72fc3db9-fce7-4ef6-a7b4-319083194991\" (UID: \"72fc3db9-fce7-4ef6-a7b4-319083194991\") "
Jul 09 01:00:53.500649 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:53.500500    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72fc3db9-fce7-4ef6-a7b4-319083194991-util\") pod \"72fc3db9-fce7-4ef6-a7b4-319083194991\" (UID: \"72fc3db9-fce7-4ef6-a7b4-319083194991\") "
Jul 09 01:00:53.500649 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:53.500531    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgpp4\" (UniqueName: \"kubernetes.io/projected/72fc3db9-fce7-4ef6-a7b4-319083194991-kube-api-access-zgpp4\") pod \"72fc3db9-fce7-4ef6-a7b4-319083194991\" (UID: \"72fc3db9-fce7-4ef6-a7b4-319083194991\") "
Jul 09 01:00:53.501089 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:53.501048    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72fc3db9-fce7-4ef6-a7b4-319083194991-bundle" (OuterVolumeSpecName: "bundle") pod "72fc3db9-fce7-4ef6-a7b4-319083194991" (UID: "72fc3db9-fce7-4ef6-a7b4-319083194991"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:00:53.502707 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:53.502677    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72fc3db9-fce7-4ef6-a7b4-319083194991-kube-api-access-zgpp4" (OuterVolumeSpecName: "kube-api-access-zgpp4") pod "72fc3db9-fce7-4ef6-a7b4-319083194991" (UID: "72fc3db9-fce7-4ef6-a7b4-319083194991"). InnerVolumeSpecName "kube-api-access-zgpp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:00:53.506533 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:53.506498    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72fc3db9-fce7-4ef6-a7b4-319083194991-util" (OuterVolumeSpecName: "util") pod "72fc3db9-fce7-4ef6-a7b4-319083194991" (UID: "72fc3db9-fce7-4ef6-a7b4-319083194991"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:00:53.601489 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:53.601442    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72fc3db9-fce7-4ef6-a7b4-319083194991-bundle\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:00:53.601489 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:53.601485    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72fc3db9-fce7-4ef6-a7b4-319083194991-util\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:00:53.601489 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:53.601494    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgpp4\" (UniqueName: \"kubernetes.io/projected/72fc3db9-fce7-4ef6-a7b4-319083194991-kube-api-access-zgpp4\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:00:54.273582 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:54.273550    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r"
Jul 09 01:00:54.273992 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:54.273554    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r" event={"ID":"72fc3db9-fce7-4ef6-a7b4-319083194991","Type":"ContainerDied","Data":"003ae6325eccaf013a09aa07142e7235c06092cdf5ed47b547ddc3ebd89da44c"}
Jul 09 01:00:54.273992 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:54.273654    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="003ae6325eccaf013a09aa07142e7235c06092cdf5ed47b547ddc3ebd89da44c"
Jul 09 01:00:54.275334 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:54.275310    2565 generic.go:356] "Generic (PLEG): container finished" podID="a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7" containerID="5be6dfc73653facf212805b420a37cc0f4438b01e485e77613b1739e44ff3bdb" exitCode=0
Jul 09 01:00:54.275465 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:54.275390    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd" event={"ID":"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7","Type":"ContainerDied","Data":"5be6dfc73653facf212805b420a37cc0f4438b01e485e77613b1739e44ff3bdb"}
Jul 09 01:00:54.277974 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:54.277954    2565 generic.go:356] "Generic (PLEG): container finished" podID="a62333e8-afef-40a0-b55f-5d4ac4f51c30" containerID="dc82088110d5819eafb9a49b4dd02c92df9453fb3e5e16366e193034bdef4857" exitCode=0
Jul 09 01:00:54.278049 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:54.278031    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz" event={"ID":"a62333e8-afef-40a0-b55f-5d4ac4f51c30","Type":"ContainerDied","Data":"dc82088110d5819eafb9a49b4dd02c92df9453fb3e5e16366e193034bdef4857"}
Jul 09 01:00:54.279986 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:54.279962    2565 generic.go:356] "Generic (PLEG): container finished" podID="b5d8ae8f-4a16-4930-a20f-a0badef1f5e3" containerID="4059969d886298cb38bd1c07c0919b6cedff50ae48b24badc6a24c07e6ffdea4" exitCode=0
Jul 09 01:00:54.280070 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:54.280011    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt" event={"ID":"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3","Type":"ContainerDied","Data":"4059969d886298cb38bd1c07c0919b6cedff50ae48b24badc6a24c07e6ffdea4"}
Jul 09 01:00:55.286912 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.286871    2565 generic.go:356] "Generic (PLEG): container finished" podID="a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7" containerID="eba3499651865cbd9b93a845341531d2a4d16b9d33429988ca5e647aa418b3f4" exitCode=0
Jul 09 01:00:55.287372 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.286967    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd" event={"ID":"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7","Type":"ContainerDied","Data":"eba3499651865cbd9b93a845341531d2a4d16b9d33429988ca5e647aa418b3f4"}
Jul 09 01:00:55.446138 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.446115    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz"
Jul 09 01:00:55.449112 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.449094    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt"
Jul 09 01:00:55.516977 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.516946    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmzsw\" (UniqueName: \"kubernetes.io/projected/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-kube-api-access-rmzsw\") pod \"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3\" (UID: \"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3\") "
Jul 09 01:00:55.517131 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.516983    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a62333e8-afef-40a0-b55f-5d4ac4f51c30-util\") pod \"a62333e8-afef-40a0-b55f-5d4ac4f51c30\" (UID: \"a62333e8-afef-40a0-b55f-5d4ac4f51c30\") "
Jul 09 01:00:55.517131 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.517023    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a62333e8-afef-40a0-b55f-5d4ac4f51c30-bundle\") pod \"a62333e8-afef-40a0-b55f-5d4ac4f51c30\" (UID: \"a62333e8-afef-40a0-b55f-5d4ac4f51c30\") "
Jul 09 01:00:55.517131 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.517048    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-util\") pod \"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3\" (UID: \"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3\") "
Jul 09 01:00:55.517131 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.517081    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-bundle\") pod \"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3\" (UID: \"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3\") "
Jul 09 01:00:55.517313 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.517131    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwwsn\" (UniqueName: \"kubernetes.io/projected/a62333e8-afef-40a0-b55f-5d4ac4f51c30-kube-api-access-dwwsn\") pod \"a62333e8-afef-40a0-b55f-5d4ac4f51c30\" (UID: \"a62333e8-afef-40a0-b55f-5d4ac4f51c30\") "
Jul 09 01:00:55.517891 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.517639    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62333e8-afef-40a0-b55f-5d4ac4f51c30-bundle" (OuterVolumeSpecName: "bundle") pod "a62333e8-afef-40a0-b55f-5d4ac4f51c30" (UID: "a62333e8-afef-40a0-b55f-5d4ac4f51c30"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:00:55.518005 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.517883    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-bundle" (OuterVolumeSpecName: "bundle") pod "b5d8ae8f-4a16-4930-a20f-a0badef1f5e3" (UID: "b5d8ae8f-4a16-4930-a20f-a0badef1f5e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:00:55.519177 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.519147    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-kube-api-access-rmzsw" (OuterVolumeSpecName: "kube-api-access-rmzsw") pod "b5d8ae8f-4a16-4930-a20f-a0badef1f5e3" (UID: "b5d8ae8f-4a16-4930-a20f-a0badef1f5e3"). InnerVolumeSpecName "kube-api-access-rmzsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:00:55.519280 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.519247    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a62333e8-afef-40a0-b55f-5d4ac4f51c30-kube-api-access-dwwsn" (OuterVolumeSpecName: "kube-api-access-dwwsn") pod "a62333e8-afef-40a0-b55f-5d4ac4f51c30" (UID: "a62333e8-afef-40a0-b55f-5d4ac4f51c30"). InnerVolumeSpecName "kube-api-access-dwwsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:00:55.522900 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.522870    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62333e8-afef-40a0-b55f-5d4ac4f51c30-util" (OuterVolumeSpecName: "util") pod "a62333e8-afef-40a0-b55f-5d4ac4f51c30" (UID: "a62333e8-afef-40a0-b55f-5d4ac4f51c30"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:00:55.524461 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.524434    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-util" (OuterVolumeSpecName: "util") pod "b5d8ae8f-4a16-4930-a20f-a0badef1f5e3" (UID: "b5d8ae8f-4a16-4930-a20f-a0badef1f5e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:00:55.618405 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.618312    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmzsw\" (UniqueName: \"kubernetes.io/projected/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-kube-api-access-rmzsw\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:00:55.618405 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.618342    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a62333e8-afef-40a0-b55f-5d4ac4f51c30-util\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:00:55.618405 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.618352    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a62333e8-afef-40a0-b55f-5d4ac4f51c30-bundle\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:00:55.618405 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.618360    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-util\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:00:55.618405 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.618368    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5d8ae8f-4a16-4930-a20f-a0badef1f5e3-bundle\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:00:55.618405 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:55.618375    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwwsn\" (UniqueName: \"kubernetes.io/projected/a62333e8-afef-40a0-b55f-5d4ac4f51c30-kube-api-access-dwwsn\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:00:56.294053 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:56.294025    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt"
Jul 09 01:00:56.294475 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:56.294066    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt" event={"ID":"b5d8ae8f-4a16-4930-a20f-a0badef1f5e3","Type":"ContainerDied","Data":"f01d60db167954d526886bf07ebc256e099bf0182d6cc0103782046ed01800b2"}
Jul 09 01:00:56.294475 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:56.294118    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f01d60db167954d526886bf07ebc256e099bf0182d6cc0103782046ed01800b2"
Jul 09 01:00:56.295917 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:56.295893    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz"
Jul 09 01:00:56.296046 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:56.295917    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz" event={"ID":"a62333e8-afef-40a0-b55f-5d4ac4f51c30","Type":"ContainerDied","Data":"85c6ca43d2b53fadf8d73e14ef7837b77d5a3fbf7e5097cc93b8a2291e2a1e59"}
Jul 09 01:00:56.296046 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:56.295958    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85c6ca43d2b53fadf8d73e14ef7837b77d5a3fbf7e5097cc93b8a2291e2a1e59"
Jul 09 01:00:56.421068 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:56.421041    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd"
Jul 09 01:00:56.525798 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:56.525761    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-bundle\") pod \"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7\" (UID: \"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7\") "
Jul 09 01:00:56.525798 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:56.525805    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-util\") pod \"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7\" (UID: \"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7\") "
Jul 09 01:00:56.525967 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:56.525844    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4lfk\" (UniqueName: \"kubernetes.io/projected/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-kube-api-access-q4lfk\") pod \"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7\" (UID: \"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7\") "
Jul 09 01:00:56.526280 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:56.526246    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-bundle" (OuterVolumeSpecName: "bundle") pod "a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7" (UID: "a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:00:56.527942 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:56.527921    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-kube-api-access-q4lfk" (OuterVolumeSpecName: "kube-api-access-q4lfk") pod "a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7" (UID: "a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7"). InnerVolumeSpecName "kube-api-access-q4lfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:00:56.530609 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:56.530578    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-util" (OuterVolumeSpecName: "util") pod "a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7" (UID: "a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:00:56.627170 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:56.627080    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4lfk\" (UniqueName: \"kubernetes.io/projected/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-kube-api-access-q4lfk\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:00:56.627170 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:56.627113    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-bundle\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:00:56.627170 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:56.627122    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7-util\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:00:57.302877 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:57.302834    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd" event={"ID":"a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7","Type":"ContainerDied","Data":"4200e5c5b14fa52015aa24c9e4688a101dfc9a36eef5bd60d1514fecf85afb3d"}
Jul 09 01:00:57.303268 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:57.302900    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd"
Jul 09 01:00:57.303268 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:00:57.302924    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4200e5c5b14fa52015aa24c9e4688a101dfc9a36eef5bd60d1514fecf85afb3d"
Jul 09 01:01:06.138658 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.138616    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-27fp8"]
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.138943    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a62333e8-afef-40a0-b55f-5d4ac4f51c30" containerName="util"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.138955    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a62333e8-afef-40a0-b55f-5d4ac4f51c30" containerName="util"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.138964    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d8ae8f-4a16-4930-a20f-a0badef1f5e3" containerName="pull"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.138969    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d8ae8f-4a16-4930-a20f-a0badef1f5e3" containerName="pull"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.138977    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d8ae8f-4a16-4930-a20f-a0badef1f5e3" containerName="util"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.138983    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d8ae8f-4a16-4930-a20f-a0badef1f5e3" containerName="util"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.138991    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a62333e8-afef-40a0-b55f-5d4ac4f51c30" containerName="extract"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.138997    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a62333e8-afef-40a0-b55f-5d4ac4f51c30" containerName="extract"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139012    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72fc3db9-fce7-4ef6-a7b4-319083194991" containerName="extract"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139017    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="72fc3db9-fce7-4ef6-a7b4-319083194991" containerName="extract"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139023    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7" containerName="extract"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139030    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7" containerName="extract"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139036    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72fc3db9-fce7-4ef6-a7b4-319083194991" containerName="util"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139041    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="72fc3db9-fce7-4ef6-a7b4-319083194991" containerName="util"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139049    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7" containerName="util"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139054    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7" containerName="util"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139063    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72fc3db9-fce7-4ef6-a7b4-319083194991" containerName="pull"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139068    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="72fc3db9-fce7-4ef6-a7b4-319083194991" containerName="pull"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139073    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d8ae8f-4a16-4930-a20f-a0badef1f5e3" containerName="extract"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139079    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d8ae8f-4a16-4930-a20f-a0badef1f5e3" containerName="extract"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139085    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7" containerName="pull"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139089    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7" containerName="pull"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139097    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a62333e8-afef-40a0-b55f-5d4ac4f51c30" containerName="pull"
Jul 09 01:01:06.139108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139102    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a62333e8-afef-40a0-b55f-5d4ac4f51c30" containerName="pull"
Jul 09 01:01:06.139811 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139154    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="72fc3db9-fce7-4ef6-a7b4-319083194991" containerName="extract"
Jul 09 01:01:06.139811 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139162    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7" containerName="extract"
Jul 09 01:01:06.139811 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139168    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5d8ae8f-4a16-4930-a20f-a0badef1f5e3" containerName="extract"
Jul 09 01:01:06.139811 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.139177    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a62333e8-afef-40a0-b55f-5d4ac4f51c30" containerName="extract"
Jul 09 01:01:06.145309 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.145290    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-27fp8"
Jul 09 01:01:06.147980 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.147958    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-z69mk\""
Jul 09 01:01:06.154255 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.154233    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-27fp8"]
Jul 09 01:01:06.209889 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.209845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpzzw\" (UniqueName: \"kubernetes.io/projected/7cf8a3f2-980f-4bc3-89c0-c1a209d35c66-kube-api-access-zpzzw\") pod \"authorino-operator-75cc8d5cb7-27fp8\" (UID: \"7cf8a3f2-980f-4bc3-89c0-c1a209d35c66\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-27fp8"
Jul 09 01:01:06.311342 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.311303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpzzw\" (UniqueName: \"kubernetes.io/projected/7cf8a3f2-980f-4bc3-89c0-c1a209d35c66-kube-api-access-zpzzw\") pod \"authorino-operator-75cc8d5cb7-27fp8\" (UID: \"7cf8a3f2-980f-4bc3-89c0-c1a209d35c66\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-27fp8"
Jul 09 01:01:06.332143 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.332111    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpzzw\" (UniqueName: \"kubernetes.io/projected/7cf8a3f2-980f-4bc3-89c0-c1a209d35c66-kube-api-access-zpzzw\") pod \"authorino-operator-75cc8d5cb7-27fp8\" (UID: \"7cf8a3f2-980f-4bc3-89c0-c1a209d35c66\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-27fp8"
Jul 09 01:01:06.456480 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.456394    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-27fp8"
Jul 09 01:01:06.590487 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:06.590464    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-27fp8"]
Jul 09 01:01:06.592226 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:01:06.592183    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cf8a3f2_980f_4bc3_89c0_c1a209d35c66.slice/crio-abc306ee93a2b253131f5d7dd92c1ee5dd25a76f25b8e6014c1bf36eda25ed68 WatchSource:0}: Error finding container abc306ee93a2b253131f5d7dd92c1ee5dd25a76f25b8e6014c1bf36eda25ed68: Status 404 returned error can't find the container with id abc306ee93a2b253131f5d7dd92c1ee5dd25a76f25b8e6014c1bf36eda25ed68
Jul 09 01:01:07.358959 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:07.358876    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-27fp8" event={"ID":"7cf8a3f2-980f-4bc3-89c0-c1a209d35c66","Type":"ContainerStarted","Data":"abc306ee93a2b253131f5d7dd92c1ee5dd25a76f25b8e6014c1bf36eda25ed68"}
Jul 09 01:01:09.373720 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:09.373681    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-27fp8" event={"ID":"7cf8a3f2-980f-4bc3-89c0-c1a209d35c66","Type":"ContainerStarted","Data":"78f0c5813e7c7ecf71b7b4c0ce0f16aa0437638b1673eb3e9b55124779a56f80"}
Jul 09 01:01:09.374117 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:09.373806    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-27fp8"
Jul 09 01:01:09.395193 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:09.395138    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-27fp8" podStartSLOduration=0.720267432 podStartE2EDuration="3.39512256s" totalImagesPullingTime="2.674855128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:01:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:01:09.394094662 +0000 UTC m=+354.457589366" watchObservedRunningTime="2026-07-09 01:01:09.39512256 +0000 UTC m=+354.458617264"
Jul 09 01:01:09.399283 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:09.399256    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"]
Jul 09 01:01:09.402488 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:09.402468    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"
Jul 09 01:01:09.404783 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:09.404761    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-x6tbx\""
Jul 09 01:01:09.412331 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:09.412307    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"]
Jul 09 01:01:09.539014 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:09.538922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgxw5\" (UniqueName: \"kubernetes.io/projected/94b73c24-298c-4374-a9fb-c9c362a4a8ca-kube-api-access-wgxw5\") pod \"limitador-operator-controller-manager-859d7b78bd-lr6wz\" (UID: \"94b73c24-298c-4374-a9fb-c9c362a4a8ca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"
Jul 09 01:01:09.640205 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:09.640161    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgxw5\" (UniqueName: \"kubernetes.io/projected/94b73c24-298c-4374-a9fb-c9c362a4a8ca-kube-api-access-wgxw5\") pod \"limitador-operator-controller-manager-859d7b78bd-lr6wz\" (UID: \"94b73c24-298c-4374-a9fb-c9c362a4a8ca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"
Jul 09 01:01:09.652994 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:09.652956    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgxw5\" (UniqueName: \"kubernetes.io/projected/94b73c24-298c-4374-a9fb-c9c362a4a8ca-kube-api-access-wgxw5\") pod \"limitador-operator-controller-manager-859d7b78bd-lr6wz\" (UID: \"94b73c24-298c-4374-a9fb-c9c362a4a8ca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"
Jul 09 01:01:09.712388 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:09.712348    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"
Jul 09 01:01:09.851099 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:09.851071    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"]
Jul 09 01:01:09.853678 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:01:09.853647    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b73c24_298c_4374_a9fb_c9c362a4a8ca.slice/crio-0ab80ac53388734ab3b69901a0aef70a54d43a99cd9548d4d1d6f370f7bb6378 WatchSource:0}: Error finding container 0ab80ac53388734ab3b69901a0aef70a54d43a99cd9548d4d1d6f370f7bb6378: Status 404 returned error can't find the container with id 0ab80ac53388734ab3b69901a0aef70a54d43a99cd9548d4d1d6f370f7bb6378
Jul 09 01:01:10.379184 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:10.379140    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz" event={"ID":"94b73c24-298c-4374-a9fb-c9c362a4a8ca","Type":"ContainerStarted","Data":"0ab80ac53388734ab3b69901a0aef70a54d43a99cd9548d4d1d6f370f7bb6378"}
Jul 09 01:01:12.395724 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:12.395664    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz" event={"ID":"94b73c24-298c-4374-a9fb-c9c362a4a8ca","Type":"ContainerStarted","Data":"378c67eb14bb5db4c64c4c81e8bf85a4978903130e119fc77eb8a0f8ca0ce5b5"}
Jul 09 01:01:12.396132 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:12.395752    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"
Jul 09 01:01:12.412010 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:12.411953    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz" podStartSLOduration=0.990288996 podStartE2EDuration="3.411936261s" totalImagesPullingTime="2.421647265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:01:12.411466631 +0000 UTC m=+357.474961337" watchObservedRunningTime="2026-07-09 01:01:12.411936261 +0000 UTC m=+357.475430967"
Jul 09 01:01:12.742052 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:12.741955    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vvrrj"]
Jul 09 01:01:12.745370 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:12.745347    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vvrrj"
Jul 09 01:01:12.747751 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:12.747733    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 09 01:01:12.747858 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:12.747777    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xn29r\""
Jul 09 01:01:12.756469 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:12.756446    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vvrrj"]
Jul 09 01:01:12.868768 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:12.868725    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srf7m\" (UniqueName: \"kubernetes.io/projected/622792d1-cab6-42cf-9b1c-0b740da0507d-kube-api-access-srf7m\") pod \"dns-operator-controller-manager-864dd78c4c-vvrrj\" (UID: \"622792d1-cab6-42cf-9b1c-0b740da0507d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vvrrj"
Jul 09 01:01:12.969663 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:12.969625    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srf7m\" (UniqueName: \"kubernetes.io/projected/622792d1-cab6-42cf-9b1c-0b740da0507d-kube-api-access-srf7m\") pod \"dns-operator-controller-manager-864dd78c4c-vvrrj\" (UID: \"622792d1-cab6-42cf-9b1c-0b740da0507d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vvrrj"
Jul 09 01:01:12.980961 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:12.980929    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srf7m\" (UniqueName: \"kubernetes.io/projected/622792d1-cab6-42cf-9b1c-0b740da0507d-kube-api-access-srf7m\") pod \"dns-operator-controller-manager-864dd78c4c-vvrrj\" (UID: \"622792d1-cab6-42cf-9b1c-0b740da0507d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vvrrj"
Jul 09 01:01:13.056108 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:13.056071    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vvrrj"
Jul 09 01:01:13.195348 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:13.195257    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vvrrj"]
Jul 09 01:01:13.197583 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:01:13.197554    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod622792d1_cab6_42cf_9b1c_0b740da0507d.slice/crio-49e87f64af3c9ec0ae2e60007ee2e157ac92c66177dfe62afc630421a6cf1820 WatchSource:0}: Error finding container 49e87f64af3c9ec0ae2e60007ee2e157ac92c66177dfe62afc630421a6cf1820: Status 404 returned error can't find the container with id 49e87f64af3c9ec0ae2e60007ee2e157ac92c66177dfe62afc630421a6cf1820
Jul 09 01:01:13.402930 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:13.402846    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vvrrj" event={"ID":"622792d1-cab6-42cf-9b1c-0b740da0507d","Type":"ContainerStarted","Data":"49e87f64af3c9ec0ae2e60007ee2e157ac92c66177dfe62afc630421a6cf1820"}
Jul 09 01:01:15.951577 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:15.951557    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 09 01:01:16.420923 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:16.420886    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vvrrj" event={"ID":"622792d1-cab6-42cf-9b1c-0b740da0507d","Type":"ContainerStarted","Data":"04f8ffe719118b9a212037aa131f32a7aeae2559fea02fee2f54c44198845185"}
Jul 09 01:01:16.421172 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:16.421151    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vvrrj"
Jul 09 01:01:16.438028 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:16.437974    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vvrrj" podStartSLOduration=1.6882433209999999 podStartE2EDuration="4.437958999s" totalImagesPullingTime="2.749715678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:01:16.435462599 +0000 UTC m=+361.498957325" watchObservedRunningTime="2026-07-09 01:01:16.437958999 +0000 UTC m=+361.501453705"
Jul 09 01:01:17.800321 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:17.800286    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"]
Jul 09 01:01:17.803940 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:17.803922    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:17.806712 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:17.806692    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2q8vw\""
Jul 09 01:01:17.817681 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:17.817653    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"]
Jul 09 01:01:17.916015 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:17.915979    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwpm2\" (UniqueName: \"kubernetes.io/projected/c0ee23d4-612e-4314-aed3-fbbc31b621ab-kube-api-access-pwpm2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qkqkj\" (UID: \"c0ee23d4-612e-4314-aed3-fbbc31b621ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:17.916187 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:17.916048    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0ee23d4-612e-4314-aed3-fbbc31b621ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qkqkj\" (UID: \"c0ee23d4-612e-4314-aed3-fbbc31b621ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:18.017073 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:18.017014    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0ee23d4-612e-4314-aed3-fbbc31b621ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qkqkj\" (UID: \"c0ee23d4-612e-4314-aed3-fbbc31b621ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:18.017282 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:18.017118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwpm2\" (UniqueName: \"kubernetes.io/projected/c0ee23d4-612e-4314-aed3-fbbc31b621ab-kube-api-access-pwpm2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qkqkj\" (UID: \"c0ee23d4-612e-4314-aed3-fbbc31b621ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:18.017440 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:18.017419    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0ee23d4-612e-4314-aed3-fbbc31b621ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qkqkj\" (UID: \"c0ee23d4-612e-4314-aed3-fbbc31b621ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:18.024835 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:18.024803    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwpm2\" (UniqueName: \"kubernetes.io/projected/c0ee23d4-612e-4314-aed3-fbbc31b621ab-kube-api-access-pwpm2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qkqkj\" (UID: \"c0ee23d4-612e-4314-aed3-fbbc31b621ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:18.114473 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:18.114369    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:18.254781 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:18.254748    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"]
Jul 09 01:01:18.256997 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:01:18.256967    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ee23d4_612e_4314_aed3_fbbc31b621ab.slice/crio-7349e267baff26c7be7f4d9d1a343c73df10ac831f77b71b06d820ea5d4b12d2 WatchSource:0}: Error finding container 7349e267baff26c7be7f4d9d1a343c73df10ac831f77b71b06d820ea5d4b12d2: Status 404 returned error can't find the container with id 7349e267baff26c7be7f4d9d1a343c73df10ac831f77b71b06d820ea5d4b12d2
Jul 09 01:01:18.433341 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:18.433254    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj" event={"ID":"c0ee23d4-612e-4314-aed3-fbbc31b621ab","Type":"ContainerStarted","Data":"7349e267baff26c7be7f4d9d1a343c73df10ac831f77b71b06d820ea5d4b12d2"}
Jul 09 01:01:20.382024 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:20.381995    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-27fp8"
Jul 09 01:01:23.406256 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:23.406206    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"
Jul 09 01:01:24.470007 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:24.469914    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj" event={"ID":"c0ee23d4-612e-4314-aed3-fbbc31b621ab","Type":"ContainerStarted","Data":"bcebf89e4345fc7fef7103fadf00ab21b976754052cc925578b147e9a40509df"}
Jul 09 01:01:24.470366 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:24.470040    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:24.491529 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:24.491476    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj" podStartSLOduration=1.544198675 podStartE2EDuration="7.491459661s" totalImagesPullingTime="5.947260986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:01:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:01:24.488758078 +0000 UTC m=+369.552252784" watchObservedRunningTime="2026-07-09 01:01:24.491459661 +0000 UTC m=+369.554954449"
Jul 09 01:01:26.968662 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:26.968626    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nxh4t"]
Jul 09 01:01:26.972291 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:26.972272    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nxh4t"
Jul 09 01:01:26.974501 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:26.974483    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 09 01:01:26.974625 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:26.974489    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 09 01:01:26.974625 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:26.974489    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6z7x6\""
Jul 09 01:01:26.982051 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:26.982028    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nxh4t"]
Jul 09 01:01:27.100996 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:27.100966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvjtj\" (UniqueName: \"kubernetes.io/projected/31b69a16-63dc-4e61-8bbe-6d2c7c02a880-kube-api-access-qvjtj\") pod \"kuadrant-console-plugin-66b5774985-nxh4t\" (UID: \"31b69a16-63dc-4e61-8bbe-6d2c7c02a880\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nxh4t"
Jul 09 01:01:27.101192 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:27.101105    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/31b69a16-63dc-4e61-8bbe-6d2c7c02a880-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nxh4t\" (UID: \"31b69a16-63dc-4e61-8bbe-6d2c7c02a880\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nxh4t"
Jul 09 01:01:27.101192 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:27.101138    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/31b69a16-63dc-4e61-8bbe-6d2c7c02a880-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nxh4t\" (UID: \"31b69a16-63dc-4e61-8bbe-6d2c7c02a880\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nxh4t"
Jul 09 01:01:27.201620 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:27.201586    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/31b69a16-63dc-4e61-8bbe-6d2c7c02a880-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nxh4t\" (UID: \"31b69a16-63dc-4e61-8bbe-6d2c7c02a880\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nxh4t"
Jul 09 01:01:27.201620 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:27.201619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/31b69a16-63dc-4e61-8bbe-6d2c7c02a880-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nxh4t\" (UID: \"31b69a16-63dc-4e61-8bbe-6d2c7c02a880\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nxh4t"
Jul 09 01:01:27.201833 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:27.201646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvjtj\" (UniqueName: \"kubernetes.io/projected/31b69a16-63dc-4e61-8bbe-6d2c7c02a880-kube-api-access-qvjtj\") pod \"kuadrant-console-plugin-66b5774985-nxh4t\" (UID: \"31b69a16-63dc-4e61-8bbe-6d2c7c02a880\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nxh4t"
Jul 09 01:01:27.202269 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:27.202236    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/31b69a16-63dc-4e61-8bbe-6d2c7c02a880-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nxh4t\" (UID: \"31b69a16-63dc-4e61-8bbe-6d2c7c02a880\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nxh4t"
Jul 09 01:01:27.203925 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:27.203907    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/31b69a16-63dc-4e61-8bbe-6d2c7c02a880-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nxh4t\" (UID: \"31b69a16-63dc-4e61-8bbe-6d2c7c02a880\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nxh4t"
Jul 09 01:01:27.212247 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:27.212202    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvjtj\" (UniqueName: \"kubernetes.io/projected/31b69a16-63dc-4e61-8bbe-6d2c7c02a880-kube-api-access-qvjtj\") pod \"kuadrant-console-plugin-66b5774985-nxh4t\" (UID: \"31b69a16-63dc-4e61-8bbe-6d2c7c02a880\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nxh4t"
Jul 09 01:01:27.281803 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:27.281769    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nxh4t"
Jul 09 01:01:27.415430 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:27.415403    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nxh4t"]
Jul 09 01:01:27.417086 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:01:27.417062    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31b69a16_63dc_4e61_8bbe_6d2c7c02a880.slice/crio-8d367e43573ff8f26785a4fa139c249e3f1163475cdd9f94e6da2142a0a67bac WatchSource:0}: Error finding container 8d367e43573ff8f26785a4fa139c249e3f1163475cdd9f94e6da2142a0a67bac: Status 404 returned error can't find the container with id 8d367e43573ff8f26785a4fa139c249e3f1163475cdd9f94e6da2142a0a67bac
Jul 09 01:01:27.428480 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:27.428458    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vvrrj"
Jul 09 01:01:27.487280 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:27.487242    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nxh4t" event={"ID":"31b69a16-63dc-4e61-8bbe-6d2c7c02a880","Type":"ContainerStarted","Data":"8d367e43573ff8f26785a4fa139c249e3f1163475cdd9f94e6da2142a0a67bac"}
Jul 09 01:01:35.478441 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:35.478409    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:36.373582 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:36.373544    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"]
Jul 09 01:01:36.380497 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:36.380466    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"
Jul 09 01:01:36.388036 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:36.388005    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"]
Jul 09 01:01:36.480359 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:36.480326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm2mj\" (UniqueName: \"kubernetes.io/projected/94ecaa90-ba8d-4181-b1e7-ff8a3dff547a-kube-api-access-gm2mj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5swwb\" (UID: \"94ecaa90-ba8d-4181-b1e7-ff8a3dff547a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"
Jul 09 01:01:36.480814 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:36.480389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94ecaa90-ba8d-4181-b1e7-ff8a3dff547a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5swwb\" (UID: \"94ecaa90-ba8d-4181-b1e7-ff8a3dff547a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"
Jul 09 01:01:36.581081 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:36.581036    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm2mj\" (UniqueName: \"kubernetes.io/projected/94ecaa90-ba8d-4181-b1e7-ff8a3dff547a-kube-api-access-gm2mj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5swwb\" (UID: \"94ecaa90-ba8d-4181-b1e7-ff8a3dff547a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"
Jul 09 01:01:36.581293 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:36.581127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94ecaa90-ba8d-4181-b1e7-ff8a3dff547a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5swwb\" (UID: \"94ecaa90-ba8d-4181-b1e7-ff8a3dff547a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"
Jul 09 01:01:36.581649 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:36.581616    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94ecaa90-ba8d-4181-b1e7-ff8a3dff547a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5swwb\" (UID: \"94ecaa90-ba8d-4181-b1e7-ff8a3dff547a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"
Jul 09 01:01:36.597400 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:36.597364    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm2mj\" (UniqueName: \"kubernetes.io/projected/94ecaa90-ba8d-4181-b1e7-ff8a3dff547a-kube-api-access-gm2mj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5swwb\" (UID: \"94ecaa90-ba8d-4181-b1e7-ff8a3dff547a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"
Jul 09 01:01:36.694633 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:36.694550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"
Jul 09 01:01:37.260254 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.260199    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"]
Jul 09 01:01:37.264550 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.264509    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"]
Jul 09 01:01:37.272693 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.272663    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"]
Jul 09 01:01:37.272927 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.272902    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj" podUID="c0ee23d4-612e-4314-aed3-fbbc31b621ab" containerName="manager" containerID="cri-o://bcebf89e4345fc7fef7103fadf00ab21b976754052cc925578b147e9a40509df" gracePeriod=2
Jul 09 01:01:37.285494 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.285465    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"]
Jul 09 01:01:37.287050 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:37.287010    2565 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c0ee23d4-612e-4314-aed3-fbbc31b621ab\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-qkqkj\": pods \"kuadrant-operator-controller-manager-8684c9ff49-qkqkj\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:37.291252 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.290658    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"]
Jul 09 01:01:37.291252 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.291158    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0ee23d4-612e-4314-aed3-fbbc31b621ab" containerName="manager"
Jul 09 01:01:37.291252 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.291176    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0ee23d4-612e-4314-aed3-fbbc31b621ab" containerName="manager"
Jul 09 01:01:37.291468 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.291336    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0ee23d4-612e-4314-aed3-fbbc31b621ab" containerName="manager"
Jul 09 01:01:37.299803 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.299778    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"]
Jul 09 01:01:37.299937 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.299909    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"
Jul 09 01:01:37.302664 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:37.302627    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qkqkj\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="c0ee23d4-612e-4314-aed3-fbbc31b621ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:37.303243 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.303178    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"]
Jul 09 01:01:37.303366 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.303313    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"
Jul 09 01:01:37.303442 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.303388    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz" podUID="94b73c24-298c-4374-a9fb-c9c362a4a8ca" containerName="manager" containerID="cri-o://378c67eb14bb5db4c64c4c81e8bf85a4978903130e119fc77eb8a0f8ca0ce5b5" gracePeriod=2
Jul 09 01:01:37.309728 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.308627    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"]
Jul 09 01:01:37.311880 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.311859    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"]
Jul 09 01:01:37.315107 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.315084    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"]
Jul 09 01:01:37.323813 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:37.323780    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qkqkj\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="c0ee23d4-612e-4314-aed3-fbbc31b621ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:37.325641 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:37.325564    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lr6wz\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="94b73c24-298c-4374-a9fb-c9c362a4a8ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"
Jul 09 01:01:37.330746 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.330722    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6mzkh"]
Jul 09 01:01:37.331236 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.331204    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94b73c24-298c-4374-a9fb-c9c362a4a8ca" containerName="manager"
Jul 09 01:01:37.331236 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.331238    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b73c24-298c-4374-a9fb-c9c362a4a8ca" containerName="manager"
Jul 09 01:01:37.331378 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.331342    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="94b73c24-298c-4374-a9fb-c9c362a4a8ca" containerName="manager"
Jul 09 01:01:37.334691 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.334669    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6mzkh"
Jul 09 01:01:37.347077 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.347055    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6mzkh"]
Jul 09 01:01:37.347199 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:37.347160    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qkqkj\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="c0ee23d4-612e-4314-aed3-fbbc31b621ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:37.349387 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:37.349349    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lr6wz\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="94b73c24-298c-4374-a9fb-c9c362a4a8ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"
Jul 09 01:01:37.387651 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.387615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qjt5\" (UniqueName: \"kubernetes.io/projected/b3bc09ea-47e4-43f5-8c24-feeea678348a-kube-api-access-9qjt5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-86rdq\" (UID: \"b3bc09ea-47e4-43f5-8c24-feeea678348a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"
Jul 09 01:01:37.387806 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.387676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3bc09ea-47e4-43f5-8c24-feeea678348a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-86rdq\" (UID: \"b3bc09ea-47e4-43f5-8c24-feeea678348a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"
Jul 09 01:01:37.387806 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.387707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wk6p\" (UniqueName: \"kubernetes.io/projected/6cf050b4-fe6f-4113-8230-47c492a431bc-kube-api-access-6wk6p\") pod \"limitador-operator-controller-manager-859d7b78bd-6mzkh\" (UID: \"6cf050b4-fe6f-4113-8230-47c492a431bc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6mzkh"
Jul 09 01:01:37.387806 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.387761    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e71779b8-cbc3-4fcc-8aac-6d735ebeefd4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rdddb\" (UID: \"e71779b8-cbc3-4fcc-8aac-6d735ebeefd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"
Jul 09 01:01:37.387958 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.387825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r48gt\" (UniqueName: \"kubernetes.io/projected/e71779b8-cbc3-4fcc-8aac-6d735ebeefd4-kube-api-access-r48gt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rdddb\" (UID: \"e71779b8-cbc3-4fcc-8aac-6d735ebeefd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"
Jul 09 01:01:37.489052 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.489001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qjt5\" (UniqueName: \"kubernetes.io/projected/b3bc09ea-47e4-43f5-8c24-feeea678348a-kube-api-access-9qjt5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-86rdq\" (UID: \"b3bc09ea-47e4-43f5-8c24-feeea678348a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"
Jul 09 01:01:37.489516 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.489071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3bc09ea-47e4-43f5-8c24-feeea678348a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-86rdq\" (UID: \"b3bc09ea-47e4-43f5-8c24-feeea678348a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"
Jul 09 01:01:37.489516 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.489101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wk6p\" (UniqueName: \"kubernetes.io/projected/6cf050b4-fe6f-4113-8230-47c492a431bc-kube-api-access-6wk6p\") pod \"limitador-operator-controller-manager-859d7b78bd-6mzkh\" (UID: \"6cf050b4-fe6f-4113-8230-47c492a431bc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6mzkh"
Jul 09 01:01:37.489516 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.489148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e71779b8-cbc3-4fcc-8aac-6d735ebeefd4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rdddb\" (UID: \"e71779b8-cbc3-4fcc-8aac-6d735ebeefd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"
Jul 09 01:01:37.489516 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.489256    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r48gt\" (UniqueName: \"kubernetes.io/projected/e71779b8-cbc3-4fcc-8aac-6d735ebeefd4-kube-api-access-r48gt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rdddb\" (UID: \"e71779b8-cbc3-4fcc-8aac-6d735ebeefd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"
Jul 09 01:01:37.489748 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.489552    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3bc09ea-47e4-43f5-8c24-feeea678348a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-86rdq\" (UID: \"b3bc09ea-47e4-43f5-8c24-feeea678348a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"
Jul 09 01:01:37.489748 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.489593    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e71779b8-cbc3-4fcc-8aac-6d735ebeefd4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rdddb\" (UID: \"e71779b8-cbc3-4fcc-8aac-6d735ebeefd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"
Jul 09 01:01:37.500353 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.500323    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r48gt\" (UniqueName: \"kubernetes.io/projected/e71779b8-cbc3-4fcc-8aac-6d735ebeefd4-kube-api-access-r48gt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rdddb\" (UID: \"e71779b8-cbc3-4fcc-8aac-6d735ebeefd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"
Jul 09 01:01:37.500513 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.500381    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wk6p\" (UniqueName: \"kubernetes.io/projected/6cf050b4-fe6f-4113-8230-47c492a431bc-kube-api-access-6wk6p\") pod \"limitador-operator-controller-manager-859d7b78bd-6mzkh\" (UID: \"6cf050b4-fe6f-4113-8230-47c492a431bc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6mzkh"
Jul 09 01:01:37.500695 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.500662    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qjt5\" (UniqueName: \"kubernetes.io/projected/b3bc09ea-47e4-43f5-8c24-feeea678348a-kube-api-access-9qjt5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-86rdq\" (UID: \"b3bc09ea-47e4-43f5-8c24-feeea678348a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"
Jul 09 01:01:37.702074 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.701983    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"
Jul 09 01:01:37.710711 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.710686    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"
Jul 09 01:01:37.717904 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:37.717875    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6mzkh"
Jul 09 01:01:46.028607 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.028568    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dfcb6c6b4-lwhn8"]
Jul 09 01:01:46.684356 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.684320    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dfcb6c6b4-lwhn8"]
Jul 09 01:01:46.684532 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.684422    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.768609 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.768574    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16b783b5-c74b-4938-bdcd-ccd2a1203d24-trusted-ca-bundle\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.768802 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.768717    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16b783b5-c74b-4938-bdcd-ccd2a1203d24-service-ca\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.768802 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.768772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16b783b5-c74b-4938-bdcd-ccd2a1203d24-console-oauth-config\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.768802 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.768797    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16b783b5-c74b-4938-bdcd-ccd2a1203d24-console-config\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.769060 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.768840    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16b783b5-c74b-4938-bdcd-ccd2a1203d24-oauth-serving-cert\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.769131 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.769107    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pvzl\" (UniqueName: \"kubernetes.io/projected/16b783b5-c74b-4938-bdcd-ccd2a1203d24-kube-api-access-4pvzl\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.769260 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.769170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16b783b5-c74b-4938-bdcd-ccd2a1203d24-console-serving-cert\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.869956 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.869914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pvzl\" (UniqueName: \"kubernetes.io/projected/16b783b5-c74b-4938-bdcd-ccd2a1203d24-kube-api-access-4pvzl\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.870141 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.869968    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16b783b5-c74b-4938-bdcd-ccd2a1203d24-console-serving-cert\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.870141 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.870016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16b783b5-c74b-4938-bdcd-ccd2a1203d24-trusted-ca-bundle\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.870141 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.870093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16b783b5-c74b-4938-bdcd-ccd2a1203d24-service-ca\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.870141 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.870130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16b783b5-c74b-4938-bdcd-ccd2a1203d24-console-oauth-config\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.870372 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.870154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16b783b5-c74b-4938-bdcd-ccd2a1203d24-console-config\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.870372 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.870201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16b783b5-c74b-4938-bdcd-ccd2a1203d24-oauth-serving-cert\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.871018 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.870987    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16b783b5-c74b-4938-bdcd-ccd2a1203d24-service-ca\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.871156 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.871068    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16b783b5-c74b-4938-bdcd-ccd2a1203d24-trusted-ca-bundle\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.871345 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.871313    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16b783b5-c74b-4938-bdcd-ccd2a1203d24-console-config\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.871450 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.871369    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16b783b5-c74b-4938-bdcd-ccd2a1203d24-oauth-serving-cert\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.872865 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.872842    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16b783b5-c74b-4938-bdcd-ccd2a1203d24-console-serving-cert\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.873034 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.873016    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16b783b5-c74b-4938-bdcd-ccd2a1203d24-console-oauth-config\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.877842 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.877817    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pvzl\" (UniqueName: \"kubernetes.io/projected/16b783b5-c74b-4938-bdcd-ccd2a1203d24-kube-api-access-4pvzl\") pod \"console-6dfcb6c6b4-lwhn8\" (UID: \"16b783b5-c74b-4938-bdcd-ccd2a1203d24\") " pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:46.995672 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:46.995630    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:51.021558 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.021528    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dfcb6c6b4-lwhn8"]
Jul 09 01:01:51.216924 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:01:51.216883    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b783b5_c74b_4938_bdcd_ccd2a1203d24.slice/crio-4b2f8db9a5bc745e6c4c34f8cb547786d8b084524f576699d6e6ff0890ebade1 WatchSource:0}: Error finding container 4b2f8db9a5bc745e6c4c34f8cb547786d8b084524f576699d6e6ff0890ebade1: Status 404 returned error can't find the container with id 4b2f8db9a5bc745e6c4c34f8cb547786d8b084524f576699d6e6ff0890ebade1
Jul 09 01:01:51.235718 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.235685    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"
Jul 09 01:01:51.237622 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:51.237593    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lr6wz\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="94b73c24-298c-4374-a9fb-c9c362a4a8ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"
Jul 09 01:01:51.255525 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.255497    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:51.256040 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.256011    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"]
Jul 09 01:01:51.256990 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:01:51.256962    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode71779b8_cbc3_4fcc_8aac_6d735ebeefd4.slice/crio-603f476d1b8ddf7671bffa6076f28eecc9cfe8600819911edd48288ebb721b22 WatchSource:0}: Error finding container 603f476d1b8ddf7671bffa6076f28eecc9cfe8600819911edd48288ebb721b22: Status 404 returned error can't find the container with id 603f476d1b8ddf7671bffa6076f28eecc9cfe8600819911edd48288ebb721b22
Jul 09 01:01:51.257503 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:51.257469    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qkqkj\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="c0ee23d4-612e-4314-aed3-fbbc31b621ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:51.259131 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:51.259105    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lr6wz\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="94b73c24-298c-4374-a9fb-c9c362a4a8ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"
Jul 09 01:01:51.281044 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.281021    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6mzkh"]
Jul 09 01:01:51.282259 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:01:51.282167    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf050b4_fe6f_4113_8230_47c492a431bc.slice/crio-b848f0568ae042453b81f529a5659b7bf6b4ca0c9591b13defe1415339a66746 WatchSource:0}: Error finding container b848f0568ae042453b81f529a5659b7bf6b4ca0c9591b13defe1415339a66746: Status 404 returned error can't find the container with id b848f0568ae042453b81f529a5659b7bf6b4ca0c9591b13defe1415339a66746
Jul 09 01:01:51.284765 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.284747    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"]
Jul 09 01:01:51.287166 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:01:51.287143    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3bc09ea_47e4_43f5_8c24_feeea678348a.slice/crio-327cc882e57f10e0fd96ddae5c44ba687f11575baf24b15024c5dc674df16d50 WatchSource:0}: Error finding container 327cc882e57f10e0fd96ddae5c44ba687f11575baf24b15024c5dc674df16d50: Status 404 returned error can't find the container with id 327cc882e57f10e0fd96ddae5c44ba687f11575baf24b15024c5dc674df16d50
Jul 09 01:01:51.310294 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.310234    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0ee23d4-612e-4314-aed3-fbbc31b621ab-extensions-socket-volume\") pod \"c0ee23d4-612e-4314-aed3-fbbc31b621ab\" (UID: \"c0ee23d4-612e-4314-aed3-fbbc31b621ab\") "
Jul 09 01:01:51.310419 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.310316    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgxw5\" (UniqueName: \"kubernetes.io/projected/94b73c24-298c-4374-a9fb-c9c362a4a8ca-kube-api-access-wgxw5\") pod \"94b73c24-298c-4374-a9fb-c9c362a4a8ca\" (UID: \"94b73c24-298c-4374-a9fb-c9c362a4a8ca\") "
Jul 09 01:01:51.310419 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.310374    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwpm2\" (UniqueName: \"kubernetes.io/projected/c0ee23d4-612e-4314-aed3-fbbc31b621ab-kube-api-access-pwpm2\") pod \"c0ee23d4-612e-4314-aed3-fbbc31b621ab\" (UID: \"c0ee23d4-612e-4314-aed3-fbbc31b621ab\") "
Jul 09 01:01:51.310769 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.310730    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ee23d4-612e-4314-aed3-fbbc31b621ab-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c0ee23d4-612e-4314-aed3-fbbc31b621ab" (UID: "c0ee23d4-612e-4314-aed3-fbbc31b621ab"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:01:51.312846 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.312820    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94b73c24-298c-4374-a9fb-c9c362a4a8ca-kube-api-access-wgxw5" (OuterVolumeSpecName: "kube-api-access-wgxw5") pod "94b73c24-298c-4374-a9fb-c9c362a4a8ca" (UID: "94b73c24-298c-4374-a9fb-c9c362a4a8ca"). InnerVolumeSpecName "kube-api-access-wgxw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:01:51.312932 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.312868    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0ee23d4-612e-4314-aed3-fbbc31b621ab-kube-api-access-pwpm2" (OuterVolumeSpecName: "kube-api-access-pwpm2") pod "c0ee23d4-612e-4314-aed3-fbbc31b621ab" (UID: "c0ee23d4-612e-4314-aed3-fbbc31b621ab"). InnerVolumeSpecName "kube-api-access-pwpm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:01:51.411927 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.411865    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0ee23d4-612e-4314-aed3-fbbc31b621ab-extensions-socket-volume\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:01:51.411927 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.411888    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgxw5\" (UniqueName: \"kubernetes.io/projected/94b73c24-298c-4374-a9fb-c9c362a4a8ca-kube-api-access-wgxw5\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:01:51.411927 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.411901    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwpm2\" (UniqueName: \"kubernetes.io/projected/c0ee23d4-612e-4314-aed3-fbbc31b621ab-kube-api-access-pwpm2\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:01:51.506776 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.506746    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94b73c24-298c-4374-a9fb-c9c362a4a8ca" path="/var/lib/kubelet/pods/94b73c24-298c-4374-a9fb-c9c362a4a8ca/volumes"
Jul 09 01:01:51.507131 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.507118    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0ee23d4-612e-4314-aed3-fbbc31b621ab" path="/var/lib/kubelet/pods/c0ee23d4-612e-4314-aed3-fbbc31b621ab/volumes"
Jul 09 01:01:51.641127 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.641089    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq" event={"ID":"b3bc09ea-47e4-43f5-8c24-feeea678348a","Type":"ContainerStarted","Data":"f7055e3141b57c9e9b134f9075647a8724d93b6edf715310d54c7b2956da5f32"}
Jul 09 01:01:51.641303 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.641158    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq" event={"ID":"b3bc09ea-47e4-43f5-8c24-feeea678348a","Type":"ContainerStarted","Data":"327cc882e57f10e0fd96ddae5c44ba687f11575baf24b15024c5dc674df16d50"}
Jul 09 01:01:51.641385 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.641356    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"
Jul 09 01:01:51.643151 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.643121    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6mzkh" event={"ID":"6cf050b4-fe6f-4113-8230-47c492a431bc","Type":"ContainerStarted","Data":"ba7aae49f944ac6be78c3412180967ea12de019bf3c8fe3d2bbc7e3f996cb7ac"}
Jul 09 01:01:51.643318 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.643181    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6mzkh" event={"ID":"6cf050b4-fe6f-4113-8230-47c492a431bc","Type":"ContainerStarted","Data":"b848f0568ae042453b81f529a5659b7bf6b4ca0c9591b13defe1415339a66746"}
Jul 09 01:01:51.643318 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.643237    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6mzkh"
Jul 09 01:01:51.644754 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.644729    2565 generic.go:356] "Generic (PLEG): container finished" podID="c0ee23d4-612e-4314-aed3-fbbc31b621ab" containerID="bcebf89e4345fc7fef7103fadf00ab21b976754052cc925578b147e9a40509df" exitCode=0
Jul 09 01:01:51.644895 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.644773    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:51.644895 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.644827    2565 scope.go:117] "RemoveContainer" containerID="bcebf89e4345fc7fef7103fadf00ab21b976754052cc925578b147e9a40509df"
Jul 09 01:01:51.647276 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.647014    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nxh4t" event={"ID":"31b69a16-63dc-4e61-8bbe-6d2c7c02a880","Type":"ContainerStarted","Data":"40299f652e189a4e150b27d8a0f32b70f793deeb708f0a31eef97ac51ce32d3b"}
Jul 09 01:01:51.650580 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.650408    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfcb6c6b4-lwhn8" event={"ID":"16b783b5-c74b-4938-bdcd-ccd2a1203d24","Type":"ContainerStarted","Data":"7df6e3a6cdb9c93d99f31e2b07fd10ae89de644c8e306e170e292f50098b8c49"}
Jul 09 01:01:51.650580 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.650452    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfcb6c6b4-lwhn8" event={"ID":"16b783b5-c74b-4938-bdcd-ccd2a1203d24","Type":"ContainerStarted","Data":"4b2f8db9a5bc745e6c4c34f8cb547786d8b084524f576699d6e6ff0890ebade1"}
Jul 09 01:01:51.651880 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.651839    2565 generic.go:356] "Generic (PLEG): container finished" podID="94b73c24-298c-4374-a9fb-c9c362a4a8ca" containerID="378c67eb14bb5db4c64c4c81e8bf85a4978903130e119fc77eb8a0f8ca0ce5b5" exitCode=0
Jul 09 01:01:51.651963 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.651923    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"
Jul 09 01:01:51.654192 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.654156    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb" event={"ID":"e71779b8-cbc3-4fcc-8aac-6d735ebeefd4","Type":"ContainerStarted","Data":"07fc20dcaad2047707fd1d025dfe152eee1a34f31a8e28f37807f3982552c5a5"}
Jul 09 01:01:51.654308 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.654204    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb" event={"ID":"e71779b8-cbc3-4fcc-8aac-6d735ebeefd4","Type":"ContainerStarted","Data":"603f476d1b8ddf7671bffa6076f28eecc9cfe8600819911edd48288ebb721b22"}
Jul 09 01:01:51.654370 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.654350    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"
Jul 09 01:01:51.656388 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.656283    2565 scope.go:117] "RemoveContainer" containerID="bcebf89e4345fc7fef7103fadf00ab21b976754052cc925578b147e9a40509df"
Jul 09 01:01:51.656577 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:51.656552    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcebf89e4345fc7fef7103fadf00ab21b976754052cc925578b147e9a40509df\": container with ID starting with bcebf89e4345fc7fef7103fadf00ab21b976754052cc925578b147e9a40509df not found: ID does not exist" containerID="bcebf89e4345fc7fef7103fadf00ab21b976754052cc925578b147e9a40509df"
Jul 09 01:01:51.656662 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.656586    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcebf89e4345fc7fef7103fadf00ab21b976754052cc925578b147e9a40509df"} err="failed to get container status \"bcebf89e4345fc7fef7103fadf00ab21b976754052cc925578b147e9a40509df\": rpc error: code = NotFound desc = could not find container \"bcebf89e4345fc7fef7103fadf00ab21b976754052cc925578b147e9a40509df\": container with ID starting with bcebf89e4345fc7fef7103fadf00ab21b976754052cc925578b147e9a40509df not found: ID does not exist"
Jul 09 01:01:51.656662 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.656608    2565 scope.go:117] "RemoveContainer" containerID="378c67eb14bb5db4c64c4c81e8bf85a4978903130e119fc77eb8a0f8ca0ce5b5"
Jul 09 01:01:51.660520 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:51.660494    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lr6wz\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="94b73c24-298c-4374-a9fb-c9c362a4a8ca" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lr6wz"
Jul 09 01:01:51.661612 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.661566    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq" podStartSLOduration=14.66155008 podStartE2EDuration="14.66155008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:01:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:01:51.658462429 +0000 UTC m=+396.721957135" watchObservedRunningTime="2026-07-09 01:01:51.66155008 +0000 UTC m=+396.725044789"
Jul 09 01:01:51.665096 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.665079    2565 scope.go:117] "RemoveContainer" containerID="378c67eb14bb5db4c64c4c81e8bf85a4978903130e119fc77eb8a0f8ca0ce5b5"
Jul 09 01:01:51.665384 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:51.665361    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"378c67eb14bb5db4c64c4c81e8bf85a4978903130e119fc77eb8a0f8ca0ce5b5\": container with ID starting with 378c67eb14bb5db4c64c4c81e8bf85a4978903130e119fc77eb8a0f8ca0ce5b5 not found: ID does not exist" containerID="378c67eb14bb5db4c64c4c81e8bf85a4978903130e119fc77eb8a0f8ca0ce5b5"
Jul 09 01:01:51.665471 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.665390    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"378c67eb14bb5db4c64c4c81e8bf85a4978903130e119fc77eb8a0f8ca0ce5b5"} err="failed to get container status \"378c67eb14bb5db4c64c4c81e8bf85a4978903130e119fc77eb8a0f8ca0ce5b5\": rpc error: code = NotFound desc = could not find container \"378c67eb14bb5db4c64c4c81e8bf85a4978903130e119fc77eb8a0f8ca0ce5b5\": container with ID starting with 378c67eb14bb5db4c64c4c81e8bf85a4978903130e119fc77eb8a0f8ca0ce5b5 not found: ID does not exist"
Jul 09 01:01:51.677188 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.677141    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6mzkh" podStartSLOduration=14.677128811 podStartE2EDuration="14.677128811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:01:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:01:51.676112626 +0000 UTC m=+396.739607332" watchObservedRunningTime="2026-07-09 01:01:51.677128811 +0000 UTC m=+396.740623515"
Jul 09 01:01:51.693635 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.693582    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb" podStartSLOduration=14.693570308 podStartE2EDuration="14.693570308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:01:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:01:51.691602613 +0000 UTC m=+396.755097317" watchObservedRunningTime="2026-07-09 01:01:51.693570308 +0000 UTC m=+396.757065012"
Jul 09 01:01:51.707968 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:51.707925    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qkqkj\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="c0ee23d4-612e-4314-aed3-fbbc31b621ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkqkj"
Jul 09 01:01:51.708141 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.708088    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dfcb6c6b4-lwhn8" podStartSLOduration=5.708073643 podStartE2EDuration="5.708073643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:01:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:01:51.706134747 +0000 UTC m=+396.769629455" watchObservedRunningTime="2026-07-09 01:01:51.708073643 +0000 UTC m=+396.771568347"
Jul 09 01:01:51.724925 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:51.724873    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nxh4t" podStartSLOduration=1.867580828 podStartE2EDuration="25.724856956s" totalImagesPullingTime="23.857276128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:01:51.724096771 +0000 UTC m=+396.787591476" watchObservedRunningTime="2026-07-09 01:01:51.724856956 +0000 UTC m=+396.788351661"
Jul 09 01:01:53.372291 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:53.372249    2565 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-5swwb_kuadrant-system_94ecaa90-ba8d-4181-b1e7-ff8a3dff547a_0(f3e1e9069cc9b61355ff5f99ac4cf4264ff389b4ccbf500586c507148cebf1fe): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-5swwb to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 09 01:01:53.372587 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:53.372319    2565 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-5swwb_kuadrant-system_94ecaa90-ba8d-4181-b1e7-ff8a3dff547a_0(f3e1e9069cc9b61355ff5f99ac4cf4264ff389b4ccbf500586c507148cebf1fe): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-5swwb to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"
Jul 09 01:01:53.666284 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:53.666189    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"
Jul 09 01:01:53.668451 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:53.668416    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-5swwb\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="94ecaa90-ba8d-4181-b1e7-ff8a3dff547a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"
Jul 09 01:01:53.673491 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:53.673465    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"
Jul 09 01:01:53.675726 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:53.675694    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-5swwb\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="94ecaa90-ba8d-4181-b1e7-ff8a3dff547a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"
Jul 09 01:01:53.731872 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:53.731838    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94ecaa90-ba8d-4181-b1e7-ff8a3dff547a-extensions-socket-volume\") pod \"94ecaa90-ba8d-4181-b1e7-ff8a3dff547a\" (UID: \"94ecaa90-ba8d-4181-b1e7-ff8a3dff547a\") "
Jul 09 01:01:53.732053 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:53.731928    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm2mj\" (UniqueName: \"kubernetes.io/projected/94ecaa90-ba8d-4181-b1e7-ff8a3dff547a-kube-api-access-gm2mj\") pod \"94ecaa90-ba8d-4181-b1e7-ff8a3dff547a\" (UID: \"94ecaa90-ba8d-4181-b1e7-ff8a3dff547a\") "
Jul 09 01:01:53.732182 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:53.732154    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ecaa90-ba8d-4181-b1e7-ff8a3dff547a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "94ecaa90-ba8d-4181-b1e7-ff8a3dff547a" (UID: "94ecaa90-ba8d-4181-b1e7-ff8a3dff547a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:01:53.734000 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:53.733981    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94ecaa90-ba8d-4181-b1e7-ff8a3dff547a-kube-api-access-gm2mj" (OuterVolumeSpecName: "kube-api-access-gm2mj") pod "94ecaa90-ba8d-4181-b1e7-ff8a3dff547a" (UID: "94ecaa90-ba8d-4181-b1e7-ff8a3dff547a"). InnerVolumeSpecName "kube-api-access-gm2mj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:01:53.833489 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:53.833457    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94ecaa90-ba8d-4181-b1e7-ff8a3dff547a-extensions-socket-volume\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:01:53.833489 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:53.833484    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm2mj\" (UniqueName: \"kubernetes.io/projected/94ecaa90-ba8d-4181-b1e7-ff8a3dff547a-kube-api-access-gm2mj\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:01:54.671114 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:54.671083    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"
Jul 09 01:01:54.673241 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:54.673189    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-5swwb\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="94ecaa90-ba8d-4181-b1e7-ff8a3dff547a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"
Jul 09 01:01:54.678795 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:54.678767    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-5swwb\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="94ecaa90-ba8d-4181-b1e7-ff8a3dff547a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"
Jul 09 01:01:55.504803 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:01:55.504754    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-5swwb\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="94ecaa90-ba8d-4181-b1e7-ff8a3dff547a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5swwb"
Jul 09 01:01:55.506008 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:55.505987    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94ecaa90-ba8d-4181-b1e7-ff8a3dff547a" path="/var/lib/kubelet/pods/94ecaa90-ba8d-4181-b1e7-ff8a3dff547a/volumes"
Jul 09 01:01:56.995765 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:56.995719    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:56.996242 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:56.995849    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:57.000743 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:57.000717    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:57.690301 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:57.690272    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dfcb6c6b4-lwhn8"
Jul 09 01:01:57.740880 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:01:57.740845    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f697db6c5-r72s4"]
Jul 09 01:02:02.663448 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:02.663416    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"
Jul 09 01:02:02.663849 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:02.663486    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"
Jul 09 01:02:02.663849 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:02.663647    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6mzkh"
Jul 09 01:02:02.736074 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:02.736031    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"]
Jul 09 01:02:02.736283 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:02.736237    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb" podUID="e71779b8-cbc3-4fcc-8aac-6d735ebeefd4" containerName="manager" containerID="cri-o://07fc20dcaad2047707fd1d025dfe152eee1a34f31a8e28f37807f3982552c5a5" gracePeriod=10
Jul 09 01:02:02.944449 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:02.944372    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"]
Jul 09 01:02:02.947171 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:02.947139    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"
Jul 09 01:02:02.966134 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:02.966108    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"]
Jul 09 01:02:02.996166 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:02.996135    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"
Jul 09 01:02:03.013355 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.013324    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/183d646d-d621-43d9-b98a-4500757a97dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2sf2w\" (UID: \"183d646d-d621-43d9-b98a-4500757a97dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"
Jul 09 01:02:03.013355 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.013357    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9jt5\" (UniqueName: \"kubernetes.io/projected/183d646d-d621-43d9-b98a-4500757a97dd-kube-api-access-w9jt5\") pod \"kuadrant-operator-controller-manager-86878c769f-2sf2w\" (UID: \"183d646d-d621-43d9-b98a-4500757a97dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"
Jul 09 01:02:03.114291 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.114251    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e71779b8-cbc3-4fcc-8aac-6d735ebeefd4-extensions-socket-volume\") pod \"e71779b8-cbc3-4fcc-8aac-6d735ebeefd4\" (UID: \"e71779b8-cbc3-4fcc-8aac-6d735ebeefd4\") "
Jul 09 01:02:03.114458 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.114336    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r48gt\" (UniqueName: \"kubernetes.io/projected/e71779b8-cbc3-4fcc-8aac-6d735ebeefd4-kube-api-access-r48gt\") pod \"e71779b8-cbc3-4fcc-8aac-6d735ebeefd4\" (UID: \"e71779b8-cbc3-4fcc-8aac-6d735ebeefd4\") "
Jul 09 01:02:03.114518 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.114495    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/183d646d-d621-43d9-b98a-4500757a97dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2sf2w\" (UID: \"183d646d-d621-43d9-b98a-4500757a97dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"
Jul 09 01:02:03.114572 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.114543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9jt5\" (UniqueName: \"kubernetes.io/projected/183d646d-d621-43d9-b98a-4500757a97dd-kube-api-access-w9jt5\") pod \"kuadrant-operator-controller-manager-86878c769f-2sf2w\" (UID: \"183d646d-d621-43d9-b98a-4500757a97dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"
Jul 09 01:02:03.114652 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.114621    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e71779b8-cbc3-4fcc-8aac-6d735ebeefd4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e71779b8-cbc3-4fcc-8aac-6d735ebeefd4" (UID: "e71779b8-cbc3-4fcc-8aac-6d735ebeefd4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:02:03.114903 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.114878    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/183d646d-d621-43d9-b98a-4500757a97dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2sf2w\" (UID: \"183d646d-d621-43d9-b98a-4500757a97dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"
Jul 09 01:02:03.116536 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.116512    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e71779b8-cbc3-4fcc-8aac-6d735ebeefd4-kube-api-access-r48gt" (OuterVolumeSpecName: "kube-api-access-r48gt") pod "e71779b8-cbc3-4fcc-8aac-6d735ebeefd4" (UID: "e71779b8-cbc3-4fcc-8aac-6d735ebeefd4"). InnerVolumeSpecName "kube-api-access-r48gt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:02:03.128012 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.127990    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9jt5\" (UniqueName: \"kubernetes.io/projected/183d646d-d621-43d9-b98a-4500757a97dd-kube-api-access-w9jt5\") pod \"kuadrant-operator-controller-manager-86878c769f-2sf2w\" (UID: \"183d646d-d621-43d9-b98a-4500757a97dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"
Jul 09 01:02:03.215771 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.215680    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e71779b8-cbc3-4fcc-8aac-6d735ebeefd4-extensions-socket-volume\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:02:03.215771 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.215713    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r48gt\" (UniqueName: \"kubernetes.io/projected/e71779b8-cbc3-4fcc-8aac-6d735ebeefd4-kube-api-access-r48gt\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:02:03.258582 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.258557    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"
Jul 09 01:02:03.395639 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.395611    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"]
Jul 09 01:02:03.396876 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:02:03.396853    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod183d646d_d621_43d9_b98a_4500757a97dd.slice/crio-9ec416f1ab0f2c26f1bf382065e7dbaab774b437de4fabb4a41bb299d38c4e67 WatchSource:0}: Error finding container 9ec416f1ab0f2c26f1bf382065e7dbaab774b437de4fabb4a41bb299d38c4e67: Status 404 returned error can't find the container with id 9ec416f1ab0f2c26f1bf382065e7dbaab774b437de4fabb4a41bb299d38c4e67
Jul 09 01:02:03.722555 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.722516    2565 generic.go:356] "Generic (PLEG): container finished" podID="e71779b8-cbc3-4fcc-8aac-6d735ebeefd4" containerID="07fc20dcaad2047707fd1d025dfe152eee1a34f31a8e28f37807f3982552c5a5" exitCode=0
Jul 09 01:02:03.723055 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.722570    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"
Jul 09 01:02:03.723055 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.722609    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb" event={"ID":"e71779b8-cbc3-4fcc-8aac-6d735ebeefd4","Type":"ContainerDied","Data":"07fc20dcaad2047707fd1d025dfe152eee1a34f31a8e28f37807f3982552c5a5"}
Jul 09 01:02:03.723055 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.722679    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb" event={"ID":"e71779b8-cbc3-4fcc-8aac-6d735ebeefd4","Type":"ContainerDied","Data":"603f476d1b8ddf7671bffa6076f28eecc9cfe8600819911edd48288ebb721b22"}
Jul 09 01:02:03.723055 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.722717    2565 scope.go:117] "RemoveContainer" containerID="07fc20dcaad2047707fd1d025dfe152eee1a34f31a8e28f37807f3982552c5a5"
Jul 09 01:02:03.724536 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.724512    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w" event={"ID":"183d646d-d621-43d9-b98a-4500757a97dd","Type":"ContainerStarted","Data":"ad8878ea559fb149e405d02e3f91e66107111326f08c9df3b79bc55f35d5f60b"}
Jul 09 01:02:03.724830 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.724807    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w" event={"ID":"183d646d-d621-43d9-b98a-4500757a97dd","Type":"ContainerStarted","Data":"9ec416f1ab0f2c26f1bf382065e7dbaab774b437de4fabb4a41bb299d38c4e67"}
Jul 09 01:02:03.724925 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.724900    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"
Jul 09 01:02:03.731825 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.731809    2565 scope.go:117] "RemoveContainer" containerID="07fc20dcaad2047707fd1d025dfe152eee1a34f31a8e28f37807f3982552c5a5"
Jul 09 01:02:03.732088 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:02:03.732069    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07fc20dcaad2047707fd1d025dfe152eee1a34f31a8e28f37807f3982552c5a5\": container with ID starting with 07fc20dcaad2047707fd1d025dfe152eee1a34f31a8e28f37807f3982552c5a5 not found: ID does not exist" containerID="07fc20dcaad2047707fd1d025dfe152eee1a34f31a8e28f37807f3982552c5a5"
Jul 09 01:02:03.732132 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.732097    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07fc20dcaad2047707fd1d025dfe152eee1a34f31a8e28f37807f3982552c5a5"} err="failed to get container status \"07fc20dcaad2047707fd1d025dfe152eee1a34f31a8e28f37807f3982552c5a5\": rpc error: code = NotFound desc = could not find container \"07fc20dcaad2047707fd1d025dfe152eee1a34f31a8e28f37807f3982552c5a5\": container with ID starting with 07fc20dcaad2047707fd1d025dfe152eee1a34f31a8e28f37807f3982552c5a5 not found: ID does not exist"
Jul 09 01:02:03.747748 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.747701    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w" podStartSLOduration=1.747687039 podStartE2EDuration="1.747687039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:02:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:02:03.745337003 +0000 UTC m=+408.808831709" watchObservedRunningTime="2026-07-09 01:02:03.747687039 +0000 UTC m=+408.811181744"
Jul 09 01:02:03.760216 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.760178    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"]
Jul 09 01:02:03.764469 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:03.764415    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rdddb"]
Jul 09 01:02:05.506597 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:05.506557    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e71779b8-cbc3-4fcc-8aac-6d735ebeefd4" path="/var/lib/kubelet/pods/e71779b8-cbc3-4fcc-8aac-6d735ebeefd4/volumes"
Jul 09 01:02:14.733540 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:14.733506    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"
Jul 09 01:02:14.778393 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:14.778353    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"]
Jul 09 01:02:14.778645 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:14.778598    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq" podUID="b3bc09ea-47e4-43f5-8c24-feeea678348a" containerName="manager" containerID="cri-o://f7055e3141b57c9e9b134f9075647a8724d93b6edf715310d54c7b2956da5f32" gracePeriod=10
Jul 09 01:02:15.048863 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:15.048835    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"
Jul 09 01:02:15.118655 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:15.118625    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qjt5\" (UniqueName: \"kubernetes.io/projected/b3bc09ea-47e4-43f5-8c24-feeea678348a-kube-api-access-9qjt5\") pod \"b3bc09ea-47e4-43f5-8c24-feeea678348a\" (UID: \"b3bc09ea-47e4-43f5-8c24-feeea678348a\") "
Jul 09 01:02:15.118810 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:15.118704    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3bc09ea-47e4-43f5-8c24-feeea678348a-extensions-socket-volume\") pod \"b3bc09ea-47e4-43f5-8c24-feeea678348a\" (UID: \"b3bc09ea-47e4-43f5-8c24-feeea678348a\") "
Jul 09 01:02:15.119106 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:15.119083    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3bc09ea-47e4-43f5-8c24-feeea678348a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b3bc09ea-47e4-43f5-8c24-feeea678348a" (UID: "b3bc09ea-47e4-43f5-8c24-feeea678348a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:02:15.120741 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:15.120716    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3bc09ea-47e4-43f5-8c24-feeea678348a-kube-api-access-9qjt5" (OuterVolumeSpecName: "kube-api-access-9qjt5") pod "b3bc09ea-47e4-43f5-8c24-feeea678348a" (UID: "b3bc09ea-47e4-43f5-8c24-feeea678348a"). InnerVolumeSpecName "kube-api-access-9qjt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:02:15.219907 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:15.219873    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3bc09ea-47e4-43f5-8c24-feeea678348a-extensions-socket-volume\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:02:15.219907 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:15.219904    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qjt5\" (UniqueName: \"kubernetes.io/projected/b3bc09ea-47e4-43f5-8c24-feeea678348a-kube-api-access-9qjt5\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:02:15.795195 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:15.795157    2565 generic.go:356] "Generic (PLEG): container finished" podID="b3bc09ea-47e4-43f5-8c24-feeea678348a" containerID="f7055e3141b57c9e9b134f9075647a8724d93b6edf715310d54c7b2956da5f32" exitCode=0
Jul 09 01:02:15.795195 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:15.795194    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"
Jul 09 01:02:15.795721 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:15.795252    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq" event={"ID":"b3bc09ea-47e4-43f5-8c24-feeea678348a","Type":"ContainerDied","Data":"f7055e3141b57c9e9b134f9075647a8724d93b6edf715310d54c7b2956da5f32"}
Jul 09 01:02:15.795721 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:15.795309    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq" event={"ID":"b3bc09ea-47e4-43f5-8c24-feeea678348a","Type":"ContainerDied","Data":"327cc882e57f10e0fd96ddae5c44ba687f11575baf24b15024c5dc674df16d50"}
Jul 09 01:02:15.795721 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:15.795340    2565 scope.go:117] "RemoveContainer" containerID="f7055e3141b57c9e9b134f9075647a8724d93b6edf715310d54c7b2956da5f32"
Jul 09 01:02:15.804918 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:15.804896    2565 scope.go:117] "RemoveContainer" containerID="f7055e3141b57c9e9b134f9075647a8724d93b6edf715310d54c7b2956da5f32"
Jul 09 01:02:15.805264 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:02:15.805242    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7055e3141b57c9e9b134f9075647a8724d93b6edf715310d54c7b2956da5f32\": container with ID starting with f7055e3141b57c9e9b134f9075647a8724d93b6edf715310d54c7b2956da5f32 not found: ID does not exist" containerID="f7055e3141b57c9e9b134f9075647a8724d93b6edf715310d54c7b2956da5f32"
Jul 09 01:02:15.805327 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:15.805276    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7055e3141b57c9e9b134f9075647a8724d93b6edf715310d54c7b2956da5f32"} err="failed to get container status \"f7055e3141b57c9e9b134f9075647a8724d93b6edf715310d54c7b2956da5f32\": rpc error: code = NotFound desc = could not find container \"f7055e3141b57c9e9b134f9075647a8724d93b6edf715310d54c7b2956da5f32\": container with ID starting with f7055e3141b57c9e9b134f9075647a8724d93b6edf715310d54c7b2956da5f32 not found: ID does not exist"
Jul 09 01:02:15.813384 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:15.813356    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"]
Jul 09 01:02:15.820242 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:15.820105    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-86rdq"]
Jul 09 01:02:17.505812 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:17.505774    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3bc09ea-47e4-43f5-8c24-feeea678348a" path="/var/lib/kubelet/pods/b3bc09ea-47e4-43f5-8c24-feeea678348a/volumes"
Jul 09 01:02:19.096826 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.096791    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"]
Jul 09 01:02:19.097299 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.097158    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e71779b8-cbc3-4fcc-8aac-6d735ebeefd4" containerName="manager"
Jul 09 01:02:19.097299 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.097169    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e71779b8-cbc3-4fcc-8aac-6d735ebeefd4" containerName="manager"
Jul 09 01:02:19.097299 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.097188    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3bc09ea-47e4-43f5-8c24-feeea678348a" containerName="manager"
Jul 09 01:02:19.097299 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.097195    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3bc09ea-47e4-43f5-8c24-feeea678348a" containerName="manager"
Jul 09 01:02:19.097299 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.097269    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3bc09ea-47e4-43f5-8c24-feeea678348a" containerName="manager"
Jul 09 01:02:19.097299 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.097282    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e71779b8-cbc3-4fcc-8aac-6d735ebeefd4" containerName="manager"
Jul 09 01:02:19.138083 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.138049    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"]
Jul 09 01:02:19.138258 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.138159    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.140702 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.140664    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 01:02:19.140702 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.140669    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-f4c66\""
Jul 09 01:02:19.252840 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.252802    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ba4ae3c-07ab-4252-829f-56a0e07337ed-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.252840 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.252843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba4ae3c-07ab-4252-829f-56a0e07337ed-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.253052 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.252880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ba4ae3c-07ab-4252-829f-56a0e07337ed-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.253052 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.252930    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ba4ae3c-07ab-4252-829f-56a0e07337ed-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.253052 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.252951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba4ae3c-07ab-4252-829f-56a0e07337ed-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.253052 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.252988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ba4ae3c-07ab-4252-829f-56a0e07337ed-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.253052 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.253034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ba4ae3c-07ab-4252-829f-56a0e07337ed-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.253229 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.253073    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ba4ae3c-07ab-4252-829f-56a0e07337ed-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.253229 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.253105    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdgv9\" (UniqueName: \"kubernetes.io/projected/1ba4ae3c-07ab-4252-829f-56a0e07337ed-kube-api-access-mdgv9\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.354522 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.354446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ba4ae3c-07ab-4252-829f-56a0e07337ed-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.354522 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.354492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ba4ae3c-07ab-4252-829f-56a0e07337ed-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.354730 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.354527    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ba4ae3c-07ab-4252-829f-56a0e07337ed-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.354730 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.354565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdgv9\" (UniqueName: \"kubernetes.io/projected/1ba4ae3c-07ab-4252-829f-56a0e07337ed-kube-api-access-mdgv9\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.354730 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.354605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ba4ae3c-07ab-4252-829f-56a0e07337ed-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.354730 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.354632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba4ae3c-07ab-4252-829f-56a0e07337ed-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.354730 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.354675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ba4ae3c-07ab-4252-829f-56a0e07337ed-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.354730 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.354706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ba4ae3c-07ab-4252-829f-56a0e07337ed-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.354996 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.354738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba4ae3c-07ab-4252-829f-56a0e07337ed-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.354996 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.354865    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ba4ae3c-07ab-4252-829f-56a0e07337ed-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.354996 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.354952    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ba4ae3c-07ab-4252-829f-56a0e07337ed-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.355148 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.355063    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba4ae3c-07ab-4252-829f-56a0e07337ed-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.355148 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.355114    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba4ae3c-07ab-4252-829f-56a0e07337ed-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.355395 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.355374    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ba4ae3c-07ab-4252-829f-56a0e07337ed-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.356780 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.356759    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ba4ae3c-07ab-4252-829f-56a0e07337ed-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.357140 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.357125    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ba4ae3c-07ab-4252-829f-56a0e07337ed-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.362183 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.362158    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ba4ae3c-07ab-4252-829f-56a0e07337ed-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.362296 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.362263    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdgv9\" (UniqueName: \"kubernetes.io/projected/1ba4ae3c-07ab-4252-829f-56a0e07337ed-kube-api-access-mdgv9\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5mpgg\" (UID: \"1ba4ae3c-07ab-4252-829f-56a0e07337ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.449138 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.449102    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:19.655973 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.655947    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"]
Jul 09 01:02:19.657541 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:02:19.657512    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba4ae3c_07ab_4252_829f_56a0e07337ed.slice/crio-bb51ed9a841e7c03842bd4ce392b428afa84f0c51bc0efc6a4b9551e7f4ba729 WatchSource:0}: Error finding container bb51ed9a841e7c03842bd4ce392b428afa84f0c51bc0efc6a4b9551e7f4ba729: Status 404 returned error can't find the container with id bb51ed9a841e7c03842bd4ce392b428afa84f0c51bc0efc6a4b9551e7f4ba729
Jul 09 01:02:19.818555 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:19.818521    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg" event={"ID":"1ba4ae3c-07ab-4252-829f-56a0e07337ed","Type":"ContainerStarted","Data":"bb51ed9a841e7c03842bd4ce392b428afa84f0c51bc0efc6a4b9551e7f4ba729"}
Jul 09 01:02:22.711301 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:22.711266    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 01:02:22.711546 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:22.711360    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 01:02:22.711546 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:22.711389    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 01:02:22.765130 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:22.765100    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f697db6c5-r72s4" podUID="6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f" containerName="console" containerID="cri-o://192b4036e209afd8931aa354f1a6a493207fee97ecbc1cbced8504238472e23f" gracePeriod=15
Jul 09 01:02:23.025537 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.025512    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 01:02:23.191809 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.191778    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-trusted-ca-bundle\") pod \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") "
Jul 09 01:02:23.192001 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.191847    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tmqk\" (UniqueName: \"kubernetes.io/projected/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-kube-api-access-9tmqk\") pod \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") "
Jul 09 01:02:23.192001 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.191873    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-oauth-config\") pod \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") "
Jul 09 01:02:23.192001 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.191898    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-service-ca\") pod \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") "
Jul 09 01:02:23.192001 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.191915    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-serving-cert\") pod \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") "
Jul 09 01:02:23.192001 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.191943    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-config\") pod \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") "
Jul 09 01:02:23.192001 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.191980    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-oauth-serving-cert\") pod \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\" (UID: \"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f\") "
Jul 09 01:02:23.192333 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.192279    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f" (UID: "6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:02:23.192463 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.192442    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-service-ca" (OuterVolumeSpecName: "service-ca") pod "6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f" (UID: "6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:02:23.192693 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.192489    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-config" (OuterVolumeSpecName: "console-config") pod "6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f" (UID: "6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:02:23.192693 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.192515    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f" (UID: "6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:02:23.194252 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.194226    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f" (UID: "6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:02:23.194546 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.194530    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-kube-api-access-9tmqk" (OuterVolumeSpecName: "kube-api-access-9tmqk") pod "6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f" (UID: "6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f"). InnerVolumeSpecName "kube-api-access-9tmqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:02:23.194604 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.194561    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f" (UID: "6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:02:23.293282 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.293166    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-trusted-ca-bundle\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:02:23.293282 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.293197    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tmqk\" (UniqueName: \"kubernetes.io/projected/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-kube-api-access-9tmqk\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:02:23.293282 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.293227    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-oauth-config\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:02:23.293282 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.293238    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-service-ca\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:02:23.293282 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.293246    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-serving-cert\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:02:23.293282 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.293255    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-console-config\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:02:23.293282 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.293263    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f-oauth-serving-cert\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:02:23.846010 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.845973    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg" event={"ID":"1ba4ae3c-07ab-4252-829f-56a0e07337ed","Type":"ContainerStarted","Data":"6401611cfe84e98f369bd3202a00398f07b189d71fb47da0a7e32bb939bdc88b"}
Jul 09 01:02:23.847500 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.847464    2565 generic.go:356] "Generic (PLEG): container finished" podID="6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f" containerID="192b4036e209afd8931aa354f1a6a493207fee97ecbc1cbced8504238472e23f" exitCode=0
Jul 09 01:02:23.847607 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.847502    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f697db6c5-r72s4"
Jul 09 01:02:23.847607 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.847538    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f697db6c5-r72s4" event={"ID":"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f","Type":"ContainerDied","Data":"192b4036e209afd8931aa354f1a6a493207fee97ecbc1cbced8504238472e23f"}
Jul 09 01:02:23.847607 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.847594    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f697db6c5-r72s4" event={"ID":"6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f","Type":"ContainerDied","Data":"6ea1c29f9b405936d5b99bd9c6134ce58884d1e4e4e6f1e3ee2cc608b5d8b523"}
Jul 09 01:02:23.847742 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.847619    2565 scope.go:117] "RemoveContainer" containerID="192b4036e209afd8931aa354f1a6a493207fee97ecbc1cbced8504238472e23f"
Jul 09 01:02:23.856281 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.856262    2565 scope.go:117] "RemoveContainer" containerID="192b4036e209afd8931aa354f1a6a493207fee97ecbc1cbced8504238472e23f"
Jul 09 01:02:23.856584 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:02:23.856560    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"192b4036e209afd8931aa354f1a6a493207fee97ecbc1cbced8504238472e23f\": container with ID starting with 192b4036e209afd8931aa354f1a6a493207fee97ecbc1cbced8504238472e23f not found: ID does not exist" containerID="192b4036e209afd8931aa354f1a6a493207fee97ecbc1cbced8504238472e23f"
Jul 09 01:02:23.856653 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.856594    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"192b4036e209afd8931aa354f1a6a493207fee97ecbc1cbced8504238472e23f"} err="failed to get container status \"192b4036e209afd8931aa354f1a6a493207fee97ecbc1cbced8504238472e23f\": rpc error: code = NotFound desc = could not find container \"192b4036e209afd8931aa354f1a6a493207fee97ecbc1cbced8504238472e23f\": container with ID starting with 192b4036e209afd8931aa354f1a6a493207fee97ecbc1cbced8504238472e23f not found: ID does not exist"
Jul 09 01:02:23.869972 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.869929    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg" podStartSLOduration=1.818834525 podStartE2EDuration="4.869913132s" totalImagesPullingTime="3.051078607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:02:23.866671166 +0000 UTC m=+428.930165899" watchObservedRunningTime="2026-07-09 01:02:23.869913132 +0000 UTC m=+428.933407906"
Jul 09 01:02:23.881575 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.881548    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f697db6c5-r72s4"]
Jul 09 01:02:23.885009 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:23.884984    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f697db6c5-r72s4"]
Jul 09 01:02:24.449981 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:24.449945    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:24.454595 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:24.454573    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:24.853819 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:24.853790    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:24.854739 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:24.854720    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:02:25.506660 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:25.506626    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f" path="/var/lib/kubelet/pods/6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f/volumes"
Jul 09 01:02:32.685081 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:32.685040    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"]
Jul 09 01:02:32.685586 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:32.685544    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f" containerName="console"
Jul 09 01:02:32.685586 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:32.685564    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f" containerName="console"
Jul 09 01:02:32.685704 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:32.685664    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b9ec3cc-c0ed-4f4b-950f-6e7e77bbe71f" containerName="console"
Jul 09 01:02:32.690323 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:32.690305    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"
Jul 09 01:02:32.692521 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:32.692498    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 01:02:32.697849 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:32.697819    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"]
Jul 09 01:02:32.781848 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:32.781817    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"]
Jul 09 01:02:32.881570 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:32.881534    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d9d669b7-91ec-4d35-abd5-cd0272c299cb-config-file\") pod \"limitador-limitador-64c94fd64f-bjhx7\" (UID: \"d9d669b7-91ec-4d35-abd5-cd0272c299cb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"
Jul 09 01:02:32.881570 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:32.881576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj7pt\" (UniqueName: \"kubernetes.io/projected/d9d669b7-91ec-4d35-abd5-cd0272c299cb-kube-api-access-xj7pt\") pod \"limitador-limitador-64c94fd64f-bjhx7\" (UID: \"d9d669b7-91ec-4d35-abd5-cd0272c299cb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"
Jul 09 01:02:32.982903 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:32.982795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d9d669b7-91ec-4d35-abd5-cd0272c299cb-config-file\") pod \"limitador-limitador-64c94fd64f-bjhx7\" (UID: \"d9d669b7-91ec-4d35-abd5-cd0272c299cb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"
Jul 09 01:02:32.982903 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:32.982853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj7pt\" (UniqueName: \"kubernetes.io/projected/d9d669b7-91ec-4d35-abd5-cd0272c299cb-kube-api-access-xj7pt\") pod \"limitador-limitador-64c94fd64f-bjhx7\" (UID: \"d9d669b7-91ec-4d35-abd5-cd0272c299cb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"
Jul 09 01:02:32.983560 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:32.983540    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d9d669b7-91ec-4d35-abd5-cd0272c299cb-config-file\") pod \"limitador-limitador-64c94fd64f-bjhx7\" (UID: \"d9d669b7-91ec-4d35-abd5-cd0272c299cb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"
Jul 09 01:02:32.990643 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:32.990611    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj7pt\" (UniqueName: \"kubernetes.io/projected/d9d669b7-91ec-4d35-abd5-cd0272c299cb-kube-api-access-xj7pt\") pod \"limitador-limitador-64c94fd64f-bjhx7\" (UID: \"d9d669b7-91ec-4d35-abd5-cd0272c299cb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"
Jul 09 01:02:33.001409 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.001385    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"
Jul 09 01:02:33.144132 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.144097    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"]
Jul 09 01:02:33.145649 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:02:33.145623    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d669b7_91ec_4d35_abd5_cd0272c299cb.slice/crio-8fc6bcecf3a7c6f549d88daddc2ba620364b8e7b5df3f8a77ed74c2f5a53ea14 WatchSource:0}: Error finding container 8fc6bcecf3a7c6f549d88daddc2ba620364b8e7b5df3f8a77ed74c2f5a53ea14: Status 404 returned error can't find the container with id 8fc6bcecf3a7c6f549d88daddc2ba620364b8e7b5df3f8a77ed74c2f5a53ea14
Jul 09 01:02:33.479733 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.479699    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-h8dj2"]
Jul 09 01:02:33.484611 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.484587    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-h8dj2"
Jul 09 01:02:33.486464 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.486368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrzfc\" (UniqueName: \"kubernetes.io/projected/cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4-kube-api-access-vrzfc\") pod \"authorino-58cd955675-h8dj2\" (UID: \"cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4\") " pod="kuadrant-system/authorino-58cd955675-h8dj2"
Jul 09 01:02:33.487035 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.487018    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lfq2r\""
Jul 09 01:02:33.488514 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.488489    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-h8dj2"]
Jul 09 01:02:33.587255 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.587204    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrzfc\" (UniqueName: \"kubernetes.io/projected/cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4-kube-api-access-vrzfc\") pod \"authorino-58cd955675-h8dj2\" (UID: \"cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4\") " pod="kuadrant-system/authorino-58cd955675-h8dj2"
Jul 09 01:02:33.595015 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.594978    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrzfc\" (UniqueName: \"kubernetes.io/projected/cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4-kube-api-access-vrzfc\") pod \"authorino-58cd955675-h8dj2\" (UID: \"cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4\") " pod="kuadrant-system/authorino-58cd955675-h8dj2"
Jul 09 01:02:33.671048 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.671010    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5mlk"]
Jul 09 01:02:33.674482 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.674465    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n5mlk"
Jul 09 01:02:33.681553 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.681525    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5mlk"]
Jul 09 01:02:33.688295 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.688272    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrzxr\" (UniqueName: \"kubernetes.io/projected/64670bf6-f115-4558-8777-67ec5b317a71-kube-api-access-vrzxr\") pod \"authorino-75d556bd77-n5mlk\" (UID: \"64670bf6-f115-4558-8777-67ec5b317a71\") " pod="kuadrant-system/authorino-75d556bd77-n5mlk"
Jul 09 01:02:33.788928 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.788890    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrzxr\" (UniqueName: \"kubernetes.io/projected/64670bf6-f115-4558-8777-67ec5b317a71-kube-api-access-vrzxr\") pod \"authorino-75d556bd77-n5mlk\" (UID: \"64670bf6-f115-4558-8777-67ec5b317a71\") " pod="kuadrant-system/authorino-75d556bd77-n5mlk"
Jul 09 01:02:33.796448 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.796422    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrzxr\" (UniqueName: \"kubernetes.io/projected/64670bf6-f115-4558-8777-67ec5b317a71-kube-api-access-vrzxr\") pod \"authorino-75d556bd77-n5mlk\" (UID: \"64670bf6-f115-4558-8777-67ec5b317a71\") " pod="kuadrant-system/authorino-75d556bd77-n5mlk"
Jul 09 01:02:33.798146 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.798118    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-h8dj2"
Jul 09 01:02:33.917391 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.917360    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7" event={"ID":"d9d669b7-91ec-4d35-abd5-cd0272c299cb","Type":"ContainerStarted","Data":"8fc6bcecf3a7c6f549d88daddc2ba620364b8e7b5df3f8a77ed74c2f5a53ea14"}
Jul 09 01:02:33.956368 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.956342    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-h8dj2"]
Jul 09 01:02:33.958055 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:02:33.958029    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbc3a8eb_a263_4f7b_ab55_6b7e94a4e4e4.slice/crio-bd7fa4978989da009588ca502e05217a680c9fd3540145228b5647c279276905 WatchSource:0}: Error finding container bd7fa4978989da009588ca502e05217a680c9fd3540145228b5647c279276905: Status 404 returned error can't find the container with id bd7fa4978989da009588ca502e05217a680c9fd3540145228b5647c279276905
Jul 09 01:02:33.986189 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:33.986161    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n5mlk"
Jul 09 01:02:34.142866 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:34.142808    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5mlk"]
Jul 09 01:02:34.145760 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:02:34.145724    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64670bf6_f115_4558_8777_67ec5b317a71.slice/crio-2b90955cae200f1b061dfb879f06cc4edf50b57fed952a9b25a3088a565f2c26 WatchSource:0}: Error finding container 2b90955cae200f1b061dfb879f06cc4edf50b57fed952a9b25a3088a565f2c26: Status 404 returned error can't find the container with id 2b90955cae200f1b061dfb879f06cc4edf50b57fed952a9b25a3088a565f2c26
Jul 09 01:02:34.929476 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:34.929429    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n5mlk" event={"ID":"64670bf6-f115-4558-8777-67ec5b317a71","Type":"ContainerStarted","Data":"2b90955cae200f1b061dfb879f06cc4edf50b57fed952a9b25a3088a565f2c26"}
Jul 09 01:02:34.932547 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:34.932515    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-h8dj2" event={"ID":"cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4","Type":"ContainerStarted","Data":"bd7fa4978989da009588ca502e05217a680c9fd3540145228b5647c279276905"}
Jul 09 01:02:38.969289 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:38.969173    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7" event={"ID":"d9d669b7-91ec-4d35-abd5-cd0272c299cb","Type":"ContainerStarted","Data":"77bcc6fc78c64116a05e3a76f55608b451caddd561039b5361be8d7acef738e3"}
Jul 09 01:02:38.969741 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:38.969291    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"
Jul 09 01:02:38.970688 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:38.970660    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n5mlk" event={"ID":"64670bf6-f115-4558-8777-67ec5b317a71","Type":"ContainerStarted","Data":"d331c5c9735b3b246959693d0d57e107eee0209fdba9007c954a309ef87b3cc3"}
Jul 09 01:02:38.971981 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:38.971959    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-h8dj2" event={"ID":"cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4","Type":"ContainerStarted","Data":"189d91b8610bee2bc84a753e38f76dc5c1a37f3eaecf8384df8d1550b4781144"}
Jul 09 01:02:38.987522 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:38.987473    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7" podStartSLOduration=1.614655733 podStartE2EDuration="6.987457685s" totalImagesPullingTime="5.372801952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:02:38.986510814 +0000 UTC m=+444.050005520" watchObservedRunningTime="2026-07-09 01:02:38.987457685 +0000 UTC m=+444.050952421"
Jul 09 01:02:39.002956 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:39.002907    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-h8dj2" podStartSLOduration=1.449259326 podStartE2EDuration="6.002891828s" totalImagesPullingTime="4.553632502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:02:39.001688655 +0000 UTC m=+444.065183362" watchObservedRunningTime="2026-07-09 01:02:39.002891828 +0000 UTC m=+444.066386534"
Jul 09 01:02:39.014638 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:39.014588    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-n5mlk" podStartSLOduration=1.693635203 podStartE2EDuration="6.014574266s" totalImagesPullingTime="4.320939063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:02:39.014416557 +0000 UTC m=+444.077911262" watchObservedRunningTime="2026-07-09 01:02:39.014574266 +0000 UTC m=+444.078068979"
Jul 09 01:02:39.040342 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:39.040309    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-h8dj2"]
Jul 09 01:02:40.982690 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:40.982652    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-h8dj2" podUID="cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4" containerName="authorino" containerID="cri-o://189d91b8610bee2bc84a753e38f76dc5c1a37f3eaecf8384df8d1550b4781144" gracePeriod=30
Jul 09 01:02:41.239118 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:41.239059    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-h8dj2"
Jul 09 01:02:41.268943 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:41.268911    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrzfc\" (UniqueName: \"kubernetes.io/projected/cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4-kube-api-access-vrzfc\") pod \"cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4\" (UID: \"cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4\") "
Jul 09 01:02:41.271385 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:41.271352    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4-kube-api-access-vrzfc" (OuterVolumeSpecName: "kube-api-access-vrzfc") pod "cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4" (UID: "cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4"). InnerVolumeSpecName "kube-api-access-vrzfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:02:41.369712 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:41.369675    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrzfc\" (UniqueName: \"kubernetes.io/projected/cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4-kube-api-access-vrzfc\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:02:41.989585 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:41.989489    2565 generic.go:356] "Generic (PLEG): container finished" podID="cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4" containerID="189d91b8610bee2bc84a753e38f76dc5c1a37f3eaecf8384df8d1550b4781144" exitCode=0
Jul 09 01:02:41.989585 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:41.989537    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-h8dj2"
Jul 09 01:02:41.989585 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:41.989576    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-h8dj2" event={"ID":"cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4","Type":"ContainerDied","Data":"189d91b8610bee2bc84a753e38f76dc5c1a37f3eaecf8384df8d1550b4781144"}
Jul 09 01:02:41.990066 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:41.989622    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-h8dj2" event={"ID":"cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4","Type":"ContainerDied","Data":"bd7fa4978989da009588ca502e05217a680c9fd3540145228b5647c279276905"}
Jul 09 01:02:41.990066 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:41.989642    2565 scope.go:117] "RemoveContainer" containerID="189d91b8610bee2bc84a753e38f76dc5c1a37f3eaecf8384df8d1550b4781144"
Jul 09 01:02:41.998378 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:41.998355    2565 scope.go:117] "RemoveContainer" containerID="189d91b8610bee2bc84a753e38f76dc5c1a37f3eaecf8384df8d1550b4781144"
Jul 09 01:02:41.998666 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:02:41.998646    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"189d91b8610bee2bc84a753e38f76dc5c1a37f3eaecf8384df8d1550b4781144\": container with ID starting with 189d91b8610bee2bc84a753e38f76dc5c1a37f3eaecf8384df8d1550b4781144 not found: ID does not exist" containerID="189d91b8610bee2bc84a753e38f76dc5c1a37f3eaecf8384df8d1550b4781144"
Jul 09 01:02:41.998726 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:41.998675    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"189d91b8610bee2bc84a753e38f76dc5c1a37f3eaecf8384df8d1550b4781144"} err="failed to get container status \"189d91b8610bee2bc84a753e38f76dc5c1a37f3eaecf8384df8d1550b4781144\": rpc error: code = NotFound desc = could not find container \"189d91b8610bee2bc84a753e38f76dc5c1a37f3eaecf8384df8d1550b4781144\": container with ID starting with 189d91b8610bee2bc84a753e38f76dc5c1a37f3eaecf8384df8d1550b4781144 not found: ID does not exist"
Jul 09 01:02:42.006682 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:42.006652    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-h8dj2"]
Jul 09 01:02:42.009886 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:42.009865    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-h8dj2"]
Jul 09 01:02:43.506826 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:43.506792    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4" path="/var/lib/kubelet/pods/cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4/volumes"
Jul 09 01:02:48.193384 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:48.193352    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"]
Jul 09 01:02:48.193828 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:48.193534    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7" podUID="d9d669b7-91ec-4d35-abd5-cd0272c299cb" containerName="limitador" containerID="cri-o://77bcc6fc78c64116a05e3a76f55608b451caddd561039b5361be8d7acef738e3" gracePeriod=30
Jul 09 01:02:48.194277 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:48.194258    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"
Jul 09 01:02:48.740877 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:48.740851    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"
Jul 09 01:02:48.835315 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:48.835192    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj7pt\" (UniqueName: \"kubernetes.io/projected/d9d669b7-91ec-4d35-abd5-cd0272c299cb-kube-api-access-xj7pt\") pod \"d9d669b7-91ec-4d35-abd5-cd0272c299cb\" (UID: \"d9d669b7-91ec-4d35-abd5-cd0272c299cb\") "
Jul 09 01:02:48.835315 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:48.835304    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d9d669b7-91ec-4d35-abd5-cd0272c299cb-config-file\") pod \"d9d669b7-91ec-4d35-abd5-cd0272c299cb\" (UID: \"d9d669b7-91ec-4d35-abd5-cd0272c299cb\") "
Jul 09 01:02:48.835678 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:48.835646    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9d669b7-91ec-4d35-abd5-cd0272c299cb-config-file" (OuterVolumeSpecName: "config-file") pod "d9d669b7-91ec-4d35-abd5-cd0272c299cb" (UID: "d9d669b7-91ec-4d35-abd5-cd0272c299cb"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:02:48.837245 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:48.837206    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9d669b7-91ec-4d35-abd5-cd0272c299cb-kube-api-access-xj7pt" (OuterVolumeSpecName: "kube-api-access-xj7pt") pod "d9d669b7-91ec-4d35-abd5-cd0272c299cb" (UID: "d9d669b7-91ec-4d35-abd5-cd0272c299cb"). InnerVolumeSpecName "kube-api-access-xj7pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:02:48.936354 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:48.936317    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj7pt\" (UniqueName: \"kubernetes.io/projected/d9d669b7-91ec-4d35-abd5-cd0272c299cb-kube-api-access-xj7pt\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:02:48.936354 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:48.936344    2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d9d669b7-91ec-4d35-abd5-cd0272c299cb-config-file\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:02:49.029944 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:49.029907    2565 generic.go:356] "Generic (PLEG): container finished" podID="d9d669b7-91ec-4d35-abd5-cd0272c299cb" containerID="77bcc6fc78c64116a05e3a76f55608b451caddd561039b5361be8d7acef738e3" exitCode=0
Jul 09 01:02:49.030110 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:49.029952    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"
Jul 09 01:02:49.030110 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:49.029993    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7" event={"ID":"d9d669b7-91ec-4d35-abd5-cd0272c299cb","Type":"ContainerDied","Data":"77bcc6fc78c64116a05e3a76f55608b451caddd561039b5361be8d7acef738e3"}
Jul 09 01:02:49.030110 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:49.030067    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bjhx7" event={"ID":"d9d669b7-91ec-4d35-abd5-cd0272c299cb","Type":"ContainerDied","Data":"8fc6bcecf3a7c6f549d88daddc2ba620364b8e7b5df3f8a77ed74c2f5a53ea14"}
Jul 09 01:02:49.030110 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:49.030090    2565 scope.go:117] "RemoveContainer" containerID="77bcc6fc78c64116a05e3a76f55608b451caddd561039b5361be8d7acef738e3"
Jul 09 01:02:49.039258 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:49.039241    2565 scope.go:117] "RemoveContainer" containerID="77bcc6fc78c64116a05e3a76f55608b451caddd561039b5361be8d7acef738e3"
Jul 09 01:02:49.039518 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:02:49.039500    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77bcc6fc78c64116a05e3a76f55608b451caddd561039b5361be8d7acef738e3\": container with ID starting with 77bcc6fc78c64116a05e3a76f55608b451caddd561039b5361be8d7acef738e3 not found: ID does not exist" containerID="77bcc6fc78c64116a05e3a76f55608b451caddd561039b5361be8d7acef738e3"
Jul 09 01:02:49.039569 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:49.039526    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77bcc6fc78c64116a05e3a76f55608b451caddd561039b5361be8d7acef738e3"} err="failed to get container status \"77bcc6fc78c64116a05e3a76f55608b451caddd561039b5361be8d7acef738e3\": rpc error: code = NotFound desc = could not find container \"77bcc6fc78c64116a05e3a76f55608b451caddd561039b5361be8d7acef738e3\": container with ID starting with 77bcc6fc78c64116a05e3a76f55608b451caddd561039b5361be8d7acef738e3 not found: ID does not exist"
Jul 09 01:02:49.051255 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:49.051230    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"]
Jul 09 01:02:49.054667 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:49.054646    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bjhx7"]
Jul 09 01:02:49.506524 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:49.506494    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9d669b7-91ec-4d35-abd5-cd0272c299cb" path="/var/lib/kubelet/pods/d9d669b7-91ec-4d35-abd5-cd0272c299cb/volumes"
Jul 09 01:02:51.941692 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:51.941659    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-n2qsq"]
Jul 09 01:02:51.942265 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:51.942179    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4" containerName="authorino"
Jul 09 01:02:51.942265 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:51.942200    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4" containerName="authorino"
Jul 09 01:02:51.942265 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:51.942250    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d669b7-91ec-4d35-abd5-cd0272c299cb" containerName="limitador"
Jul 09 01:02:51.942265 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:51.942261    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d669b7-91ec-4d35-abd5-cd0272c299cb" containerName="limitador"
Jul 09 01:02:51.942493 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:51.942377    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9d669b7-91ec-4d35-abd5-cd0272c299cb" containerName="limitador"
Jul 09 01:02:51.942493 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:51.942392    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbc3a8eb-a263-4f7b-ab55-6b7e94a4e4e4" containerName="authorino"
Jul 09 01:02:51.946757 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:51.946737    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n2qsq"
Jul 09 01:02:51.948999 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:51.948974    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 09 01:02:51.949288 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:51.949265    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 01:02:51.949930 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:51.949898    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-mgvpq\""
Jul 09 01:02:51.949930 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:51.949930    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 01:02:51.956546 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:51.956525    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-n2qsq"]
Jul 09 01:02:52.065945 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:52.065908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/77b9d026-7f3f-40f7-98fe-a16259bbf7d9-data\") pod \"postgres-69fb4594cf-n2qsq\" (UID: \"77b9d026-7f3f-40f7-98fe-a16259bbf7d9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n2qsq"
Jul 09 01:02:52.066149 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:52.066051    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8nnj\" (UniqueName: \"kubernetes.io/projected/77b9d026-7f3f-40f7-98fe-a16259bbf7d9-kube-api-access-h8nnj\") pod \"postgres-69fb4594cf-n2qsq\" (UID: \"77b9d026-7f3f-40f7-98fe-a16259bbf7d9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n2qsq"
Jul 09 01:02:52.167036 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:52.166996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8nnj\" (UniqueName: \"kubernetes.io/projected/77b9d026-7f3f-40f7-98fe-a16259bbf7d9-kube-api-access-h8nnj\") pod \"postgres-69fb4594cf-n2qsq\" (UID: \"77b9d026-7f3f-40f7-98fe-a16259bbf7d9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n2qsq"
Jul 09 01:02:52.167253 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:52.167056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/77b9d026-7f3f-40f7-98fe-a16259bbf7d9-data\") pod \"postgres-69fb4594cf-n2qsq\" (UID: \"77b9d026-7f3f-40f7-98fe-a16259bbf7d9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n2qsq"
Jul 09 01:02:52.167456 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:52.167439    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/77b9d026-7f3f-40f7-98fe-a16259bbf7d9-data\") pod \"postgres-69fb4594cf-n2qsq\" (UID: \"77b9d026-7f3f-40f7-98fe-a16259bbf7d9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n2qsq"
Jul 09 01:02:52.175052 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:52.175027    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8nnj\" (UniqueName: \"kubernetes.io/projected/77b9d026-7f3f-40f7-98fe-a16259bbf7d9-kube-api-access-h8nnj\") pod \"postgres-69fb4594cf-n2qsq\" (UID: \"77b9d026-7f3f-40f7-98fe-a16259bbf7d9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n2qsq"
Jul 09 01:02:52.259368 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:52.259334    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n2qsq"
Jul 09 01:02:52.391300 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:52.391277    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-n2qsq"]
Jul 09 01:02:52.392997 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:02:52.392971    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b9d026_7f3f_40f7_98fe_a16259bbf7d9.slice/crio-458834fef561de4a4d61d7f56f253ca36eabcbf3e57acf0d80bcb258545b1547 WatchSource:0}: Error finding container 458834fef561de4a4d61d7f56f253ca36eabcbf3e57acf0d80bcb258545b1547: Status 404 returned error can't find the container with id 458834fef561de4a4d61d7f56f253ca36eabcbf3e57acf0d80bcb258545b1547
Jul 09 01:02:53.054292 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:53.054253    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n2qsq" event={"ID":"77b9d026-7f3f-40f7-98fe-a16259bbf7d9","Type":"ContainerStarted","Data":"458834fef561de4a4d61d7f56f253ca36eabcbf3e57acf0d80bcb258545b1547"}
Jul 09 01:02:58.093340 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:58.093288    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n2qsq" event={"ID":"77b9d026-7f3f-40f7-98fe-a16259bbf7d9","Type":"ContainerStarted","Data":"ab44b134f154398fc38aff0598aa9854b6437385d6038a897f7d9c633474c137"}
Jul 09 01:02:58.095464 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:58.095366    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n2qsq"
Jul 09 01:02:58.110120 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:02:58.110069    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n2qsq" podStartSLOduration=1.969764392 podStartE2EDuration="7.110055516s" totalImagesPullingTime="5.140291124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:02:58.107871556 +0000 UTC m=+463.171366262" watchObservedRunningTime="2026-07-09 01:02:58.110055516 +0000 UTC m=+463.173550221"
Jul 09 01:03:04.127765 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:04.127729    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n2qsq"
Jul 09 01:03:04.691388 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:04.691350    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z89cs"]
Jul 09 01:03:04.695199 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:04.695176    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-z89cs"
Jul 09 01:03:04.700616 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:04.700589    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z89cs"]
Jul 09 01:03:04.782670 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:04.782628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbbld\" (UniqueName: \"kubernetes.io/projected/f2c94254-6a5a-442b-a5d4-1ef6356a8c17-kube-api-access-pbbld\") pod \"authorino-5d4b67c446-z89cs\" (UID: \"f2c94254-6a5a-442b-a5d4-1ef6356a8c17\") " pod="kuadrant-system/authorino-5d4b67c446-z89cs"
Jul 09 01:03:04.883354 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:04.883318    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbbld\" (UniqueName: \"kubernetes.io/projected/f2c94254-6a5a-442b-a5d4-1ef6356a8c17-kube-api-access-pbbld\") pod \"authorino-5d4b67c446-z89cs\" (UID: \"f2c94254-6a5a-442b-a5d4-1ef6356a8c17\") " pod="kuadrant-system/authorino-5d4b67c446-z89cs"
Jul 09 01:03:04.890681 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:04.890647    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbbld\" (UniqueName: \"kubernetes.io/projected/f2c94254-6a5a-442b-a5d4-1ef6356a8c17-kube-api-access-pbbld\") pod \"authorino-5d4b67c446-z89cs\" (UID: \"f2c94254-6a5a-442b-a5d4-1ef6356a8c17\") " pod="kuadrant-system/authorino-5d4b67c446-z89cs"
Jul 09 01:03:04.964871 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:04.964789    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z89cs"]
Jul 09 01:03:04.965066 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:04.965055    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-z89cs"
Jul 09 01:03:04.989191 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:04.989163    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-574c6cfb7c-kgwxj"]
Jul 09 01:03:04.993963 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:04.993940    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574c6cfb7c-kgwxj"
Jul 09 01:03:04.996604 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:04.996580    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 09 01:03:05.000898 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:05.000867    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-574c6cfb7c-kgwxj"]
Jul 09 01:03:05.085576 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:05.085535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff329696-e01c-46a6-af73-991dc6ff939a-tls-cert\") pod \"authorino-574c6cfb7c-kgwxj\" (UID: \"ff329696-e01c-46a6-af73-991dc6ff939a\") " pod="kuadrant-system/authorino-574c6cfb7c-kgwxj"
Jul 09 01:03:05.085760 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:05.085613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ts5s\" (UniqueName: \"kubernetes.io/projected/ff329696-e01c-46a6-af73-991dc6ff939a-kube-api-access-5ts5s\") pod \"authorino-574c6cfb7c-kgwxj\" (UID: \"ff329696-e01c-46a6-af73-991dc6ff939a\") " pod="kuadrant-system/authorino-574c6cfb7c-kgwxj"
Jul 09 01:03:05.104787 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:05.104758    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z89cs"]
Jul 09 01:03:05.106264 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:03:05.106205    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2c94254_6a5a_442b_a5d4_1ef6356a8c17.slice/crio-850bae721c4d02213d739a6e915c88e32b57e64243937b828a7e974a2cd7711f WatchSource:0}: Error finding container 850bae721c4d02213d739a6e915c88e32b57e64243937b828a7e974a2cd7711f: Status 404 returned error can't find the container with id 850bae721c4d02213d739a6e915c88e32b57e64243937b828a7e974a2cd7711f
Jul 09 01:03:05.133489 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:05.133456    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-z89cs" event={"ID":"f2c94254-6a5a-442b-a5d4-1ef6356a8c17","Type":"ContainerStarted","Data":"850bae721c4d02213d739a6e915c88e32b57e64243937b828a7e974a2cd7711f"}
Jul 09 01:03:05.186881 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:05.186843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ts5s\" (UniqueName: \"kubernetes.io/projected/ff329696-e01c-46a6-af73-991dc6ff939a-kube-api-access-5ts5s\") pod \"authorino-574c6cfb7c-kgwxj\" (UID: \"ff329696-e01c-46a6-af73-991dc6ff939a\") " pod="kuadrant-system/authorino-574c6cfb7c-kgwxj"
Jul 09 01:03:05.187037 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:05.186940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff329696-e01c-46a6-af73-991dc6ff939a-tls-cert\") pod \"authorino-574c6cfb7c-kgwxj\" (UID: \"ff329696-e01c-46a6-af73-991dc6ff939a\") " pod="kuadrant-system/authorino-574c6cfb7c-kgwxj"
Jul 09 01:03:05.189415 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:05.189396    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff329696-e01c-46a6-af73-991dc6ff939a-tls-cert\") pod \"authorino-574c6cfb7c-kgwxj\" (UID: \"ff329696-e01c-46a6-af73-991dc6ff939a\") " pod="kuadrant-system/authorino-574c6cfb7c-kgwxj"
Jul 09 01:03:05.193917 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:05.193897    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ts5s\" (UniqueName: \"kubernetes.io/projected/ff329696-e01c-46a6-af73-991dc6ff939a-kube-api-access-5ts5s\") pod \"authorino-574c6cfb7c-kgwxj\" (UID: \"ff329696-e01c-46a6-af73-991dc6ff939a\") " pod="kuadrant-system/authorino-574c6cfb7c-kgwxj"
Jul 09 01:03:05.304364 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:05.304323    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574c6cfb7c-kgwxj"
Jul 09 01:03:05.441467 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:05.441433    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-574c6cfb7c-kgwxj"]
Jul 09 01:03:05.443133 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:03:05.443098    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff329696_e01c_46a6_af73_991dc6ff939a.slice/crio-463e8dd3809926fd5b78d58df88457f75ba4974ba2d0cc3d956af954b40d8d2c WatchSource:0}: Error finding container 463e8dd3809926fd5b78d58df88457f75ba4974ba2d0cc3d956af954b40d8d2c: Status 404 returned error can't find the container with id 463e8dd3809926fd5b78d58df88457f75ba4974ba2d0cc3d956af954b40d8d2c
Jul 09 01:03:06.140819 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:06.140722    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-z89cs" event={"ID":"f2c94254-6a5a-442b-a5d4-1ef6356a8c17","Type":"ContainerStarted","Data":"91d161585f26a890375aa9636665f75cce14c7573c5a40667286f0a5b30364cd"}
Jul 09 01:03:06.140819 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:06.140769    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-z89cs" podUID="f2c94254-6a5a-442b-a5d4-1ef6356a8c17" containerName="authorino" containerID="cri-o://91d161585f26a890375aa9636665f75cce14c7573c5a40667286f0a5b30364cd" gracePeriod=30
Jul 09 01:03:06.142361 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:06.142331    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574c6cfb7c-kgwxj" event={"ID":"ff329696-e01c-46a6-af73-991dc6ff939a","Type":"ContainerStarted","Data":"4f8350bac0cbc3742fcee289cb2b7151886856830d8d70bfe65f4361d4de370c"}
Jul 09 01:03:06.142491 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:06.142368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574c6cfb7c-kgwxj" event={"ID":"ff329696-e01c-46a6-af73-991dc6ff939a","Type":"ContainerStarted","Data":"463e8dd3809926fd5b78d58df88457f75ba4974ba2d0cc3d956af954b40d8d2c"}
Jul 09 01:03:06.158458 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:06.158416    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-z89cs" podStartSLOduration=1.821860751 podStartE2EDuration="2.158401638s" totalImagesPullingTime="336.540887ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:03:06.156130881 +0000 UTC m=+471.219625586" watchObservedRunningTime="2026-07-09 01:03:06.158401638 +0000 UTC m=+471.221896343"
Jul 09 01:03:06.170675 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:06.170617    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-574c6cfb7c-kgwxj" podStartSLOduration=1.851820838 podStartE2EDuration="2.170601515s" totalImagesPullingTime="318.780677ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:03:06.169504236 +0000 UTC m=+471.232998943" watchObservedRunningTime="2026-07-09 01:03:06.170601515 +0000 UTC m=+471.234096219"
Jul 09 01:03:06.194497 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:06.194464    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5mlk"]
Jul 09 01:03:06.194714 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:06.194690    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-n5mlk" podUID="64670bf6-f115-4558-8777-67ec5b317a71" containerName="authorino" containerID="cri-o://d331c5c9735b3b246959693d0d57e107eee0209fdba9007c954a309ef87b3cc3" gracePeriod=30
Jul 09 01:03:06.467376 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:06.467202    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-z89cs"
Jul 09 01:03:06.470471 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:06.470447    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n5mlk"
Jul 09 01:03:06.599128 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:06.599093    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrzxr\" (UniqueName: \"kubernetes.io/projected/64670bf6-f115-4558-8777-67ec5b317a71-kube-api-access-vrzxr\") pod \"64670bf6-f115-4558-8777-67ec5b317a71\" (UID: \"64670bf6-f115-4558-8777-67ec5b317a71\") "
Jul 09 01:03:06.599319 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:06.599198    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbbld\" (UniqueName: \"kubernetes.io/projected/f2c94254-6a5a-442b-a5d4-1ef6356a8c17-kube-api-access-pbbld\") pod \"f2c94254-6a5a-442b-a5d4-1ef6356a8c17\" (UID: \"f2c94254-6a5a-442b-a5d4-1ef6356a8c17\") "
Jul 09 01:03:06.601274 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:06.601239    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64670bf6-f115-4558-8777-67ec5b317a71-kube-api-access-vrzxr" (OuterVolumeSpecName: "kube-api-access-vrzxr") pod "64670bf6-f115-4558-8777-67ec5b317a71" (UID: "64670bf6-f115-4558-8777-67ec5b317a71"). InnerVolumeSpecName "kube-api-access-vrzxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:03:06.601274 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:06.601257    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2c94254-6a5a-442b-a5d4-1ef6356a8c17-kube-api-access-pbbld" (OuterVolumeSpecName: "kube-api-access-pbbld") pod "f2c94254-6a5a-442b-a5d4-1ef6356a8c17" (UID: "f2c94254-6a5a-442b-a5d4-1ef6356a8c17"). InnerVolumeSpecName "kube-api-access-pbbld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:03:06.700506 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:06.700419    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrzxr\" (UniqueName: \"kubernetes.io/projected/64670bf6-f115-4558-8777-67ec5b317a71-kube-api-access-vrzxr\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:03:06.700506 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:06.700449    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbbld\" (UniqueName: \"kubernetes.io/projected/f2c94254-6a5a-442b-a5d4-1ef6356a8c17-kube-api-access-pbbld\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:03:07.148962 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.148922    2565 generic.go:356] "Generic (PLEG): container finished" podID="64670bf6-f115-4558-8777-67ec5b317a71" containerID="d331c5c9735b3b246959693d0d57e107eee0209fdba9007c954a309ef87b3cc3" exitCode=0
Jul 09 01:03:07.149431 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.148967    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n5mlk"
Jul 09 01:03:07.149431 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.149008    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n5mlk" event={"ID":"64670bf6-f115-4558-8777-67ec5b317a71","Type":"ContainerDied","Data":"d331c5c9735b3b246959693d0d57e107eee0209fdba9007c954a309ef87b3cc3"}
Jul 09 01:03:07.149431 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.149055    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n5mlk" event={"ID":"64670bf6-f115-4558-8777-67ec5b317a71","Type":"ContainerDied","Data":"2b90955cae200f1b061dfb879f06cc4edf50b57fed952a9b25a3088a565f2c26"}
Jul 09 01:03:07.149431 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.149077    2565 scope.go:117] "RemoveContainer" containerID="d331c5c9735b3b246959693d0d57e107eee0209fdba9007c954a309ef87b3cc3"
Jul 09 01:03:07.150630 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.150605    2565 generic.go:356] "Generic (PLEG): container finished" podID="f2c94254-6a5a-442b-a5d4-1ef6356a8c17" containerID="91d161585f26a890375aa9636665f75cce14c7573c5a40667286f0a5b30364cd" exitCode=0
Jul 09 01:03:07.150752 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.150635    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-z89cs"
Jul 09 01:03:07.150752 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.150672    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-z89cs" event={"ID":"f2c94254-6a5a-442b-a5d4-1ef6356a8c17","Type":"ContainerDied","Data":"91d161585f26a890375aa9636665f75cce14c7573c5a40667286f0a5b30364cd"}
Jul 09 01:03:07.150752 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.150715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-z89cs" event={"ID":"f2c94254-6a5a-442b-a5d4-1ef6356a8c17","Type":"ContainerDied","Data":"850bae721c4d02213d739a6e915c88e32b57e64243937b828a7e974a2cd7711f"}
Jul 09 01:03:07.160742 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.160718    2565 scope.go:117] "RemoveContainer" containerID="d331c5c9735b3b246959693d0d57e107eee0209fdba9007c954a309ef87b3cc3"
Jul 09 01:03:07.161150 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:03:07.161123    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d331c5c9735b3b246959693d0d57e107eee0209fdba9007c954a309ef87b3cc3\": container with ID starting with d331c5c9735b3b246959693d0d57e107eee0209fdba9007c954a309ef87b3cc3 not found: ID does not exist" containerID="d331c5c9735b3b246959693d0d57e107eee0209fdba9007c954a309ef87b3cc3"
Jul 09 01:03:07.161235 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.161163    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d331c5c9735b3b246959693d0d57e107eee0209fdba9007c954a309ef87b3cc3"} err="failed to get container status \"d331c5c9735b3b246959693d0d57e107eee0209fdba9007c954a309ef87b3cc3\": rpc error: code = NotFound desc = could not find container \"d331c5c9735b3b246959693d0d57e107eee0209fdba9007c954a309ef87b3cc3\": container with ID starting with d331c5c9735b3b246959693d0d57e107eee0209fdba9007c954a309ef87b3cc3 not found: ID does not exist"
Jul 09 01:03:07.161235 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.161192    2565 scope.go:117] "RemoveContainer" containerID="91d161585f26a890375aa9636665f75cce14c7573c5a40667286f0a5b30364cd"
Jul 09 01:03:07.171468 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.171441    2565 scope.go:117] "RemoveContainer" containerID="91d161585f26a890375aa9636665f75cce14c7573c5a40667286f0a5b30364cd"
Jul 09 01:03:07.171772 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:03:07.171752    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91d161585f26a890375aa9636665f75cce14c7573c5a40667286f0a5b30364cd\": container with ID starting with 91d161585f26a890375aa9636665f75cce14c7573c5a40667286f0a5b30364cd not found: ID does not exist" containerID="91d161585f26a890375aa9636665f75cce14c7573c5a40667286f0a5b30364cd"
Jul 09 01:03:07.171840 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.171780    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91d161585f26a890375aa9636665f75cce14c7573c5a40667286f0a5b30364cd"} err="failed to get container status \"91d161585f26a890375aa9636665f75cce14c7573c5a40667286f0a5b30364cd\": rpc error: code = NotFound desc = could not find container \"91d161585f26a890375aa9636665f75cce14c7573c5a40667286f0a5b30364cd\": container with ID starting with 91d161585f26a890375aa9636665f75cce14c7573c5a40667286f0a5b30364cd not found: ID does not exist"
Jul 09 01:03:07.180825 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.180802    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5mlk"]
Jul 09 01:03:07.186417 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.186395    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5mlk"]
Jul 09 01:03:07.195095 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.195075    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z89cs"]
Jul 09 01:03:07.197775 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.197757    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z89cs"]
Jul 09 01:03:07.506812 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.506776    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64670bf6-f115-4558-8777-67ec5b317a71" path="/var/lib/kubelet/pods/64670bf6-f115-4558-8777-67ec5b317a71/volumes"
Jul 09 01:03:07.507109 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:07.507096    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2c94254-6a5a-442b-a5d4-1ef6356a8c17" path="/var/lib/kubelet/pods/f2c94254-6a5a-442b-a5d4-1ef6356a8c17/volumes"
Jul 09 01:03:11.296611 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.296565    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fff84bc67-t46vk"]
Jul 09 01:03:11.297126 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.297106    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64670bf6-f115-4558-8777-67ec5b317a71" containerName="authorino"
Jul 09 01:03:11.297241 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.297130    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="64670bf6-f115-4558-8777-67ec5b317a71" containerName="authorino"
Jul 09 01:03:11.297241 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.297142    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2c94254-6a5a-442b-a5d4-1ef6356a8c17" containerName="authorino"
Jul 09 01:03:11.297241 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.297150    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c94254-6a5a-442b-a5d4-1ef6356a8c17" containerName="authorino"
Jul 09 01:03:11.297395 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.297271    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="64670bf6-f115-4558-8777-67ec5b317a71" containerName="authorino"
Jul 09 01:03:11.297395 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.297285    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2c94254-6a5a-442b-a5d4-1ef6356a8c17" containerName="authorino"
Jul 09 01:03:11.299452 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.299432    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fff84bc67-t46vk"
Jul 09 01:03:11.302419 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.302401    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 01:03:11.302529 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.302513    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 01:03:11.303362 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.303336    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z9pb7\""
Jul 09 01:03:11.310119 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.310097    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fff84bc67-t46vk"]
Jul 09 01:03:11.442866 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.442822    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcgt5\" (UniqueName: \"kubernetes.io/projected/30666833-f361-454f-8c52-1031e7e201ea-kube-api-access-xcgt5\") pod \"maas-controller-7fff84bc67-t46vk\" (UID: \"30666833-f361-454f-8c52-1031e7e201ea\") " pod="opendatahub/maas-controller-7fff84bc67-t46vk"
Jul 09 01:03:11.443057 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.442879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30666833-f361-454f-8c52-1031e7e201ea-webhook-cert\") pod \"maas-controller-7fff84bc67-t46vk\" (UID: \"30666833-f361-454f-8c52-1031e7e201ea\") " pod="opendatahub/maas-controller-7fff84bc67-t46vk"
Jul 09 01:03:11.474065 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.474030    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c89db8b46-2znnt"]
Jul 09 01:03:11.476653 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.476630    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c89db8b46-2znnt"
Jul 09 01:03:11.487047 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.487024    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c89db8b46-2znnt"]
Jul 09 01:03:11.544109 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.544072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcgt5\" (UniqueName: \"kubernetes.io/projected/30666833-f361-454f-8c52-1031e7e201ea-kube-api-access-xcgt5\") pod \"maas-controller-7fff84bc67-t46vk\" (UID: \"30666833-f361-454f-8c52-1031e7e201ea\") " pod="opendatahub/maas-controller-7fff84bc67-t46vk"
Jul 09 01:03:11.544279 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.544123    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30666833-f361-454f-8c52-1031e7e201ea-webhook-cert\") pod \"maas-controller-7fff84bc67-t46vk\" (UID: \"30666833-f361-454f-8c52-1031e7e201ea\") " pod="opendatahub/maas-controller-7fff84bc67-t46vk"
Jul 09 01:03:11.544279 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:03:11.544263    2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 09 01:03:11.544395 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:03:11.544335    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30666833-f361-454f-8c52-1031e7e201ea-webhook-cert podName:30666833-f361-454f-8c52-1031e7e201ea nodeName:}" failed. No retries permitted until 2026-07-09 01:03:12.04431495 +0000 UTC m=+477.107809633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/30666833-f361-454f-8c52-1031e7e201ea-webhook-cert") pod "maas-controller-7fff84bc67-t46vk" (UID: "30666833-f361-454f-8c52-1031e7e201ea") : secret "maas-controller-webhook-cert" not found
Jul 09 01:03:11.552701 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.552636    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcgt5\" (UniqueName: \"kubernetes.io/projected/30666833-f361-454f-8c52-1031e7e201ea-kube-api-access-xcgt5\") pod \"maas-controller-7fff84bc67-t46vk\" (UID: \"30666833-f361-454f-8c52-1031e7e201ea\") " pod="opendatahub/maas-controller-7fff84bc67-t46vk"
Jul 09 01:03:11.645373 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.645337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thgnp\" (UniqueName: \"kubernetes.io/projected/5e0c3a60-93ae-4753-9113-2c799faa5f46-kube-api-access-thgnp\") pod \"maas-controller-5c89db8b46-2znnt\" (UID: \"5e0c3a60-93ae-4753-9113-2c799faa5f46\") " pod="opendatahub/maas-controller-5c89db8b46-2znnt"
Jul 09 01:03:11.645523 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.645432    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e0c3a60-93ae-4753-9113-2c799faa5f46-webhook-cert\") pod \"maas-controller-5c89db8b46-2znnt\" (UID: \"5e0c3a60-93ae-4753-9113-2c799faa5f46\") " pod="opendatahub/maas-controller-5c89db8b46-2znnt"
Jul 09 01:03:11.745911 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.745875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thgnp\" (UniqueName: \"kubernetes.io/projected/5e0c3a60-93ae-4753-9113-2c799faa5f46-kube-api-access-thgnp\") pod \"maas-controller-5c89db8b46-2znnt\" (UID: \"5e0c3a60-93ae-4753-9113-2c799faa5f46\") " pod="opendatahub/maas-controller-5c89db8b46-2znnt"
Jul 09 01:03:11.746100 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.746081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e0c3a60-93ae-4753-9113-2c799faa5f46-webhook-cert\") pod \"maas-controller-5c89db8b46-2znnt\" (UID: \"5e0c3a60-93ae-4753-9113-2c799faa5f46\") " pod="opendatahub/maas-controller-5c89db8b46-2znnt"
Jul 09 01:03:11.748539 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.748511    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e0c3a60-93ae-4753-9113-2c799faa5f46-webhook-cert\") pod \"maas-controller-5c89db8b46-2znnt\" (UID: \"5e0c3a60-93ae-4753-9113-2c799faa5f46\") " pod="opendatahub/maas-controller-5c89db8b46-2znnt"
Jul 09 01:03:11.752828 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.752804    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thgnp\" (UniqueName: \"kubernetes.io/projected/5e0c3a60-93ae-4753-9113-2c799faa5f46-kube-api-access-thgnp\") pod \"maas-controller-5c89db8b46-2znnt\" (UID: \"5e0c3a60-93ae-4753-9113-2c799faa5f46\") " pod="opendatahub/maas-controller-5c89db8b46-2znnt"
Jul 09 01:03:11.787893 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.787857    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c89db8b46-2znnt"
Jul 09 01:03:11.923251 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:11.920432    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c89db8b46-2znnt"]
Jul 09 01:03:12.049115 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:12.049079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30666833-f361-454f-8c52-1031e7e201ea-webhook-cert\") pod \"maas-controller-7fff84bc67-t46vk\" (UID: \"30666833-f361-454f-8c52-1031e7e201ea\") " pod="opendatahub/maas-controller-7fff84bc67-t46vk"
Jul 09 01:03:12.051754 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:12.051727    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30666833-f361-454f-8c52-1031e7e201ea-webhook-cert\") pod \"maas-controller-7fff84bc67-t46vk\" (UID: \"30666833-f361-454f-8c52-1031e7e201ea\") " pod="opendatahub/maas-controller-7fff84bc67-t46vk"
Jul 09 01:03:12.182028 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:12.181940    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c89db8b46-2znnt" event={"ID":"5e0c3a60-93ae-4753-9113-2c799faa5f46","Type":"ContainerStarted","Data":"0da684e503e6acbcc4eb6aa02c6a423d21818ba5bc77eadcf245b83933b5b622"}
Jul 09 01:03:12.210174 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:12.210136    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fff84bc67-t46vk"
Jul 09 01:03:12.342688 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:12.342660    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fff84bc67-t46vk"]
Jul 09 01:03:12.344160 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:03:12.344131    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30666833_f361_454f_8c52_1031e7e201ea.slice/crio-d9365d120c203e400eb1a9b75b2a85a504c6ffab6090115a5bfe0b0689fc9b71 WatchSource:0}: Error finding container d9365d120c203e400eb1a9b75b2a85a504c6ffab6090115a5bfe0b0689fc9b71: Status 404 returned error can't find the container with id d9365d120c203e400eb1a9b75b2a85a504c6ffab6090115a5bfe0b0689fc9b71
Jul 09 01:03:13.196755 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:13.196656    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fff84bc67-t46vk" event={"ID":"30666833-f361-454f-8c52-1031e7e201ea","Type":"ContainerStarted","Data":"d9365d120c203e400eb1a9b75b2a85a504c6ffab6090115a5bfe0b0689fc9b71"}
Jul 09 01:03:15.211257 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:15.211222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fff84bc67-t46vk" event={"ID":"30666833-f361-454f-8c52-1031e7e201ea","Type":"ContainerStarted","Data":"51f9f31a20756beeaedf605c11540b34195db0b4a4456a978265453c4e9278ce"}
Jul 09 01:03:15.211721 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:15.211287    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fff84bc67-t46vk"
Jul 09 01:03:15.212818 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:15.212797    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c89db8b46-2znnt" event={"ID":"5e0c3a60-93ae-4753-9113-2c799faa5f46","Type":"ContainerStarted","Data":"85137272c5883768c6c037bc7d9ca879719433dc531bcae9a1696007f2ce3d52"}
Jul 09 01:03:15.212942 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:15.212924    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c89db8b46-2znnt"
Jul 09 01:03:15.229705 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:15.229650    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fff84bc67-t46vk" podStartSLOduration=2.080518359 podStartE2EDuration="4.229634679s" totalImagesPullingTime="2.14911632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:03:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:03:15.227146819 +0000 UTC m=+480.290641524" watchObservedRunningTime="2026-07-09 01:03:15.229634679 +0000 UTC m=+480.293129385"
Jul 09 01:03:15.243263 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:15.243189    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c89db8b46-2znnt" podStartSLOduration=1.6835889210000001 podStartE2EDuration="4.243174077s" totalImagesPullingTime="2.559585156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:03:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:03:15.24242912 +0000 UTC m=+480.305923823" watchObservedRunningTime="2026-07-09 01:03:15.243174077 +0000 UTC m=+480.306668795"
Jul 09 01:03:26.224064 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:26.224032    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fff84bc67-t46vk"
Jul 09 01:03:26.224838 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:26.224106    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c89db8b46-2znnt"
Jul 09 01:03:26.280298 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:26.280268    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fff84bc67-t46vk"]
Jul 09 01:03:26.280478 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:26.280456    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7fff84bc67-t46vk" podUID="30666833-f361-454f-8c52-1031e7e201ea" containerName="manager" containerID="cri-o://51f9f31a20756beeaedf605c11540b34195db0b4a4456a978265453c4e9278ce" gracePeriod=30
Jul 09 01:03:26.530805 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:26.530770    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fff84bc67-t46vk"
Jul 09 01:03:26.567506 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:26.567468    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcgt5\" (UniqueName: \"kubernetes.io/projected/30666833-f361-454f-8c52-1031e7e201ea-kube-api-access-xcgt5\") pod \"30666833-f361-454f-8c52-1031e7e201ea\" (UID: \"30666833-f361-454f-8c52-1031e7e201ea\") "
Jul 09 01:03:26.567692 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:26.567597    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30666833-f361-454f-8c52-1031e7e201ea-webhook-cert\") pod \"30666833-f361-454f-8c52-1031e7e201ea\" (UID: \"30666833-f361-454f-8c52-1031e7e201ea\") "
Jul 09 01:03:26.569787 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:26.569756    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30666833-f361-454f-8c52-1031e7e201ea-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "30666833-f361-454f-8c52-1031e7e201ea" (UID: "30666833-f361-454f-8c52-1031e7e201ea"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:03:26.569903 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:26.569760    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30666833-f361-454f-8c52-1031e7e201ea-kube-api-access-xcgt5" (OuterVolumeSpecName: "kube-api-access-xcgt5") pod "30666833-f361-454f-8c52-1031e7e201ea" (UID: "30666833-f361-454f-8c52-1031e7e201ea"). InnerVolumeSpecName "kube-api-access-xcgt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:03:26.668384 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:26.668342    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30666833-f361-454f-8c52-1031e7e201ea-webhook-cert\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:03:26.668384 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:26.668381    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcgt5\" (UniqueName: \"kubernetes.io/projected/30666833-f361-454f-8c52-1031e7e201ea-kube-api-access-xcgt5\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:03:27.284016 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:27.283981    2565 generic.go:356] "Generic (PLEG): container finished" podID="30666833-f361-454f-8c52-1031e7e201ea" containerID="51f9f31a20756beeaedf605c11540b34195db0b4a4456a978265453c4e9278ce" exitCode=0
Jul 09 01:03:27.284514 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:27.284042    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fff84bc67-t46vk"
Jul 09 01:03:27.284514 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:27.284071    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fff84bc67-t46vk" event={"ID":"30666833-f361-454f-8c52-1031e7e201ea","Type":"ContainerDied","Data":"51f9f31a20756beeaedf605c11540b34195db0b4a4456a978265453c4e9278ce"}
Jul 09 01:03:27.284514 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:27.284147    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fff84bc67-t46vk" event={"ID":"30666833-f361-454f-8c52-1031e7e201ea","Type":"ContainerDied","Data":"d9365d120c203e400eb1a9b75b2a85a504c6ffab6090115a5bfe0b0689fc9b71"}
Jul 09 01:03:27.284514 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:27.284168    2565 scope.go:117] "RemoveContainer" containerID="51f9f31a20756beeaedf605c11540b34195db0b4a4456a978265453c4e9278ce"
Jul 09 01:03:27.293187 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:27.293173    2565 scope.go:117] "RemoveContainer" containerID="51f9f31a20756beeaedf605c11540b34195db0b4a4456a978265453c4e9278ce"
Jul 09 01:03:27.293454 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:03:27.293430    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51f9f31a20756beeaedf605c11540b34195db0b4a4456a978265453c4e9278ce\": container with ID starting with 51f9f31a20756beeaedf605c11540b34195db0b4a4456a978265453c4e9278ce not found: ID does not exist" containerID="51f9f31a20756beeaedf605c11540b34195db0b4a4456a978265453c4e9278ce"
Jul 09 01:03:27.293520 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:27.293461    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51f9f31a20756beeaedf605c11540b34195db0b4a4456a978265453c4e9278ce"} err="failed to get container status \"51f9f31a20756beeaedf605c11540b34195db0b4a4456a978265453c4e9278ce\": rpc error: code = NotFound desc = could not find container \"51f9f31a20756beeaedf605c11540b34195db0b4a4456a978265453c4e9278ce\": container with ID starting with 51f9f31a20756beeaedf605c11540b34195db0b4a4456a978265453c4e9278ce not found: ID does not exist"
Jul 09 01:03:27.305586 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:27.305565    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fff84bc67-t46vk"]
Jul 09 01:03:27.308984 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:27.308965    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7fff84bc67-t46vk"]
Jul 09 01:03:27.506308 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:27.506274    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30666833-f361-454f-8c52-1031e7e201ea" path="/var/lib/kubelet/pods/30666833-f361-454f-8c52-1031e7e201ea/volumes"
Jul 09 01:03:47.485575 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.485541    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6987d8886-ng82l"]
Jul 09 01:03:47.485981 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.485927    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30666833-f361-454f-8c52-1031e7e201ea" containerName="manager"
Jul 09 01:03:47.485981 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.485939    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="30666833-f361-454f-8c52-1031e7e201ea" containerName="manager"
Jul 09 01:03:47.486059 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.486030    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="30666833-f361-454f-8c52-1031e7e201ea" containerName="manager"
Jul 09 01:03:47.490206 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.490186    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6987d8886-ng82l"
Jul 09 01:03:47.492624 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.492598    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5rxv2\""
Jul 09 01:03:47.492753 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.492597    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 09 01:03:47.499943 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.499917    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6987d8886-ng82l"]
Jul 09 01:03:47.553122 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.553082    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7b097f5-1877-453c-bca3-68ea78e7f2a5-openshift-service-ca\") pod \"maas-api-6987d8886-ng82l\" (UID: \"a7b097f5-1877-453c-bca3-68ea78e7f2a5\") " pod="odh-ai-gateway-infra/maas-api-6987d8886-ng82l"
Jul 09 01:03:47.553340 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.553152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7b097f5-1877-453c-bca3-68ea78e7f2a5-maas-api-tls\") pod \"maas-api-6987d8886-ng82l\" (UID: \"a7b097f5-1877-453c-bca3-68ea78e7f2a5\") " pod="odh-ai-gateway-infra/maas-api-6987d8886-ng82l"
Jul 09 01:03:47.553340 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.553292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrtd5\" (UniqueName: \"kubernetes.io/projected/a7b097f5-1877-453c-bca3-68ea78e7f2a5-kube-api-access-mrtd5\") pod \"maas-api-6987d8886-ng82l\" (UID: \"a7b097f5-1877-453c-bca3-68ea78e7f2a5\") " pod="odh-ai-gateway-infra/maas-api-6987d8886-ng82l"
Jul 09 01:03:47.654737 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.654695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7b097f5-1877-453c-bca3-68ea78e7f2a5-openshift-service-ca\") pod \"maas-api-6987d8886-ng82l\" (UID: \"a7b097f5-1877-453c-bca3-68ea78e7f2a5\") " pod="odh-ai-gateway-infra/maas-api-6987d8886-ng82l"
Jul 09 01:03:47.654921 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.654752    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7b097f5-1877-453c-bca3-68ea78e7f2a5-maas-api-tls\") pod \"maas-api-6987d8886-ng82l\" (UID: \"a7b097f5-1877-453c-bca3-68ea78e7f2a5\") " pod="odh-ai-gateway-infra/maas-api-6987d8886-ng82l"
Jul 09 01:03:47.654921 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.654808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrtd5\" (UniqueName: \"kubernetes.io/projected/a7b097f5-1877-453c-bca3-68ea78e7f2a5-kube-api-access-mrtd5\") pod \"maas-api-6987d8886-ng82l\" (UID: \"a7b097f5-1877-453c-bca3-68ea78e7f2a5\") " pod="odh-ai-gateway-infra/maas-api-6987d8886-ng82l"
Jul 09 01:03:47.655380 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.655352    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7b097f5-1877-453c-bca3-68ea78e7f2a5-openshift-service-ca\") pod \"maas-api-6987d8886-ng82l\" (UID: \"a7b097f5-1877-453c-bca3-68ea78e7f2a5\") " pod="odh-ai-gateway-infra/maas-api-6987d8886-ng82l"
Jul 09 01:03:47.657146 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.657122    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7b097f5-1877-453c-bca3-68ea78e7f2a5-maas-api-tls\") pod \"maas-api-6987d8886-ng82l\" (UID: \"a7b097f5-1877-453c-bca3-68ea78e7f2a5\") " pod="odh-ai-gateway-infra/maas-api-6987d8886-ng82l"
Jul 09 01:03:47.662331 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.662309    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrtd5\" (UniqueName: \"kubernetes.io/projected/a7b097f5-1877-453c-bca3-68ea78e7f2a5-kube-api-access-mrtd5\") pod \"maas-api-6987d8886-ng82l\" (UID: \"a7b097f5-1877-453c-bca3-68ea78e7f2a5\") " pod="odh-ai-gateway-infra/maas-api-6987d8886-ng82l"
Jul 09 01:03:47.802716 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.802682    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6987d8886-ng82l"
Jul 09 01:03:47.952540 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.952504    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6987d8886-ng82l"]
Jul 09 01:03:47.953817 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:03:47.953790    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b097f5_1877_453c_bca3_68ea78e7f2a5.slice/crio-5b5f04af06009ace4c1e7c6778712f826d35e69c55675780e1bc8d4e6f8b0c1b WatchSource:0}: Error finding container 5b5f04af06009ace4c1e7c6778712f826d35e69c55675780e1bc8d4e6f8b0c1b: Status 404 returned error can't find the container with id 5b5f04af06009ace4c1e7c6778712f826d35e69c55675780e1bc8d4e6f8b0c1b
Jul 09 01:03:47.962499 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.962478    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-v9n8r"]
Jul 09 01:03:47.968689 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.968671    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-v9n8r"
Jul 09 01:03:47.971637 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.971613    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 01:03:47.971938 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.971896    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-zqwnq\""
Jul 09 01:03:47.974347 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.974322    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-v9n8r"]
Jul 09 01:03:47.986420 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.986395    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4cndj"]
Jul 09 01:03:47.991195 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.991169    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-4cndj"
Jul 09 01:03:47.996260 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:47.996237    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4cndj"]
Jul 09 01:03:48.060486 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:48.060396    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srg65\" (UniqueName: \"kubernetes.io/projected/fd0fe6a9-57d4-487d-8e17-54e43f645104-kube-api-access-srg65\") pod \"payload-pre-processing-7964457696-v9n8r\" (UID: \"fd0fe6a9-57d4-487d-8e17-54e43f645104\") " pod="openshift-ingress/payload-pre-processing-7964457696-v9n8r"
Jul 09 01:03:48.060486 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:48.060459    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndx2l\" (UniqueName: \"kubernetes.io/projected/e4b6f609-a070-4d4a-a699-e1815f71687e-kube-api-access-ndx2l\") pod \"payload-processing-58f86c7798-4cndj\" (UID: \"e4b6f609-a070-4d4a-a699-e1815f71687e\") " pod="openshift-ingress/payload-processing-58f86c7798-4cndj"
Jul 09 01:03:48.060665 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:48.060495    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4b6f609-a070-4d4a-a699-e1815f71687e-plugins-config-volume\") pod \"payload-processing-58f86c7798-4cndj\" (UID: \"e4b6f609-a070-4d4a-a699-e1815f71687e\") " pod="openshift-ingress/payload-processing-58f86c7798-4cndj"
Jul 09 01:03:48.060665 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:48.060562    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd0fe6a9-57d4-487d-8e17-54e43f645104-plugins-config-volume\") pod \"payload-pre-processing-7964457696-v9n8r\" (UID: \"fd0fe6a9-57d4-487d-8e17-54e43f645104\") " pod="openshift-ingress/payload-pre-processing-7964457696-v9n8r"
Jul 09 01:03:48.161641 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:48.161598    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srg65\" (UniqueName: \"kubernetes.io/projected/fd0fe6a9-57d4-487d-8e17-54e43f645104-kube-api-access-srg65\") pod \"payload-pre-processing-7964457696-v9n8r\" (UID: \"fd0fe6a9-57d4-487d-8e17-54e43f645104\") " pod="openshift-ingress/payload-pre-processing-7964457696-v9n8r"
Jul 09 01:03:48.161822 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:48.161662    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndx2l\" (UniqueName: \"kubernetes.io/projected/e4b6f609-a070-4d4a-a699-e1815f71687e-kube-api-access-ndx2l\") pod \"payload-processing-58f86c7798-4cndj\" (UID: \"e4b6f609-a070-4d4a-a699-e1815f71687e\") " pod="openshift-ingress/payload-processing-58f86c7798-4cndj"
Jul 09 01:03:48.161822 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:48.161697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4b6f609-a070-4d4a-a699-e1815f71687e-plugins-config-volume\") pod \"payload-processing-58f86c7798-4cndj\" (UID: \"e4b6f609-a070-4d4a-a699-e1815f71687e\") " pod="openshift-ingress/payload-processing-58f86c7798-4cndj"
Jul 09 01:03:48.161822 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:48.161745    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd0fe6a9-57d4-487d-8e17-54e43f645104-plugins-config-volume\") pod \"payload-pre-processing-7964457696-v9n8r\" (UID: \"fd0fe6a9-57d4-487d-8e17-54e43f645104\") " pod="openshift-ingress/payload-pre-processing-7964457696-v9n8r"
Jul 09 01:03:48.162524 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:48.162502    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4b6f609-a070-4d4a-a699-e1815f71687e-plugins-config-volume\") pod \"payload-processing-58f86c7798-4cndj\" (UID: \"e4b6f609-a070-4d4a-a699-e1815f71687e\") " pod="openshift-ingress/payload-processing-58f86c7798-4cndj"
Jul 09 01:03:48.162628 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:48.162572    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd0fe6a9-57d4-487d-8e17-54e43f645104-plugins-config-volume\") pod \"payload-pre-processing-7964457696-v9n8r\" (UID: \"fd0fe6a9-57d4-487d-8e17-54e43f645104\") " pod="openshift-ingress/payload-pre-processing-7964457696-v9n8r"
Jul 09 01:03:48.173340 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:48.173278    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srg65\" (UniqueName: \"kubernetes.io/projected/fd0fe6a9-57d4-487d-8e17-54e43f645104-kube-api-access-srg65\") pod \"payload-pre-processing-7964457696-v9n8r\" (UID: \"fd0fe6a9-57d4-487d-8e17-54e43f645104\") " pod="openshift-ingress/payload-pre-processing-7964457696-v9n8r"
Jul 09 01:03:48.173525 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:48.173339    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndx2l\" (UniqueName: \"kubernetes.io/projected/e4b6f609-a070-4d4a-a699-e1815f71687e-kube-api-access-ndx2l\") pod \"payload-processing-58f86c7798-4cndj\" (UID: \"e4b6f609-a070-4d4a-a699-e1815f71687e\") " pod="openshift-ingress/payload-processing-58f86c7798-4cndj"
Jul 09 01:03:48.281127 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:48.281086    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-v9n8r"
Jul 09 01:03:48.302728 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:48.302700    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-4cndj"
Jul 09 01:03:48.412999 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:48.412957    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6987d8886-ng82l" event={"ID":"a7b097f5-1877-453c-bca3-68ea78e7f2a5","Type":"ContainerStarted","Data":"5b5f04af06009ace4c1e7c6778712f826d35e69c55675780e1bc8d4e6f8b0c1b"}
Jul 09 01:03:48.464735 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:48.464408    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-v9n8r"]
Jul 09 01:03:48.467799 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:03:48.467771    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd0fe6a9_57d4_487d_8e17_54e43f645104.slice/crio-7617f4a33fdf42632713dac1ff2987a9df55ec4b3f3212c9ae600912cf7088a6 WatchSource:0}: Error finding container 7617f4a33fdf42632713dac1ff2987a9df55ec4b3f3212c9ae600912cf7088a6: Status 404 returned error can't find the container with id 7617f4a33fdf42632713dac1ff2987a9df55ec4b3f3212c9ae600912cf7088a6
Jul 09 01:03:48.479242 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:48.479200    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4cndj"]
Jul 09 01:03:48.481030 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:03:48.481007    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b6f609_a070_4d4a_a699_e1815f71687e.slice/crio-8b880c589acfb048750c2cf9b540b2e79eec1ac1cb7a5fbc8ea1a7746a429800 WatchSource:0}: Error finding container 8b880c589acfb048750c2cf9b540b2e79eec1ac1cb7a5fbc8ea1a7746a429800: Status 404 returned error can't find the container with id 8b880c589acfb048750c2cf9b540b2e79eec1ac1cb7a5fbc8ea1a7746a429800
Jul 09 01:03:49.434570 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:49.434529    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-v9n8r" event={"ID":"fd0fe6a9-57d4-487d-8e17-54e43f645104","Type":"ContainerStarted","Data":"7617f4a33fdf42632713dac1ff2987a9df55ec4b3f3212c9ae600912cf7088a6"}
Jul 09 01:03:49.436188 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:49.436159    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-4cndj" event={"ID":"e4b6f609-a070-4d4a-a699-e1815f71687e","Type":"ContainerStarted","Data":"8b880c589acfb048750c2cf9b540b2e79eec1ac1cb7a5fbc8ea1a7746a429800"}
Jul 09 01:03:51.475679 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:51.475643    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6987d8886-ng82l" event={"ID":"a7b097f5-1877-453c-bca3-68ea78e7f2a5","Type":"ContainerStarted","Data":"787fea96ed45ab3b96baf232b62d3e1d5118a3f8d406a4dee2998fef7280ca5d"}
Jul 09 01:03:51.476162 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:51.475707    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6987d8886-ng82l"
Jul 09 01:03:51.477162 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:51.477137    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-v9n8r" event={"ID":"fd0fe6a9-57d4-487d-8e17-54e43f645104","Type":"ContainerStarted","Data":"aa254d8b99985afc4f8d00cfb525190003e395d2185e5b2bd9ab345189b8be12"}
Jul 09 01:03:51.477275 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:51.477194    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-v9n8r"
Jul 09 01:03:51.478812 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:51.478788    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-4cndj" event={"ID":"e4b6f609-a070-4d4a-a699-e1815f71687e","Type":"ContainerStarted","Data":"07f41a2137d3fe5026e6e06577d3e7181ff2a6aaf29c920b052b402ab3093a45"}
Jul 09 01:03:51.478956 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:51.478910    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-4cndj"
Jul 09 01:03:51.491083 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:51.491026    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6987d8886-ng82l" podStartSLOduration=1.864650039 podStartE2EDuration="4.491006161s" totalImagesPullingTime="2.626356122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:03:51.490115268 +0000 UTC m=+516.553609983" watchObservedRunningTime="2026-07-09 01:03:51.491006161 +0000 UTC m=+516.554500869"
Jul 09 01:03:51.504542 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:51.504495    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-v9n8r" podStartSLOduration=2.390663579 podStartE2EDuration="4.504480246s" totalImagesPullingTime="2.113816667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:03:51.503079557 +0000 UTC m=+516.566574263" watchObservedRunningTime="2026-07-09 01:03:51.504480246 +0000 UTC m=+516.567974950"
Jul 09 01:03:51.516388 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:51.516333    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-4cndj" podStartSLOduration=2.417968868 podStartE2EDuration="4.516314461s" totalImagesPullingTime="2.098345593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:03:51.515924595 +0000 UTC m=+516.579419301" watchObservedRunningTime="2026-07-09 01:03:51.516314461 +0000 UTC m=+516.579809156"
Jul 09 01:03:55.517876 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:55.517659    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-5mpgg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:44566->10.133.0.47:15021: read: connection reset by peer" start-of-body=
Jul 09 01:03:55.517876 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:55.517724    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg" podUID="1ba4ae3c-07ab-4252-829f-56a0e07337ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:44566->10.133.0.47:15021: read: connection reset by peer"
Jul 09 01:03:56.509482 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:56.509448    2565 generic.go:356] "Generic (PLEG): container finished" podID="1ba4ae3c-07ab-4252-829f-56a0e07337ed" containerID="6401611cfe84e98f369bd3202a00398f07b189d71fb47da0a7e32bb939bdc88b" exitCode=0
Jul 09 01:03:56.509700 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:56.509523    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg" event={"ID":"1ba4ae3c-07ab-4252-829f-56a0e07337ed","Type":"ContainerDied","Data":"6401611cfe84e98f369bd3202a00398f07b189d71fb47da0a7e32bb939bdc88b"}
Jul 09 01:03:56.509926 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:56.509913    2565 scope.go:117] "RemoveContainer" containerID="6401611cfe84e98f369bd3202a00398f07b189d71fb47da0a7e32bb939bdc88b"
Jul 09 01:03:56.510887 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:56.510858    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 01:03:56.510951 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:56.510925    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 01:03:56.510991 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:56.510956    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 01:03:57.490249 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:57.490205    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6987d8886-ng82l"
Jul 09 01:03:57.517023 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:57.516981    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg" event={"ID":"1ba4ae3c-07ab-4252-829f-56a0e07337ed","Type":"ContainerStarted","Data":"66f4e3d9bd4fc19c8d4f72136f8c920293f3fcf9f395f42c763f01ba67703c19"}
Jul 09 01:03:58.449527 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:58.449486    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:03:58.449837 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:58.449807    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-5mpgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 09 01:03:58.449943 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:58.449873    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg" podUID="1ba4ae3c-07ab-4252-829f-56a0e07337ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 09 01:03:59.449803 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:59.449755    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-5mpgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 09 01:03:59.450341 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:03:59.449841    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg" podUID="1ba4ae3c-07ab-4252-829f-56a0e07337ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 09 01:04:00.450667 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:00.450625    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-5mpgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 09 01:04:00.451280 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:00.451243    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg" podUID="1ba4ae3c-07ab-4252-829f-56a0e07337ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 09 01:04:01.453593 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:01.453559    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:04:01.454025 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:01.453917    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:04:01.454744 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:01.454724    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5mpgg"
Jul 09 01:04:02.485999 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:02.485961    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-4cndj"
Jul 09 01:04:02.486448 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:02.486282    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-v9n8r"
Jul 09 01:04:09.039001 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.038907    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"]
Jul 09 01:04:09.042579 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.042554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.044916 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.044885    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 01:04:09.045653 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.045633    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zm9xt\""
Jul 09 01:04:09.045783 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.045659    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 01:04:09.045854 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.045841    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 09 01:04:09.053564 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.053541    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"]
Jul 09 01:04:09.171174 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.171136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95966409-5857-4ff0-beb8-b5a6c20d0ad9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.171373 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.171185    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95966409-5857-4ff0-beb8-b5a6c20d0ad9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.171373 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.171270    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b76q\" (UniqueName: \"kubernetes.io/projected/95966409-5857-4ff0-beb8-b5a6c20d0ad9-kube-api-access-6b76q\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.171373 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.171296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95966409-5857-4ff0-beb8-b5a6c20d0ad9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.171373 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.171326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95966409-5857-4ff0-beb8-b5a6c20d0ad9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.171373 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.171341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95966409-5857-4ff0-beb8-b5a6c20d0ad9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.271969 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.271934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b76q\" (UniqueName: \"kubernetes.io/projected/95966409-5857-4ff0-beb8-b5a6c20d0ad9-kube-api-access-6b76q\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.271969 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.271973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95966409-5857-4ff0-beb8-b5a6c20d0ad9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.272255 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.272002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95966409-5857-4ff0-beb8-b5a6c20d0ad9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.272255 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.272017    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95966409-5857-4ff0-beb8-b5a6c20d0ad9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.272255 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.272087    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95966409-5857-4ff0-beb8-b5a6c20d0ad9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.272255 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.272127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95966409-5857-4ff0-beb8-b5a6c20d0ad9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.272485 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.272460    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95966409-5857-4ff0-beb8-b5a6c20d0ad9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.272536 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.272492    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95966409-5857-4ff0-beb8-b5a6c20d0ad9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.272579 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.272549    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95966409-5857-4ff0-beb8-b5a6c20d0ad9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.274457 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.274423    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95966409-5857-4ff0-beb8-b5a6c20d0ad9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.274775 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.274752    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95966409-5857-4ff0-beb8-b5a6c20d0ad9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.279422 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.279397    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b76q\" (UniqueName: \"kubernetes.io/projected/95966409-5857-4ff0-beb8-b5a6c20d0ad9-kube-api-access-6b76q\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8\" (UID: \"95966409-5857-4ff0-beb8-b5a6c20d0ad9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.353457 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.353365    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:09.487668 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.487637    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"]
Jul 09 01:04:09.489037 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:04:09.488997    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95966409_5857_4ff0_beb8_b5a6c20d0ad9.slice/crio-765fd910516bc385a503b59926c8cc2f7181352f49690e7e46e3dfd39ec0c7e5 WatchSource:0}: Error finding container 765fd910516bc385a503b59926c8cc2f7181352f49690e7e46e3dfd39ec0c7e5: Status 404 returned error can't find the container with id 765fd910516bc385a503b59926c8cc2f7181352f49690e7e46e3dfd39ec0c7e5
Jul 09 01:04:09.591287 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:09.591248    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8" event={"ID":"95966409-5857-4ff0-beb8-b5a6c20d0ad9","Type":"ContainerStarted","Data":"765fd910516bc385a503b59926c8cc2f7181352f49690e7e46e3dfd39ec0c7e5"}
Jul 09 01:04:11.604794 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:11.604748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8" event={"ID":"95966409-5857-4ff0-beb8-b5a6c20d0ad9","Type":"ContainerStarted","Data":"c683f81ac4e6e7ae38821e25aaeae3bce3f6bcc5640857ce4b729b901f25138c"}
Jul 09 01:04:11.621413 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:11.621358    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8" podStartSLOduration=1.376571747 podStartE2EDuration="2.621341095s" totalImagesPullingTime="1.244769348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:04:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:04:11.619555884 +0000 UTC m=+536.683050593" watchObservedRunningTime="2026-07-09 01:04:11.621341095 +0000 UTC m=+536.684835818"
Jul 09 01:04:15.226060 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.226027    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"]
Jul 09 01:04:15.230810 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.230792    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.233172 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.233148    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 09 01:04:15.238069 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.238042    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"]
Jul 09 01:04:15.336759 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.336724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d43a308a-2b04-42bd-aa72-d6803711accf-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.336924 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.336769    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d43a308a-2b04-42bd-aa72-d6803711accf-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.336924 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.336800    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mwzs\" (UniqueName: \"kubernetes.io/projected/d43a308a-2b04-42bd-aa72-d6803711accf-kube-api-access-7mwzs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.336924 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.336837    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d43a308a-2b04-42bd-aa72-d6803711accf-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.336924 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.336902    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d43a308a-2b04-42bd-aa72-d6803711accf-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.337112 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.336959    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d43a308a-2b04-42bd-aa72-d6803711accf-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.437746 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.437699    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d43a308a-2b04-42bd-aa72-d6803711accf-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.438013 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.437763    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mwzs\" (UniqueName: \"kubernetes.io/projected/d43a308a-2b04-42bd-aa72-d6803711accf-kube-api-access-7mwzs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.438013 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.437801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d43a308a-2b04-42bd-aa72-d6803711accf-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.438013 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.437844    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d43a308a-2b04-42bd-aa72-d6803711accf-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.438013 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.437896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d43a308a-2b04-42bd-aa72-d6803711accf-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.438013 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.437946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d43a308a-2b04-42bd-aa72-d6803711accf-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.438321 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.438196    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d43a308a-2b04-42bd-aa72-d6803711accf-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.438321 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.438252    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d43a308a-2b04-42bd-aa72-d6803711accf-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.438480 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.438462    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d43a308a-2b04-42bd-aa72-d6803711accf-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.440281 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.440260    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 09 01:04:15.440381 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.440281    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d43a308a-2b04-42bd-aa72-d6803711accf-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.445332 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.445309    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mwzs\" (UniqueName: \"kubernetes.io/projected/d43a308a-2b04-42bd-aa72-d6803711accf-kube-api-access-7mwzs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.451249 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.451191    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d43a308a-2b04-42bd-aa72-d6803711accf-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bndz6\" (UID: \"d43a308a-2b04-42bd-aa72-d6803711accf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.542345 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.542307    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:15.684142 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:15.684117    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"]
Jul 09 01:04:15.685681 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:04:15.685655    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd43a308a_2b04_42bd_aa72_d6803711accf.slice/crio-7f1894021e47db2b5fe75fe3f87c4a4a765268be26c804d9705c862f573da386 WatchSource:0}: Error finding container 7f1894021e47db2b5fe75fe3f87c4a4a765268be26c804d9705c862f573da386: Status 404 returned error can't find the container with id 7f1894021e47db2b5fe75fe3f87c4a4a765268be26c804d9705c862f573da386
Jul 09 01:04:16.635058 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:16.635019    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6" event={"ID":"d43a308a-2b04-42bd-aa72-d6803711accf","Type":"ContainerStarted","Data":"bb48604fddd953b740e9d4b0a2fb1953d3b6020b38ee33169387cf3728a9d437"}
Jul 09 01:04:16.635465 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:16.635081    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6" event={"ID":"d43a308a-2b04-42bd-aa72-d6803711accf","Type":"ContainerStarted","Data":"7f1894021e47db2b5fe75fe3f87c4a4a765268be26c804d9705c862f573da386"}
Jul 09 01:04:16.658784 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:16.658719    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6" podStartSLOduration=1.440230512 podStartE2EDuration="1.658700973s" totalImagesPullingTime="218.470461ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:04:16.656153242 +0000 UTC m=+541.719647948" watchObservedRunningTime="2026-07-09 01:04:16.658700973 +0000 UTC m=+541.722195677"
Jul 09 01:04:19.353663 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:19.353619    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:19.354038 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:19.353703    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:19.366443 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:19.366416    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:19.664349 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:19.664252    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8"
Jul 09 01:04:25.543246 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:25.543190    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:25.543634 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:25.543279    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:25.555766 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:25.555745    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:25.697695 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:25.697651    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bndz6"
Jul 09 01:04:41.235904 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.235858    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"]
Jul 09 01:04:41.239675 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.239652    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.242074 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.242049    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 09 01:04:41.249946 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.249919    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"]
Jul 09 01:04:41.364263 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.364194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.364449 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.364338    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr554\" (UniqueName: \"kubernetes.io/projected/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-kube-api-access-rr554\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.364449 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.364381    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.364449 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.364438    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.364566 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.364513    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.364566 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.364559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.466058 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.466020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.466058 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.466061    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.466287 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.466112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr554\" (UniqueName: \"kubernetes.io/projected/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-kube-api-access-rr554\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.466287 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.466140    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.466287 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.466174    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.466287 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.466252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.466525 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.466495    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.466588 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.466529    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.466672 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.466643    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.468334 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.468313    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.468701 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.468684    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.474041 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.474006    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr554\" (UniqueName: \"kubernetes.io/projected/f839b6fe-31e2-46c7-9d8e-95d4115ff65c-kube-api-access-rr554\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7\" (UID: \"f839b6fe-31e2-46c7-9d8e-95d4115ff65c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.554586 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.554551    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:41.696042 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.696015    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"]
Jul 09 01:04:41.697751 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:04:41.697717    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf839b6fe_31e2_46c7_9d8e_95d4115ff65c.slice/crio-1903a25a5e1ecc9bc018252a952c43fbbf6e6ec49ea90e84ed09fed0e65edcf7 WatchSource:0}: Error finding container 1903a25a5e1ecc9bc018252a952c43fbbf6e6ec49ea90e84ed09fed0e65edcf7: Status 404 returned error can't find the container with id 1903a25a5e1ecc9bc018252a952c43fbbf6e6ec49ea90e84ed09fed0e65edcf7
Jul 09 01:04:41.781087 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:41.781051    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7" event={"ID":"f839b6fe-31e2-46c7-9d8e-95d4115ff65c","Type":"ContainerStarted","Data":"1903a25a5e1ecc9bc018252a952c43fbbf6e6ec49ea90e84ed09fed0e65edcf7"}
Jul 09 01:04:42.788399 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:42.788355    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7" event={"ID":"f839b6fe-31e2-46c7-9d8e-95d4115ff65c","Type":"ContainerStarted","Data":"610bb6a1949c7a449667a957ad7556952b043c3a5db9bed83f8d20c46b3cdf4f"}
Jul 09 01:04:42.807335 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:42.807273    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7" podStartSLOduration=1.608641899 podStartE2EDuration="1.807256972s" totalImagesPullingTime="198.615073ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:04:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:04:42.804376788 +0000 UTC m=+567.867871494" watchObservedRunningTime="2026-07-09 01:04:42.807256972 +0000 UTC m=+567.870751677"
Jul 09 01:04:51.555128 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:51.555094    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:51.555642 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:51.555162    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:51.567692 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:51.567666    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:51.851432 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:51.851344    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7"
Jul 09 01:04:55.330057 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.330027    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"]
Jul 09 01:04:55.335344 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.335322    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.337666 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.337634    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 09 01:04:55.341636 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.341613    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"]
Jul 09 01:04:55.502813 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.502764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef60c197-4ce5-4e02-8f27-c5a3d7505732-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.502988 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.502819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef60c197-4ce5-4e02-8f27-c5a3d7505732-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.502988 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.502919    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef60c197-4ce5-4e02-8f27-c5a3d7505732-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.502988 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.502955    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxn4s\" (UniqueName: \"kubernetes.io/projected/ef60c197-4ce5-4e02-8f27-c5a3d7505732-kube-api-access-cxn4s\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.503099 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.503055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef60c197-4ce5-4e02-8f27-c5a3d7505732-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.503136 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.503110    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef60c197-4ce5-4e02-8f27-c5a3d7505732-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.604267 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.604146    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef60c197-4ce5-4e02-8f27-c5a3d7505732-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.604267 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.604189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef60c197-4ce5-4e02-8f27-c5a3d7505732-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.604512 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.604274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef60c197-4ce5-4e02-8f27-c5a3d7505732-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.604512 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.604305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxn4s\" (UniqueName: \"kubernetes.io/projected/ef60c197-4ce5-4e02-8f27-c5a3d7505732-kube-api-access-cxn4s\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.604512 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.604369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef60c197-4ce5-4e02-8f27-c5a3d7505732-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.604512 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.604451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef60c197-4ce5-4e02-8f27-c5a3d7505732-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.604722 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.604630    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef60c197-4ce5-4e02-8f27-c5a3d7505732-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.604722 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.604678    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef60c197-4ce5-4e02-8f27-c5a3d7505732-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.604827 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.604809    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef60c197-4ce5-4e02-8f27-c5a3d7505732-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.606613 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.606592    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef60c197-4ce5-4e02-8f27-c5a3d7505732-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.606901 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.606882    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef60c197-4ce5-4e02-8f27-c5a3d7505732-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.612178 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.612152    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxn4s\" (UniqueName: \"kubernetes.io/projected/ef60c197-4ce5-4e02-8f27-c5a3d7505732-kube-api-access-cxn4s\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz\" (UID: \"ef60c197-4ce5-4e02-8f27-c5a3d7505732\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.646519 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.646485    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:04:55.791270 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.791239    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"]
Jul 09 01:04:55.792426 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:04:55.792402    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef60c197_4ce5_4e02_8f27_c5a3d7505732.slice/crio-3718946a4f5b853f29d5a25705765f9e007187573f00216438b055b4a471663e WatchSource:0}: Error finding container 3718946a4f5b853f29d5a25705765f9e007187573f00216438b055b4a471663e: Status 404 returned error can't find the container with id 3718946a4f5b853f29d5a25705765f9e007187573f00216438b055b4a471663e
Jul 09 01:04:55.866099 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:55.866009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz" event={"ID":"ef60c197-4ce5-4e02-8f27-c5a3d7505732","Type":"ContainerStarted","Data":"3718946a4f5b853f29d5a25705765f9e007187573f00216438b055b4a471663e"}
Jul 09 01:04:56.873225 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:56.873180    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz" event={"ID":"ef60c197-4ce5-4e02-8f27-c5a3d7505732","Type":"ContainerStarted","Data":"f2bf95e5177cfcf6a32aae19aa6b7d6d1b7b63e574c4823377fd41426053eef6"}
Jul 09 01:04:56.889349 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:04:56.889292    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz" podStartSLOduration=1.670991614 podStartE2EDuration="1.889273844s" totalImagesPullingTime="218.28223ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:04:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:04:56.888506338 +0000 UTC m=+581.952001044" watchObservedRunningTime="2026-07-09 01:04:56.889273844 +0000 UTC m=+581.952768549"
Jul 09 01:05:05.646934 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:05:05.646898    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:05:05.647361 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:05:05.646946    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:05:05.659857 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:05:05.659826    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:05:05.944286 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:05:05.944191    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz"
Jul 09 01:06:08.755435 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:08.755400    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c5f9f5fdd-5g645"]
Jul 09 01:06:08.760033 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:08.760009    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c5f9f5fdd-5g645"
Jul 09 01:06:08.769688 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:08.769661    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c5f9f5fdd-5g645"]
Jul 09 01:06:08.917974 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:08.917937    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxqbk\" (UniqueName: \"kubernetes.io/projected/34fc5a3a-4443-46d0-92c6-b430b885315f-kube-api-access-rxqbk\") pod \"authorino-7c5f9f5fdd-5g645\" (UID: \"34fc5a3a-4443-46d0-92c6-b430b885315f\") " pod="kuadrant-system/authorino-7c5f9f5fdd-5g645"
Jul 09 01:06:08.918145 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:08.917987    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/34fc5a3a-4443-46d0-92c6-b430b885315f-tls-cert\") pod \"authorino-7c5f9f5fdd-5g645\" (UID: \"34fc5a3a-4443-46d0-92c6-b430b885315f\") " pod="kuadrant-system/authorino-7c5f9f5fdd-5g645"
Jul 09 01:06:09.019083 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:09.018994    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxqbk\" (UniqueName: \"kubernetes.io/projected/34fc5a3a-4443-46d0-92c6-b430b885315f-kube-api-access-rxqbk\") pod \"authorino-7c5f9f5fdd-5g645\" (UID: \"34fc5a3a-4443-46d0-92c6-b430b885315f\") " pod="kuadrant-system/authorino-7c5f9f5fdd-5g645"
Jul 09 01:06:09.019083 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:09.019038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/34fc5a3a-4443-46d0-92c6-b430b885315f-tls-cert\") pod \"authorino-7c5f9f5fdd-5g645\" (UID: \"34fc5a3a-4443-46d0-92c6-b430b885315f\") " pod="kuadrant-system/authorino-7c5f9f5fdd-5g645"
Jul 09 01:06:09.021490 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:09.021458    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/34fc5a3a-4443-46d0-92c6-b430b885315f-tls-cert\") pod \"authorino-7c5f9f5fdd-5g645\" (UID: \"34fc5a3a-4443-46d0-92c6-b430b885315f\") " pod="kuadrant-system/authorino-7c5f9f5fdd-5g645"
Jul 09 01:06:09.027478 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:09.027453    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxqbk\" (UniqueName: \"kubernetes.io/projected/34fc5a3a-4443-46d0-92c6-b430b885315f-kube-api-access-rxqbk\") pod \"authorino-7c5f9f5fdd-5g645\" (UID: \"34fc5a3a-4443-46d0-92c6-b430b885315f\") " pod="kuadrant-system/authorino-7c5f9f5fdd-5g645"
Jul 09 01:06:09.070455 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:09.070417    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c5f9f5fdd-5g645"
Jul 09 01:06:09.208874 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:09.208850    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c5f9f5fdd-5g645"]
Jul 09 01:06:09.210863 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:06:09.210832    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34fc5a3a_4443_46d0_92c6_b430b885315f.slice/crio-401559f3ad46b27b151d65a6e20e08ba437e5fed491787deb1c31804cd0fcec2 WatchSource:0}: Error finding container 401559f3ad46b27b151d65a6e20e08ba437e5fed491787deb1c31804cd0fcec2: Status 404 returned error can't find the container with id 401559f3ad46b27b151d65a6e20e08ba437e5fed491787deb1c31804cd0fcec2
Jul 09 01:06:09.212141 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:09.212119    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 01:06:09.295475 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:09.295383    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c5f9f5fdd-5g645" event={"ID":"34fc5a3a-4443-46d0-92c6-b430b885315f","Type":"ContainerStarted","Data":"401559f3ad46b27b151d65a6e20e08ba437e5fed491787deb1c31804cd0fcec2"}
Jul 09 01:06:10.306292 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:10.306248    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c5f9f5fdd-5g645" event={"ID":"34fc5a3a-4443-46d0-92c6-b430b885315f","Type":"ContainerStarted","Data":"96891b46516833da4c11159b1335e51bbc8f63bf55c78603079252ef2a015e88"}
Jul 09 01:06:10.325922 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:10.325855    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c5f9f5fdd-5g645" podStartSLOduration=1.751669259 podStartE2EDuration="2.325832568s" totalImagesPullingTime="574.163309ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:06:10.32293522 +0000 UTC m=+655.386429927" watchObservedRunningTime="2026-07-09 01:06:10.325832568 +0000 UTC m=+655.389327274"
Jul 09 01:06:10.362056 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:10.361295    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-574c6cfb7c-kgwxj"]
Jul 09 01:06:10.362056 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:10.361522    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-574c6cfb7c-kgwxj" podUID="ff329696-e01c-46a6-af73-991dc6ff939a" containerName="authorino" containerID="cri-o://4f8350bac0cbc3742fcee289cb2b7151886856830d8d70bfe65f4361d4de370c" gracePeriod=30
Jul 09 01:06:10.648437 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:10.648413    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574c6cfb7c-kgwxj"
Jul 09 01:06:10.738254 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:10.738174    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff329696-e01c-46a6-af73-991dc6ff939a-tls-cert\") pod \"ff329696-e01c-46a6-af73-991dc6ff939a\" (UID: \"ff329696-e01c-46a6-af73-991dc6ff939a\") "
Jul 09 01:06:10.738254 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:10.738240    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ts5s\" (UniqueName: \"kubernetes.io/projected/ff329696-e01c-46a6-af73-991dc6ff939a-kube-api-access-5ts5s\") pod \"ff329696-e01c-46a6-af73-991dc6ff939a\" (UID: \"ff329696-e01c-46a6-af73-991dc6ff939a\") "
Jul 09 01:06:10.740903 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:10.740857    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff329696-e01c-46a6-af73-991dc6ff939a-kube-api-access-5ts5s" (OuterVolumeSpecName: "kube-api-access-5ts5s") pod "ff329696-e01c-46a6-af73-991dc6ff939a" (UID: "ff329696-e01c-46a6-af73-991dc6ff939a"). InnerVolumeSpecName "kube-api-access-5ts5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:06:10.751135 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:10.751104    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff329696-e01c-46a6-af73-991dc6ff939a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ff329696-e01c-46a6-af73-991dc6ff939a" (UID: "ff329696-e01c-46a6-af73-991dc6ff939a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:06:10.840000 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:10.839929    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff329696-e01c-46a6-af73-991dc6ff939a-tls-cert\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:06:10.840000 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:10.839971    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ts5s\" (UniqueName: \"kubernetes.io/projected/ff329696-e01c-46a6-af73-991dc6ff939a-kube-api-access-5ts5s\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:06:11.316997 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:11.316892    2565 generic.go:356] "Generic (PLEG): container finished" podID="ff329696-e01c-46a6-af73-991dc6ff939a" containerID="4f8350bac0cbc3742fcee289cb2b7151886856830d8d70bfe65f4361d4de370c" exitCode=0
Jul 09 01:06:11.317639 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:11.317619    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574c6cfb7c-kgwxj"
Jul 09 01:06:11.326324 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:11.326286    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574c6cfb7c-kgwxj" event={"ID":"ff329696-e01c-46a6-af73-991dc6ff939a","Type":"ContainerDied","Data":"4f8350bac0cbc3742fcee289cb2b7151886856830d8d70bfe65f4361d4de370c"}
Jul 09 01:06:11.326505 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:11.326342    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574c6cfb7c-kgwxj" event={"ID":"ff329696-e01c-46a6-af73-991dc6ff939a","Type":"ContainerDied","Data":"463e8dd3809926fd5b78d58df88457f75ba4974ba2d0cc3d956af954b40d8d2c"}
Jul 09 01:06:11.326505 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:11.326365    2565 scope.go:117] "RemoveContainer" containerID="4f8350bac0cbc3742fcee289cb2b7151886856830d8d70bfe65f4361d4de370c"
Jul 09 01:06:11.343929 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:11.343372    2565 scope.go:117] "RemoveContainer" containerID="4f8350bac0cbc3742fcee289cb2b7151886856830d8d70bfe65f4361d4de370c"
Jul 09 01:06:11.344060 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:06:11.343996    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f8350bac0cbc3742fcee289cb2b7151886856830d8d70bfe65f4361d4de370c\": container with ID starting with 4f8350bac0cbc3742fcee289cb2b7151886856830d8d70bfe65f4361d4de370c not found: ID does not exist" containerID="4f8350bac0cbc3742fcee289cb2b7151886856830d8d70bfe65f4361d4de370c"
Jul 09 01:06:11.344136 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:11.344074    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f8350bac0cbc3742fcee289cb2b7151886856830d8d70bfe65f4361d4de370c"} err="failed to get container status \"4f8350bac0cbc3742fcee289cb2b7151886856830d8d70bfe65f4361d4de370c\": rpc error: code = NotFound desc = could not find container \"4f8350bac0cbc3742fcee289cb2b7151886856830d8d70bfe65f4361d4de370c\": container with ID starting with 4f8350bac0cbc3742fcee289cb2b7151886856830d8d70bfe65f4361d4de370c not found: ID does not exist"
Jul 09 01:06:11.356073 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:11.356042    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-574c6cfb7c-kgwxj"]
Jul 09 01:06:11.363439 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:11.363402    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-574c6cfb7c-kgwxj"]
Jul 09 01:06:11.506535 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:06:11.506501    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff329696-e01c-46a6-af73-991dc6ff939a" path="/var/lib/kubelet/pods/ff329696-e01c-46a6-af73-991dc6ff939a/volumes"
Jul 09 01:07:23.171755 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.171717    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c89db8b46-2znnt"]
Jul 09 01:07:23.172310 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.171922    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5c89db8b46-2znnt" podUID="5e0c3a60-93ae-4753-9113-2c799faa5f46" containerName="manager" containerID="cri-o://85137272c5883768c6c037bc7d9ca879719433dc531bcae9a1696007f2ce3d52" gracePeriod=30
Jul 09 01:07:23.428298 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.428225    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c89db8b46-2znnt"
Jul 09 01:07:23.563667 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.563627    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e0c3a60-93ae-4753-9113-2c799faa5f46-webhook-cert\") pod \"5e0c3a60-93ae-4753-9113-2c799faa5f46\" (UID: \"5e0c3a60-93ae-4753-9113-2c799faa5f46\") "
Jul 09 01:07:23.563864 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.563757    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thgnp\" (UniqueName: \"kubernetes.io/projected/5e0c3a60-93ae-4753-9113-2c799faa5f46-kube-api-access-thgnp\") pod \"5e0c3a60-93ae-4753-9113-2c799faa5f46\" (UID: \"5e0c3a60-93ae-4753-9113-2c799faa5f46\") "
Jul 09 01:07:23.565793 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.565767    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e0c3a60-93ae-4753-9113-2c799faa5f46-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5e0c3a60-93ae-4753-9113-2c799faa5f46" (UID: "5e0c3a60-93ae-4753-9113-2c799faa5f46"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:07:23.565923 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.565899    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e0c3a60-93ae-4753-9113-2c799faa5f46-kube-api-access-thgnp" (OuterVolumeSpecName: "kube-api-access-thgnp") pod "5e0c3a60-93ae-4753-9113-2c799faa5f46" (UID: "5e0c3a60-93ae-4753-9113-2c799faa5f46"). InnerVolumeSpecName "kube-api-access-thgnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:07:23.664821 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.664784    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e0c3a60-93ae-4753-9113-2c799faa5f46-webhook-cert\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:07:23.664821 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.664814    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thgnp\" (UniqueName: \"kubernetes.io/projected/5e0c3a60-93ae-4753-9113-2c799faa5f46-kube-api-access-thgnp\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:07:23.742649 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.742603    2565 generic.go:356] "Generic (PLEG): container finished" podID="5e0c3a60-93ae-4753-9113-2c799faa5f46" containerID="85137272c5883768c6c037bc7d9ca879719433dc531bcae9a1696007f2ce3d52" exitCode=0
Jul 09 01:07:23.742649 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.742646    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c89db8b46-2znnt"
Jul 09 01:07:23.742865 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.742697    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c89db8b46-2znnt" event={"ID":"5e0c3a60-93ae-4753-9113-2c799faa5f46","Type":"ContainerDied","Data":"85137272c5883768c6c037bc7d9ca879719433dc531bcae9a1696007f2ce3d52"}
Jul 09 01:07:23.742865 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.742760    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c89db8b46-2znnt" event={"ID":"5e0c3a60-93ae-4753-9113-2c799faa5f46","Type":"ContainerDied","Data":"0da684e503e6acbcc4eb6aa02c6a423d21818ba5bc77eadcf245b83933b5b622"}
Jul 09 01:07:23.742865 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.742789    2565 scope.go:117] "RemoveContainer" containerID="85137272c5883768c6c037bc7d9ca879719433dc531bcae9a1696007f2ce3d52"
Jul 09 01:07:23.752746 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.752727    2565 scope.go:117] "RemoveContainer" containerID="85137272c5883768c6c037bc7d9ca879719433dc531bcae9a1696007f2ce3d52"
Jul 09 01:07:23.753016 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:07:23.752999    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85137272c5883768c6c037bc7d9ca879719433dc531bcae9a1696007f2ce3d52\": container with ID starting with 85137272c5883768c6c037bc7d9ca879719433dc531bcae9a1696007f2ce3d52 not found: ID does not exist" containerID="85137272c5883768c6c037bc7d9ca879719433dc531bcae9a1696007f2ce3d52"
Jul 09 01:07:23.753063 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.753024    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85137272c5883768c6c037bc7d9ca879719433dc531bcae9a1696007f2ce3d52"} err="failed to get container status \"85137272c5883768c6c037bc7d9ca879719433dc531bcae9a1696007f2ce3d52\": rpc error: code = NotFound desc = could not find container \"85137272c5883768c6c037bc7d9ca879719433dc531bcae9a1696007f2ce3d52\": container with ID starting with 85137272c5883768c6c037bc7d9ca879719433dc531bcae9a1696007f2ce3d52 not found: ID does not exist"
Jul 09 01:07:23.764163 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.764140    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c89db8b46-2znnt"]
Jul 09 01:07:23.769916 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:23.769890    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c89db8b46-2znnt"]
Jul 09 01:07:24.524533 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.524495    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c89db8b46-scgq7"]
Jul 09 01:07:24.524988 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.524973    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff329696-e01c-46a6-af73-991dc6ff939a" containerName="authorino"
Jul 09 01:07:24.525040 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.524990    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff329696-e01c-46a6-af73-991dc6ff939a" containerName="authorino"
Jul 09 01:07:24.525040 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.525001    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e0c3a60-93ae-4753-9113-2c799faa5f46" containerName="manager"
Jul 09 01:07:24.525040 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.525007    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e0c3a60-93ae-4753-9113-2c799faa5f46" containerName="manager"
Jul 09 01:07:24.525132 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.525068    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e0c3a60-93ae-4753-9113-2c799faa5f46" containerName="manager"
Jul 09 01:07:24.525132 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.525075    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff329696-e01c-46a6-af73-991dc6ff939a" containerName="authorino"
Jul 09 01:07:24.529390 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.529372    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c89db8b46-scgq7"
Jul 09 01:07:24.532693 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.532669    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z9pb7\""
Jul 09 01:07:24.532693 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.532685    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 01:07:24.532870 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.532787    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 01:07:24.539201 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.539178    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c89db8b46-scgq7"]
Jul 09 01:07:24.673781 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.673748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/014b31d7-7f20-4a5e-86d6-65ecb380a2d8-webhook-cert\") pod \"maas-controller-5c89db8b46-scgq7\" (UID: \"014b31d7-7f20-4a5e-86d6-65ecb380a2d8\") " pod="opendatahub/maas-controller-5c89db8b46-scgq7"
Jul 09 01:07:24.673956 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.673804    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzzm7\" (UniqueName: \"kubernetes.io/projected/014b31d7-7f20-4a5e-86d6-65ecb380a2d8-kube-api-access-qzzm7\") pod \"maas-controller-5c89db8b46-scgq7\" (UID: \"014b31d7-7f20-4a5e-86d6-65ecb380a2d8\") " pod="opendatahub/maas-controller-5c89db8b46-scgq7"
Jul 09 01:07:24.774750 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.774664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/014b31d7-7f20-4a5e-86d6-65ecb380a2d8-webhook-cert\") pod \"maas-controller-5c89db8b46-scgq7\" (UID: \"014b31d7-7f20-4a5e-86d6-65ecb380a2d8\") " pod="opendatahub/maas-controller-5c89db8b46-scgq7"
Jul 09 01:07:24.774750 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.774728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzzm7\" (UniqueName: \"kubernetes.io/projected/014b31d7-7f20-4a5e-86d6-65ecb380a2d8-kube-api-access-qzzm7\") pod \"maas-controller-5c89db8b46-scgq7\" (UID: \"014b31d7-7f20-4a5e-86d6-65ecb380a2d8\") " pod="opendatahub/maas-controller-5c89db8b46-scgq7"
Jul 09 01:07:24.777059 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.777038    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/014b31d7-7f20-4a5e-86d6-65ecb380a2d8-webhook-cert\") pod \"maas-controller-5c89db8b46-scgq7\" (UID: \"014b31d7-7f20-4a5e-86d6-65ecb380a2d8\") " pod="opendatahub/maas-controller-5c89db8b46-scgq7"
Jul 09 01:07:24.781989 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.781966    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzzm7\" (UniqueName: \"kubernetes.io/projected/014b31d7-7f20-4a5e-86d6-65ecb380a2d8-kube-api-access-qzzm7\") pod \"maas-controller-5c89db8b46-scgq7\" (UID: \"014b31d7-7f20-4a5e-86d6-65ecb380a2d8\") " pod="opendatahub/maas-controller-5c89db8b46-scgq7"
Jul 09 01:07:24.841965 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.841929    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c89db8b46-scgq7"
Jul 09 01:07:24.980711 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:24.980686    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c89db8b46-scgq7"]
Jul 09 01:07:24.982427 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:07:24.982402    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod014b31d7_7f20_4a5e_86d6_65ecb380a2d8.slice/crio-fc3220aa43e80ddfa142356abf355c0fa7868b5e316ec63ead8d836d23f648eb WatchSource:0}: Error finding container fc3220aa43e80ddfa142356abf355c0fa7868b5e316ec63ead8d836d23f648eb: Status 404 returned error can't find the container with id fc3220aa43e80ddfa142356abf355c0fa7868b5e316ec63ead8d836d23f648eb
Jul 09 01:07:25.506915 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:25.506880    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e0c3a60-93ae-4753-9113-2c799faa5f46" path="/var/lib/kubelet/pods/5e0c3a60-93ae-4753-9113-2c799faa5f46/volumes"
Jul 09 01:07:25.755477 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:25.755438    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c89db8b46-scgq7" event={"ID":"014b31d7-7f20-4a5e-86d6-65ecb380a2d8","Type":"ContainerStarted","Data":"fc3220aa43e80ddfa142356abf355c0fa7868b5e316ec63ead8d836d23f648eb"}
Jul 09 01:07:26.762716 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:26.762669    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c89db8b46-scgq7" event={"ID":"014b31d7-7f20-4a5e-86d6-65ecb380a2d8","Type":"ContainerStarted","Data":"7261c3429d7a3eb3bfa11256213684373c8a0821a099534d9cee3f3353053353"}
Jul 09 01:07:26.763147 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:26.762898    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c89db8b46-scgq7"
Jul 09 01:07:26.781066 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:26.781013    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c89db8b46-scgq7" podStartSLOduration=2.021966132 podStartE2EDuration="2.780999432s" totalImagesPullingTime="759.0333ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:07:26.778190754 +0000 UTC m=+731.841685459" watchObservedRunningTime="2026-07-09 01:07:26.780999432 +0000 UTC m=+731.844494210"
Jul 09 01:07:37.776756 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:07:37.776727    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c89db8b46-scgq7"
Jul 09 01:12:17.248748 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:12:17.248708    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"]
Jul 09 01:12:17.249716 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:12:17.249662    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w" podUID="183d646d-d621-43d9-b98a-4500757a97dd" containerName="manager" containerID="cri-o://ad8878ea559fb149e405d02e3f91e66107111326f08c9df3b79bc55f35d5f60b" gracePeriod=10
Jul 09 01:12:20.519371 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:12:20.519340    2565 generic.go:356] "Generic (PLEG): container finished" podID="183d646d-d621-43d9-b98a-4500757a97dd" containerID="ad8878ea559fb149e405d02e3f91e66107111326f08c9df3b79bc55f35d5f60b" exitCode=0
Jul 09 01:12:20.519686 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:12:20.519417    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w" event={"ID":"183d646d-d621-43d9-b98a-4500757a97dd","Type":"ContainerDied","Data":"ad8878ea559fb149e405d02e3f91e66107111326f08c9df3b79bc55f35d5f60b"}
Jul 09 01:12:20.519686 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:12:20.519465    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w" event={"ID":"183d646d-d621-43d9-b98a-4500757a97dd","Type":"ContainerDied","Data":"9ec416f1ab0f2c26f1bf382065e7dbaab774b437de4fabb4a41bb299d38c4e67"}
Jul 09 01:12:20.519686 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:12:20.519483    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ec416f1ab0f2c26f1bf382065e7dbaab774b437de4fabb4a41bb299d38c4e67"
Jul 09 01:12:20.520151 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:12:20.520133    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"
Jul 09 01:12:20.617670 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:12:20.617573    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9jt5\" (UniqueName: \"kubernetes.io/projected/183d646d-d621-43d9-b98a-4500757a97dd-kube-api-access-w9jt5\") pod \"183d646d-d621-43d9-b98a-4500757a97dd\" (UID: \"183d646d-d621-43d9-b98a-4500757a97dd\") "
Jul 09 01:12:20.617844 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:12:20.617708    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/183d646d-d621-43d9-b98a-4500757a97dd-extensions-socket-volume\") pod \"183d646d-d621-43d9-b98a-4500757a97dd\" (UID: \"183d646d-d621-43d9-b98a-4500757a97dd\") "
Jul 09 01:12:20.618062 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:12:20.618040    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/183d646d-d621-43d9-b98a-4500757a97dd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "183d646d-d621-43d9-b98a-4500757a97dd" (UID: "183d646d-d621-43d9-b98a-4500757a97dd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:12:20.619698 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:12:20.619673    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/183d646d-d621-43d9-b98a-4500757a97dd-kube-api-access-w9jt5" (OuterVolumeSpecName: "kube-api-access-w9jt5") pod "183d646d-d621-43d9-b98a-4500757a97dd" (UID: "183d646d-d621-43d9-b98a-4500757a97dd"). InnerVolumeSpecName "kube-api-access-w9jt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:12:20.719038 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:12:20.719001    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/183d646d-d621-43d9-b98a-4500757a97dd-extensions-socket-volume\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:12:20.719038 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:12:20.719030    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9jt5\" (UniqueName: \"kubernetes.io/projected/183d646d-d621-43d9-b98a-4500757a97dd-kube-api-access-w9jt5\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:12:21.525750 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:12:21.525721    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"
Jul 09 01:12:21.543757 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:12:21.543729    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"]
Jul 09 01:12:21.547463 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:12:21.547439    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2sf2w"]
Jul 09 01:12:23.507065 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:12:23.507028    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="183d646d-d621-43d9-b98a-4500757a97dd" path="/var/lib/kubelet/pods/183d646d-d621-43d9-b98a-4500757a97dd/volumes"
Jul 09 01:13:15.565295 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:15.565264    2565 scope.go:117] "RemoveContainer" containerID="ad8878ea559fb149e405d02e3f91e66107111326f08c9df3b79bc55f35d5f60b"
Jul 09 01:13:18.431748 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:18.431709    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-478m9"]
Jul 09 01:13:18.432159 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:18.432146    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="183d646d-d621-43d9-b98a-4500757a97dd" containerName="manager"
Jul 09 01:13:18.432159 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:18.432160    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="183d646d-d621-43d9-b98a-4500757a97dd" containerName="manager"
Jul 09 01:13:18.432262 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:18.432239    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="183d646d-d621-43d9-b98a-4500757a97dd" containerName="manager"
Jul 09 01:13:18.436839 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:18.436822    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-478m9"
Jul 09 01:13:18.439146 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:18.439125    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2q8vw\""
Jul 09 01:13:18.447979 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:18.447957    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-478m9"]
Jul 09 01:13:18.480227 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:18.480176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd8rd\" (UniqueName: \"kubernetes.io/projected/acfa1386-aec0-4f59-8e98-db8c25c69e44-kube-api-access-pd8rd\") pod \"kuadrant-operator-controller-manager-86878c769f-478m9\" (UID: \"acfa1386-aec0-4f59-8e98-db8c25c69e44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-478m9"
Jul 09 01:13:18.480404 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:18.480259    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acfa1386-aec0-4f59-8e98-db8c25c69e44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-478m9\" (UID: \"acfa1386-aec0-4f59-8e98-db8c25c69e44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-478m9"
Jul 09 01:13:18.581628 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:18.581588    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd8rd\" (UniqueName: \"kubernetes.io/projected/acfa1386-aec0-4f59-8e98-db8c25c69e44-kube-api-access-pd8rd\") pod \"kuadrant-operator-controller-manager-86878c769f-478m9\" (UID: \"acfa1386-aec0-4f59-8e98-db8c25c69e44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-478m9"
Jul 09 01:13:18.581813 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:18.581657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acfa1386-aec0-4f59-8e98-db8c25c69e44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-478m9\" (UID: \"acfa1386-aec0-4f59-8e98-db8c25c69e44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-478m9"
Jul 09 01:13:18.582083 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:18.582062    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acfa1386-aec0-4f59-8e98-db8c25c69e44-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-478m9\" (UID: \"acfa1386-aec0-4f59-8e98-db8c25c69e44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-478m9"
Jul 09 01:13:18.590505 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:18.590476    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd8rd\" (UniqueName: \"kubernetes.io/projected/acfa1386-aec0-4f59-8e98-db8c25c69e44-kube-api-access-pd8rd\") pod \"kuadrant-operator-controller-manager-86878c769f-478m9\" (UID: \"acfa1386-aec0-4f59-8e98-db8c25c69e44\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-478m9"
Jul 09 01:13:18.748116 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:18.748077    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-478m9"
Jul 09 01:13:18.894796 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:18.894770    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-478m9"]
Jul 09 01:13:18.896385 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:13:18.896350    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacfa1386_aec0_4f59_8e98_db8c25c69e44.slice/crio-92fa55ec5d2b908c51d7c83d9418a6f9721f9d4034c5312915928fce3061ae46 WatchSource:0}: Error finding container 92fa55ec5d2b908c51d7c83d9418a6f9721f9d4034c5312915928fce3061ae46: Status 404 returned error can't find the container with id 92fa55ec5d2b908c51d7c83d9418a6f9721f9d4034c5312915928fce3061ae46
Jul 09 01:13:19.862623 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:19.862587    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-478m9" event={"ID":"acfa1386-aec0-4f59-8e98-db8c25c69e44","Type":"ContainerStarted","Data":"8222127be81a20872007f56c56238ec545bf293fe5bd836fd54d595ca0e9c5df"}
Jul 09 01:13:19.862997 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:19.862649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-478m9" event={"ID":"acfa1386-aec0-4f59-8e98-db8c25c69e44","Type":"ContainerStarted","Data":"92fa55ec5d2b908c51d7c83d9418a6f9721f9d4034c5312915928fce3061ae46"}
Jul 09 01:13:19.862997 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:19.862726    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-478m9"
Jul 09 01:13:19.881887 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:19.881837    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-478m9" podStartSLOduration=1.881818969 podStartE2EDuration="1.881818969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:13:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:13:19.879106178 +0000 UTC m=+1084.942600918" watchObservedRunningTime="2026-07-09 01:13:19.881818969 +0000 UTC m=+1084.945313675"
Jul 09 01:13:30.870586 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:13:30.870552    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-478m9"
Jul 09 01:19:53.398472 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:53.398371    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"]
Jul 09 01:19:53.402348 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:53.402329    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"
Jul 09 01:19:53.404850 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:53.404829    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e6bc8ba4-serving-cert\""
Jul 09 01:19:53.413331 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:53.413304    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"]
Jul 09 01:19:53.484568 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:53.484534    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb94f273-858b-4b57-bf06-535f54830696-maas-api-tls\") pod \"maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g\" (UID: \"cb94f273-858b-4b57-bf06-535f54830696\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"
Jul 09 01:19:53.484844 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:53.484592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb94f273-858b-4b57-bf06-535f54830696-openshift-service-ca\") pod \"maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g\" (UID: \"cb94f273-858b-4b57-bf06-535f54830696\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"
Jul 09 01:19:53.484844 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:53.484742    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv7v5\" (UniqueName: \"kubernetes.io/projected/cb94f273-858b-4b57-bf06-535f54830696-kube-api-access-rv7v5\") pod \"maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g\" (UID: \"cb94f273-858b-4b57-bf06-535f54830696\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"
Jul 09 01:19:53.585491 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:53.585452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb94f273-858b-4b57-bf06-535f54830696-maas-api-tls\") pod \"maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g\" (UID: \"cb94f273-858b-4b57-bf06-535f54830696\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"
Jul 09 01:19:53.585693 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:53.585548    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb94f273-858b-4b57-bf06-535f54830696-openshift-service-ca\") pod \"maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g\" (UID: \"cb94f273-858b-4b57-bf06-535f54830696\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"
Jul 09 01:19:53.585693 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:19:53.585600    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-serving-cert: secret "maas-api-e2e-ait-e6bc8ba4-serving-cert" not found
Jul 09 01:19:53.585693 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:53.585643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv7v5\" (UniqueName: \"kubernetes.io/projected/cb94f273-858b-4b57-bf06-535f54830696-kube-api-access-rv7v5\") pod \"maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g\" (UID: \"cb94f273-858b-4b57-bf06-535f54830696\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"
Jul 09 01:19:53.585693 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:19:53.585681    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb94f273-858b-4b57-bf06-535f54830696-maas-api-tls podName:cb94f273-858b-4b57-bf06-535f54830696 nodeName:}" failed. No retries permitted until 2026-07-09 01:19:54.085663543 +0000 UTC m=+1479.149158225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cb94f273-858b-4b57-bf06-535f54830696-maas-api-tls") pod "maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g" (UID: "cb94f273-858b-4b57-bf06-535f54830696") : secret "maas-api-e2e-ait-e6bc8ba4-serving-cert" not found
Jul 09 01:19:53.586357 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:53.586335    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb94f273-858b-4b57-bf06-535f54830696-openshift-service-ca\") pod \"maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g\" (UID: \"cb94f273-858b-4b57-bf06-535f54830696\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"
Jul 09 01:19:53.595148 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:53.595126    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv7v5\" (UniqueName: \"kubernetes.io/projected/cb94f273-858b-4b57-bf06-535f54830696-kube-api-access-rv7v5\") pod \"maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g\" (UID: \"cb94f273-858b-4b57-bf06-535f54830696\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"
Jul 09 01:19:54.091753 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:54.091718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb94f273-858b-4b57-bf06-535f54830696-maas-api-tls\") pod \"maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g\" (UID: \"cb94f273-858b-4b57-bf06-535f54830696\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"
Jul 09 01:19:54.094255 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:54.094228    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb94f273-858b-4b57-bf06-535f54830696-maas-api-tls\") pod \"maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g\" (UID: \"cb94f273-858b-4b57-bf06-535f54830696\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"
Jul 09 01:19:54.314320 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:54.314274    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"
Jul 09 01:19:54.464481 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:54.464450    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"]
Jul 09 01:19:54.465591 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:19:54.465563    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb94f273_858b_4b57_bf06_535f54830696.slice/crio-36ba341de77b41e627794c6f3c910f1d1849eb22606715d513be3ea0ab5f7c0e WatchSource:0}: Error finding container 36ba341de77b41e627794c6f3c910f1d1849eb22606715d513be3ea0ab5f7c0e: Status 404 returned error can't find the container with id 36ba341de77b41e627794c6f3c910f1d1849eb22606715d513be3ea0ab5f7c0e
Jul 09 01:19:54.466945 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:54.466921    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 01:19:55.228949 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:55.228850    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g" event={"ID":"cb94f273-858b-4b57-bf06-535f54830696","Type":"ContainerStarted","Data":"6937cfc959551a0dc0dccc65c21ab12550c0ad0d152fa990a237990d45bbc1e4"}
Jul 09 01:19:55.228949 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:55.228918    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g" event={"ID":"cb94f273-858b-4b57-bf06-535f54830696","Type":"ContainerStarted","Data":"36ba341de77b41e627794c6f3c910f1d1849eb22606715d513be3ea0ab5f7c0e"}
Jul 09 01:19:55.229156 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:55.228969    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"
Jul 09 01:19:55.244434 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:55.244379    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g" podStartSLOduration=1.965878979 podStartE2EDuration="2.244364684s" totalImagesPullingTime="278.485705ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:19:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:19:55.243760463 +0000 UTC m=+1480.307255184" watchObservedRunningTime="2026-07-09 01:19:55.244364684 +0000 UTC m=+1480.307859389"
Jul 09 01:19:58.643394 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:58.643346    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"]
Jul 09 01:19:58.643903 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:58.643624    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g" podUID="cb94f273-858b-4b57-bf06-535f54830696" containerName="maas-api" containerID="cri-o://6937cfc959551a0dc0dccc65c21ab12550c0ad0d152fa990a237990d45bbc1e4" gracePeriod=30
Jul 09 01:19:58.895457 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:58.895397    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"
Jul 09 01:19:59.045181 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.045141    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb94f273-858b-4b57-bf06-535f54830696-maas-api-tls\") pod \"cb94f273-858b-4b57-bf06-535f54830696\" (UID: \"cb94f273-858b-4b57-bf06-535f54830696\") "
Jul 09 01:19:59.045403 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.045257    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv7v5\" (UniqueName: \"kubernetes.io/projected/cb94f273-858b-4b57-bf06-535f54830696-kube-api-access-rv7v5\") pod \"cb94f273-858b-4b57-bf06-535f54830696\" (UID: \"cb94f273-858b-4b57-bf06-535f54830696\") "
Jul 09 01:19:59.045403 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.045288    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb94f273-858b-4b57-bf06-535f54830696-openshift-service-ca\") pod \"cb94f273-858b-4b57-bf06-535f54830696\" (UID: \"cb94f273-858b-4b57-bf06-535f54830696\") "
Jul 09 01:19:59.045729 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.045707    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb94f273-858b-4b57-bf06-535f54830696-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cb94f273-858b-4b57-bf06-535f54830696" (UID: "cb94f273-858b-4b57-bf06-535f54830696"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 01:19:59.047442 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.047408    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb94f273-858b-4b57-bf06-535f54830696-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cb94f273-858b-4b57-bf06-535f54830696" (UID: "cb94f273-858b-4b57-bf06-535f54830696"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:19:59.047549 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.047515    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb94f273-858b-4b57-bf06-535f54830696-kube-api-access-rv7v5" (OuterVolumeSpecName: "kube-api-access-rv7v5") pod "cb94f273-858b-4b57-bf06-535f54830696" (UID: "cb94f273-858b-4b57-bf06-535f54830696"). InnerVolumeSpecName "kube-api-access-rv7v5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:19:59.146826 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.146730    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb94f273-858b-4b57-bf06-535f54830696-maas-api-tls\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:19:59.146826 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.146761    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv7v5\" (UniqueName: \"kubernetes.io/projected/cb94f273-858b-4b57-bf06-535f54830696-kube-api-access-rv7v5\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:19:59.146826 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.146770    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb94f273-858b-4b57-bf06-535f54830696-openshift-service-ca\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:19:59.253706 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.253668    2565 generic.go:356] "Generic (PLEG): container finished" podID="cb94f273-858b-4b57-bf06-535f54830696" containerID="6937cfc959551a0dc0dccc65c21ab12550c0ad0d152fa990a237990d45bbc1e4" exitCode=0
Jul 09 01:19:59.253706 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.253708    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"
Jul 09 01:19:59.253967 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.253751    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g" event={"ID":"cb94f273-858b-4b57-bf06-535f54830696","Type":"ContainerDied","Data":"6937cfc959551a0dc0dccc65c21ab12550c0ad0d152fa990a237990d45bbc1e4"}
Jul 09 01:19:59.253967 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.253808    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g" event={"ID":"cb94f273-858b-4b57-bf06-535f54830696","Type":"ContainerDied","Data":"36ba341de77b41e627794c6f3c910f1d1849eb22606715d513be3ea0ab5f7c0e"}
Jul 09 01:19:59.253967 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.253837    2565 scope.go:117] "RemoveContainer" containerID="6937cfc959551a0dc0dccc65c21ab12550c0ad0d152fa990a237990d45bbc1e4"
Jul 09 01:19:59.264252 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.264234    2565 scope.go:117] "RemoveContainer" containerID="6937cfc959551a0dc0dccc65c21ab12550c0ad0d152fa990a237990d45bbc1e4"
Jul 09 01:19:59.264535 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:19:59.264518    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6937cfc959551a0dc0dccc65c21ab12550c0ad0d152fa990a237990d45bbc1e4\": container with ID starting with 6937cfc959551a0dc0dccc65c21ab12550c0ad0d152fa990a237990d45bbc1e4 not found: ID does not exist" containerID="6937cfc959551a0dc0dccc65c21ab12550c0ad0d152fa990a237990d45bbc1e4"
Jul 09 01:19:59.264592 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.264542    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6937cfc959551a0dc0dccc65c21ab12550c0ad0d152fa990a237990d45bbc1e4"} err="failed to get container status \"6937cfc959551a0dc0dccc65c21ab12550c0ad0d152fa990a237990d45bbc1e4\": rpc error: code = NotFound desc = could not find container \"6937cfc959551a0dc0dccc65c21ab12550c0ad0d152fa990a237990d45bbc1e4\": container with ID starting with 6937cfc959551a0dc0dccc65c21ab12550c0ad0d152fa990a237990d45bbc1e4 not found: ID does not exist"
Jul 09 01:19:59.277092 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.277044    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"]
Jul 09 01:19:59.280784 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.280757    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e6bc8ba4-6cf4cdddc8-nm67g"]
Jul 09 01:19:59.507200 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:19:59.507167    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb94f273-858b-4b57-bf06-535f54830696" path="/var/lib/kubelet/pods/cb94f273-858b-4b57-bf06-535f54830696/volumes"
Jul 09 01:23:14.633355 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.633320    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"]
Jul 09 01:23:14.633884 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.633787    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb94f273-858b-4b57-bf06-535f54830696" containerName="maas-api"
Jul 09 01:23:14.633884 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.633801    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb94f273-858b-4b57-bf06-535f54830696" containerName="maas-api"
Jul 09 01:23:14.633884 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.633864    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb94f273-858b-4b57-bf06-535f54830696" containerName="maas-api"
Jul 09 01:23:14.637309 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.637289    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.640291 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.640259    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e0f06239\"/\"e2e-lifecycle-model-e0f06239-kserve-self-signed-certs\""
Jul 09 01:23:14.640459 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.640324    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e0f06239\"/\"kube-root-ca.crt\""
Jul 09 01:23:14.640459 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.640389    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e0f06239\"/\"default-dockercfg-5l22x\""
Jul 09 01:23:14.640459 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.640437    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e0f06239\"/\"openshift-service-ca.crt\""
Jul 09 01:23:14.644473 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.644452    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"]
Jul 09 01:23:14.756628 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.756591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-model-cache\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.756628 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.756628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-dshm\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.756863 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.756699    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-home\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.756863 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.756719    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj4dl\" (UniqueName: \"kubernetes.io/projected/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-kube-api-access-bj4dl\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.756863 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.756830    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-tmp-dir\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.756863 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.756856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-tls-certs\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.858422 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.858378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-tmp-dir\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.858615 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.858434    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-tls-certs\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.858615 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.858474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-model-cache\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.858615 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.858500    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-dshm\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.858615 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.858560    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-home\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.858615 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.858589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj4dl\" (UniqueName: \"kubernetes.io/projected/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-kube-api-access-bj4dl\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.858903 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.858871    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-tmp-dir\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.858963 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.858900    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-model-cache\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.859029 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.859000    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-home\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.860769 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.860743    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-dshm\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.861055 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.861036    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-tls-certs\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.865972 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.865949    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj4dl\" (UniqueName: \"kubernetes.io/projected/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-kube-api-access-bj4dl\") pod \"e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") " pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:14.948320 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:14.948205    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:15.094777 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:15.094749    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"]
Jul 09 01:23:15.096004 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:23:15.095970    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fe2ab1a_2731_49d6_b86c_212fcca92cf4.slice/crio-cd41b0b1e673979223ed24f226a47ce1dc52ba3d668e07832390b725d9fd53eb WatchSource:0}: Error finding container cd41b0b1e673979223ed24f226a47ce1dc52ba3d668e07832390b725d9fd53eb: Status 404 returned error can't find the container with id cd41b0b1e673979223ed24f226a47ce1dc52ba3d668e07832390b725d9fd53eb
Jul 09 01:23:15.411177 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:15.411142    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h" event={"ID":"8fe2ab1a-2731-49d6-b86c-212fcca92cf4","Type":"ContainerStarted","Data":"210120c1ada5bcc7decdbedd5fbfacb02371b4f04ce687dc38ac0b0413aae79e"}
Jul 09 01:23:15.411371 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:15.411189    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h" event={"ID":"8fe2ab1a-2731-49d6-b86c-212fcca92cf4","Type":"ContainerStarted","Data":"cd41b0b1e673979223ed24f226a47ce1dc52ba3d668e07832390b725d9fd53eb"}
Jul 09 01:23:15.427486 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:15.427437    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h" podStartSLOduration=1.4274220930000001 podStartE2EDuration="1.427422093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:23:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:23:15.426533044 +0000 UTC m=+1680.490027766" watchObservedRunningTime="2026-07-09 01:23:15.427422093 +0000 UTC m=+1680.490916799"
Jul 09 01:23:24.948814 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:24.948773    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:24.949483 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:24.948840    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:24.961394 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:24.961363    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:25.488044 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:25.488014    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:23:47.824323 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:23:47.824235    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"]
Jul 09 01:24:02.850463 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:02.850420    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h" podUID="8fe2ab1a-2731-49d6-b86c-212fcca92cf4" containerName="main" containerID="cri-o://210120c1ada5bcc7decdbedd5fbfacb02371b4f04ce687dc38ac0b0413aae79e" gracePeriod=45
Jul 09 01:24:03.101003 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.100942    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:24:03.135588 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.135556    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-tls-certs\") pod \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") "
Jul 09 01:24:03.135774 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.135604    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-dshm\") pod \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") "
Jul 09 01:24:03.135774 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.135629    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-tmp-dir\") pod \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") "
Jul 09 01:24:03.135774 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.135667    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-model-cache\") pod \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") "
Jul 09 01:24:03.135774 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.135695    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bj4dl\" (UniqueName: \"kubernetes.io/projected/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-kube-api-access-bj4dl\") pod \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") "
Jul 09 01:24:03.135774 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.135750    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-home\") pod \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\" (UID: \"8fe2ab1a-2731-49d6-b86c-212fcca92cf4\") "
Jul 09 01:24:03.136064 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.135955    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-model-cache" (OuterVolumeSpecName: "model-cache") pod "8fe2ab1a-2731-49d6-b86c-212fcca92cf4" (UID: "8fe2ab1a-2731-49d6-b86c-212fcca92cf4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:24:03.136064 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.135963    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8fe2ab1a-2731-49d6-b86c-212fcca92cf4" (UID: "8fe2ab1a-2731-49d6-b86c-212fcca92cf4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:24:03.136168 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.136150    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-home" (OuterVolumeSpecName: "home") pod "8fe2ab1a-2731-49d6-b86c-212fcca92cf4" (UID: "8fe2ab1a-2731-49d6-b86c-212fcca92cf4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:24:03.136273 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.136254    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-tmp-dir\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:24:03.136345 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.136277    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-model-cache\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:24:03.136345 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.136291    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-home\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:24:03.137986 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.137956    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8fe2ab1a-2731-49d6-b86c-212fcca92cf4" (UID: "8fe2ab1a-2731-49d6-b86c-212fcca92cf4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:24:03.138230 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.138185    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-dshm" (OuterVolumeSpecName: "dshm") pod "8fe2ab1a-2731-49d6-b86c-212fcca92cf4" (UID: "8fe2ab1a-2731-49d6-b86c-212fcca92cf4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:24:03.138293 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.138265    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-kube-api-access-bj4dl" (OuterVolumeSpecName: "kube-api-access-bj4dl") pod "8fe2ab1a-2731-49d6-b86c-212fcca92cf4" (UID: "8fe2ab1a-2731-49d6-b86c-212fcca92cf4"). InnerVolumeSpecName "kube-api-access-bj4dl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:24:03.237811 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.237766    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bj4dl\" (UniqueName: \"kubernetes.io/projected/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-kube-api-access-bj4dl\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:24:03.237811 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.237807    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-tls-certs\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:24:03.237811 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.237817    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fe2ab1a-2731-49d6-b86c-212fcca92cf4-dshm\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:24:03.704261 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.704226    2565 generic.go:356] "Generic (PLEG): container finished" podID="8fe2ab1a-2731-49d6-b86c-212fcca92cf4" containerID="210120c1ada5bcc7decdbedd5fbfacb02371b4f04ce687dc38ac0b0413aae79e" exitCode=0
Jul 09 01:24:03.704453 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.704285    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"
Jul 09 01:24:03.704453 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.704296    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h" event={"ID":"8fe2ab1a-2731-49d6-b86c-212fcca92cf4","Type":"ContainerDied","Data":"210120c1ada5bcc7decdbedd5fbfacb02371b4f04ce687dc38ac0b0413aae79e"}
Jul 09 01:24:03.704453 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.704339    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h" event={"ID":"8fe2ab1a-2731-49d6-b86c-212fcca92cf4","Type":"ContainerDied","Data":"cd41b0b1e673979223ed24f226a47ce1dc52ba3d668e07832390b725d9fd53eb"}
Jul 09 01:24:03.704453 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.704361    2565 scope.go:117] "RemoveContainer" containerID="210120c1ada5bcc7decdbedd5fbfacb02371b4f04ce687dc38ac0b0413aae79e"
Jul 09 01:24:03.713425 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.713407    2565 scope.go:117] "RemoveContainer" containerID="210120c1ada5bcc7decdbedd5fbfacb02371b4f04ce687dc38ac0b0413aae79e"
Jul 09 01:24:03.713715 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:24:03.713697    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"210120c1ada5bcc7decdbedd5fbfacb02371b4f04ce687dc38ac0b0413aae79e\": container with ID starting with 210120c1ada5bcc7decdbedd5fbfacb02371b4f04ce687dc38ac0b0413aae79e not found: ID does not exist" containerID="210120c1ada5bcc7decdbedd5fbfacb02371b4f04ce687dc38ac0b0413aae79e"
Jul 09 01:24:03.713783 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.713723    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"210120c1ada5bcc7decdbedd5fbfacb02371b4f04ce687dc38ac0b0413aae79e"} err="failed to get container status \"210120c1ada5bcc7decdbedd5fbfacb02371b4f04ce687dc38ac0b0413aae79e\": rpc error: code = NotFound desc = could not find container \"210120c1ada5bcc7decdbedd5fbfacb02371b4f04ce687dc38ac0b0413aae79e\": container with ID starting with 210120c1ada5bcc7decdbedd5fbfacb02371b4f04ce687dc38ac0b0413aae79e not found: ID does not exist"
Jul 09 01:24:03.721521 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.721495    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"]
Jul 09 01:24:03.725751 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:03.725728    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-e0f06239/e2e-lifecycle-model-e0f06239-kserve-5bb66796c-b2h2h"]
Jul 09 01:24:05.508612 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:24:05.508583    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fe2ab1a-2731-49d6-b86c-212fcca92cf4" path="/var/lib/kubelet/pods/8fe2ab1a-2731-49d6-b86c-212fcca92cf4/volumes"
Jul 09 01:25:55.857255 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:55.857220    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"]
Jul 09 01:25:55.857884 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:55.857664    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fe2ab1a-2731-49d6-b86c-212fcca92cf4" containerName="main"
Jul 09 01:25:55.857884 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:55.857676    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fe2ab1a-2731-49d6-b86c-212fcca92cf4" containerName="main"
Jul 09 01:25:55.857884 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:55.857742    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fe2ab1a-2731-49d6-b86c-212fcca92cf4" containerName="main"
Jul 09 01:25:55.860890 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:55.860869    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:55.864076 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:55.864049    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-3460b5\"/\"test-model-3460b5-kserve-self-signed-certs\""
Jul 09 01:25:55.864076 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:55.864073    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-3460b5\"/\"kube-root-ca.crt\""
Jul 09 01:25:55.864294 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:55.864049    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-3460b5\"/\"openshift-service-ca.crt\""
Jul 09 01:25:55.864294 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:55.864051    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-3460b5\"/\"default-dockercfg-gc8gw\""
Jul 09 01:25:55.869271 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:55.869234    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"]
Jul 09 01:25:55.935349 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:55.935307    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7628c7de-d977-4e8a-a343-0b99c27122d4-tls-certs\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:55.935349 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:55.935351    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-model-cache\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:55.935609 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:55.935415    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-home\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:55.935609 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:55.935444    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqnd4\" (UniqueName: \"kubernetes.io/projected/7628c7de-d977-4e8a-a343-0b99c27122d4-kube-api-access-dqnd4\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:55.935609 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:55.935557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-dshm\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:55.935609 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:55.935580    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-tmp-dir\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:56.036096 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:56.036064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7628c7de-d977-4e8a-a343-0b99c27122d4-tls-certs\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:56.036325 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:56.036117    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-model-cache\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:56.036325 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:56.036182    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-home\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:56.036325 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:56.036224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqnd4\" (UniqueName: \"kubernetes.io/projected/7628c7de-d977-4e8a-a343-0b99c27122d4-kube-api-access-dqnd4\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:56.036516 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:56.036381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-dshm\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:56.036516 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:56.036415    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-tmp-dir\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:56.036797 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:56.036773    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-model-cache\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:56.036930 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:56.036906    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-tmp-dir\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:56.037314 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:56.037291    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-home\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:56.039084 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:56.039059    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-dshm\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:56.039270 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:56.039253    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7628c7de-d977-4e8a-a343-0b99c27122d4-tls-certs\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:56.044285 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:56.044260    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqnd4\" (UniqueName: \"kubernetes.io/projected/7628c7de-d977-4e8a-a343-0b99c27122d4-kube-api-access-dqnd4\") pod \"test-model-3460b5-kserve-644cbf877c-2n6k7\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") " pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:56.172379 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:56.172282    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:25:56.318618 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:56.318590    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"]
Jul 09 01:25:56.319684 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:25:56.319657    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7628c7de_d977_4e8a_a343_0b99c27122d4.slice/crio-599ddd7727315ed96f463736720743e1d5fb5bc82617f1d6a8e2e580e90fae08 WatchSource:0}: Error finding container 599ddd7727315ed96f463736720743e1d5fb5bc82617f1d6a8e2e580e90fae08: Status 404 returned error can't find the container with id 599ddd7727315ed96f463736720743e1d5fb5bc82617f1d6a8e2e580e90fae08
Jul 09 01:25:56.354533 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:56.354502    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7" event={"ID":"7628c7de-d977-4e8a-a343-0b99c27122d4","Type":"ContainerStarted","Data":"599ddd7727315ed96f463736720743e1d5fb5bc82617f1d6a8e2e580e90fae08"}
Jul 09 01:25:57.362127 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:57.362091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7" event={"ID":"7628c7de-d977-4e8a-a343-0b99c27122d4","Type":"ContainerStarted","Data":"1b03f3ef26bd1b22b2ceae5f2af4d842f55acdf151c8a9517195ff7af3662055"}
Jul 09 01:25:57.385626 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:25:57.385571    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7" podStartSLOduration=2.385550246 podStartE2EDuration="2.385550246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:25:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:25:57.384540996 +0000 UTC m=+1842.448035697" watchObservedRunningTime="2026-07-09 01:25:57.385550246 +0000 UTC m=+1842.449044951"
Jul 09 01:26:06.172658 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:06.172620    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:26:06.173059 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:06.172677    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:26:06.185291 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:06.185265    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:26:06.429134 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:06.429044    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:26:19.531552 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.531502    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"]
Jul 09 01:26:19.535410 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.535392    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.538757 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.538729    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-adaf0e\"/\"openshift-service-ca.crt\""
Jul 09 01:26:19.538889 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.538731    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-adaf0e\"/\"default-dockercfg-tk28k\""
Jul 09 01:26:19.538889 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.538775    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-adaf0e\"/\"test-model-adaf0e-kserve-self-signed-certs\""
Jul 09 01:26:19.538889 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.538792    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-adaf0e\"/\"kube-root-ca.crt\""
Jul 09 01:26:19.544534 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.544514    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"]
Jul 09 01:26:19.677443 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.677390    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6qpf\" (UniqueName: \"kubernetes.io/projected/14d67d35-1369-4d25-ba5e-efd256f789e4-kube-api-access-s6qpf\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.677443 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.677445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14d67d35-1369-4d25-ba5e-efd256f789e4-tls-certs\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.677723 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.677467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-home\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.677723 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.677587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-tmp-dir\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.677723 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.677626    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-dshm\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.677723 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.677714    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-model-cache\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.778672 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.778634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6qpf\" (UniqueName: \"kubernetes.io/projected/14d67d35-1369-4d25-ba5e-efd256f789e4-kube-api-access-s6qpf\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.778672 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.778674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14d67d35-1369-4d25-ba5e-efd256f789e4-tls-certs\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.779029 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.778694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-home\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.779029 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.778747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-tmp-dir\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.779029 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.778768    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-dshm\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.779029 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.778832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-model-cache\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.779281 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.779240    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-model-cache\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.779330 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.779291    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-tmp-dir\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.779330 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.779305    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-home\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.781056 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.781035    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-dshm\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.781361 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.781343    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14d67d35-1369-4d25-ba5e-efd256f789e4-tls-certs\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.787160 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.787111    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6qpf\" (UniqueName: \"kubernetes.io/projected/14d67d35-1369-4d25-ba5e-efd256f789e4-kube-api-access-s6qpf\") pod \"test-model-adaf0e-kserve-dd7c48f87-56tw5\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") " pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.846350 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.846309    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:19.985624 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:19.985597    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"]
Jul 09 01:26:19.986518 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:26:19.986496    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14d67d35_1369_4d25_ba5e_efd256f789e4.slice/crio-bf48893ce10dcbd6043769fdd580f8f191c00c945e491349bc388a31c9ccb927 WatchSource:0}: Error finding container bf48893ce10dcbd6043769fdd580f8f191c00c945e491349bc388a31c9ccb927: Status 404 returned error can't find the container with id bf48893ce10dcbd6043769fdd580f8f191c00c945e491349bc388a31c9ccb927
Jul 09 01:26:20.499617 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:20.499588    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5" event={"ID":"14d67d35-1369-4d25-ba5e-efd256f789e4","Type":"ContainerStarted","Data":"147ff3a9fe5056ebe2543c719e15e6ef63b3458adbedbdee0598cb3ba80dec98"}
Jul 09 01:26:20.499790 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:20.499625    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5" event={"ID":"14d67d35-1369-4d25-ba5e-efd256f789e4","Type":"ContainerStarted","Data":"bf48893ce10dcbd6043769fdd580f8f191c00c945e491349bc388a31c9ccb927"}
Jul 09 01:26:20.516566 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:20.516510    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5" podStartSLOduration=1.516495483 podStartE2EDuration="1.516495483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:26:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:26:20.513832267 +0000 UTC m=+1865.577326975" watchObservedRunningTime="2026-07-09 01:26:20.516495483 +0000 UTC m=+1865.579990188"
Jul 09 01:26:29.846995 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:29.846949    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:29.847590 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:29.847014    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:29.860309 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:29.860277    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:30.571942 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:30.571910    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:26:44.613988 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:44.613906    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"]
Jul 09 01:26:45.554273 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:45.554239    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"]
Jul 09 01:26:59.635142 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:59.635073    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7" podUID="7628c7de-d977-4e8a-a343-0b99c27122d4" containerName="main" containerID="cri-o://1b03f3ef26bd1b22b2ceae5f2af4d842f55acdf151c8a9517195ff7af3662055" gracePeriod=45
Jul 09 01:26:59.888191 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:59.888129    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:26:59.998691 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:59.998650    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-dshm\") pod \"7628c7de-d977-4e8a-a343-0b99c27122d4\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") "
Jul 09 01:26:59.998691 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:59.998693    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7628c7de-d977-4e8a-a343-0b99c27122d4-tls-certs\") pod \"7628c7de-d977-4e8a-a343-0b99c27122d4\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") "
Jul 09 01:26:59.998904 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:59.998730    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqnd4\" (UniqueName: \"kubernetes.io/projected/7628c7de-d977-4e8a-a343-0b99c27122d4-kube-api-access-dqnd4\") pod \"7628c7de-d977-4e8a-a343-0b99c27122d4\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") "
Jul 09 01:26:59.998904 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:59.998791    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-tmp-dir\") pod \"7628c7de-d977-4e8a-a343-0b99c27122d4\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") "
Jul 09 01:26:59.998904 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:59.998881    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-home\") pod \"7628c7de-d977-4e8a-a343-0b99c27122d4\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") "
Jul 09 01:26:59.999027 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:59.998964    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-model-cache\") pod \"7628c7de-d977-4e8a-a343-0b99c27122d4\" (UID: \"7628c7de-d977-4e8a-a343-0b99c27122d4\") "
Jul 09 01:26:59.999157 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:59.999124    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7628c7de-d977-4e8a-a343-0b99c27122d4" (UID: "7628c7de-d977-4e8a-a343-0b99c27122d4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:26:59.999257 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:59.999134    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-home" (OuterVolumeSpecName: "home") pod "7628c7de-d977-4e8a-a343-0b99c27122d4" (UID: "7628c7de-d977-4e8a-a343-0b99c27122d4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:26:59.999325 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:59.999296    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-model-cache" (OuterVolumeSpecName: "model-cache") pod "7628c7de-d977-4e8a-a343-0b99c27122d4" (UID: "7628c7de-d977-4e8a-a343-0b99c27122d4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:26:59.999498 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:59.999481    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-model-cache\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:26:59.999562 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:59.999503    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-tmp-dir\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:26:59.999562 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:26:59.999516    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-home\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:27:00.000937 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.000911    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-dshm" (OuterVolumeSpecName: "dshm") pod "7628c7de-d977-4e8a-a343-0b99c27122d4" (UID: "7628c7de-d977-4e8a-a343-0b99c27122d4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:27:00.001054 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.001036    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7628c7de-d977-4e8a-a343-0b99c27122d4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7628c7de-d977-4e8a-a343-0b99c27122d4" (UID: "7628c7de-d977-4e8a-a343-0b99c27122d4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:27:00.001109 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.001048    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7628c7de-d977-4e8a-a343-0b99c27122d4-kube-api-access-dqnd4" (OuterVolumeSpecName: "kube-api-access-dqnd4") pod "7628c7de-d977-4e8a-a343-0b99c27122d4" (UID: "7628c7de-d977-4e8a-a343-0b99c27122d4"). InnerVolumeSpecName "kube-api-access-dqnd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:27:00.100757 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.100720    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7628c7de-d977-4e8a-a343-0b99c27122d4-dshm\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:27:00.100757 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.100752    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7628c7de-d977-4e8a-a343-0b99c27122d4-tls-certs\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:27:00.100757 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.100763    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqnd4\" (UniqueName: \"kubernetes.io/projected/7628c7de-d977-4e8a-a343-0b99c27122d4-kube-api-access-dqnd4\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:27:00.575474 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.575432    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5" podUID="14d67d35-1369-4d25-ba5e-efd256f789e4" containerName="main" containerID="cri-o://147ff3a9fe5056ebe2543c719e15e6ef63b3458adbedbdee0598cb3ba80dec98" gracePeriod=45
Jul 09 01:27:00.739526 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.739489    2565 generic.go:356] "Generic (PLEG): container finished" podID="7628c7de-d977-4e8a-a343-0b99c27122d4" containerID="1b03f3ef26bd1b22b2ceae5f2af4d842f55acdf151c8a9517195ff7af3662055" exitCode=0
Jul 09 01:27:00.739526 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.739524    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"
Jul 09 01:27:00.740072 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.739573    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7" event={"ID":"7628c7de-d977-4e8a-a343-0b99c27122d4","Type":"ContainerDied","Data":"1b03f3ef26bd1b22b2ceae5f2af4d842f55acdf151c8a9517195ff7af3662055"}
Jul 09 01:27:00.740072 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.739616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7" event={"ID":"7628c7de-d977-4e8a-a343-0b99c27122d4","Type":"ContainerDied","Data":"599ddd7727315ed96f463736720743e1d5fb5bc82617f1d6a8e2e580e90fae08"}
Jul 09 01:27:00.740072 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.739640    2565 scope.go:117] "RemoveContainer" containerID="1b03f3ef26bd1b22b2ceae5f2af4d842f55acdf151c8a9517195ff7af3662055"
Jul 09 01:27:00.741482 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.741457    2565 generic.go:356] "Generic (PLEG): container finished" podID="14d67d35-1369-4d25-ba5e-efd256f789e4" containerID="147ff3a9fe5056ebe2543c719e15e6ef63b3458adbedbdee0598cb3ba80dec98" exitCode=0
Jul 09 01:27:00.741601 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.741528    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5" event={"ID":"14d67d35-1369-4d25-ba5e-efd256f789e4","Type":"ContainerDied","Data":"147ff3a9fe5056ebe2543c719e15e6ef63b3458adbedbdee0598cb3ba80dec98"}
Jul 09 01:27:00.751502 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.751471    2565 scope.go:117] "RemoveContainer" containerID="1b03f3ef26bd1b22b2ceae5f2af4d842f55acdf151c8a9517195ff7af3662055"
Jul 09 01:27:00.751947 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:27:00.751863    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b03f3ef26bd1b22b2ceae5f2af4d842f55acdf151c8a9517195ff7af3662055\": container with ID starting with 1b03f3ef26bd1b22b2ceae5f2af4d842f55acdf151c8a9517195ff7af3662055 not found: ID does not exist" containerID="1b03f3ef26bd1b22b2ceae5f2af4d842f55acdf151c8a9517195ff7af3662055"
Jul 09 01:27:00.751947 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.751906    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b03f3ef26bd1b22b2ceae5f2af4d842f55acdf151c8a9517195ff7af3662055"} err="failed to get container status \"1b03f3ef26bd1b22b2ceae5f2af4d842f55acdf151c8a9517195ff7af3662055\": rpc error: code = NotFound desc = could not find container \"1b03f3ef26bd1b22b2ceae5f2af4d842f55acdf151c8a9517195ff7af3662055\": container with ID starting with 1b03f3ef26bd1b22b2ceae5f2af4d842f55acdf151c8a9517195ff7af3662055 not found: ID does not exist"
Jul 09 01:27:00.762995 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.762960    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"]
Jul 09 01:27:00.766757 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.766727    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-3460b5/test-model-3460b5-kserve-644cbf877c-2n6k7"]
Jul 09 01:27:00.844324 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.844296    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:27:00.909574 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.909544    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6qpf\" (UniqueName: \"kubernetes.io/projected/14d67d35-1369-4d25-ba5e-efd256f789e4-kube-api-access-s6qpf\") pod \"14d67d35-1369-4d25-ba5e-efd256f789e4\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") "
Jul 09 01:27:00.909574 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.909580    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-model-cache\") pod \"14d67d35-1369-4d25-ba5e-efd256f789e4\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") "
Jul 09 01:27:00.909823 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.909629    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-dshm\") pod \"14d67d35-1369-4d25-ba5e-efd256f789e4\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") "
Jul 09 01:27:00.909823 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.909659    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-home\") pod \"14d67d35-1369-4d25-ba5e-efd256f789e4\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") "
Jul 09 01:27:00.909823 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.909696    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14d67d35-1369-4d25-ba5e-efd256f789e4-tls-certs\") pod \"14d67d35-1369-4d25-ba5e-efd256f789e4\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") "
Jul 09 01:27:00.909823 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.909761    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-tmp-dir\") pod \"14d67d35-1369-4d25-ba5e-efd256f789e4\" (UID: \"14d67d35-1369-4d25-ba5e-efd256f789e4\") "
Jul 09 01:27:00.910036 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.909949    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-model-cache" (OuterVolumeSpecName: "model-cache") pod "14d67d35-1369-4d25-ba5e-efd256f789e4" (UID: "14d67d35-1369-4d25-ba5e-efd256f789e4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:27:00.910036 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.909959    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-home" (OuterVolumeSpecName: "home") pod "14d67d35-1369-4d25-ba5e-efd256f789e4" (UID: "14d67d35-1369-4d25-ba5e-efd256f789e4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:27:00.910036 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.910024    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "14d67d35-1369-4d25-ba5e-efd256f789e4" (UID: "14d67d35-1369-4d25-ba5e-efd256f789e4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:27:00.910166 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.910153    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-tmp-dir\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:27:00.910237 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.910171    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-model-cache\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:27:00.910237 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.910184    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-home\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:27:00.911955 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.911934    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-dshm" (OuterVolumeSpecName: "dshm") pod "14d67d35-1369-4d25-ba5e-efd256f789e4" (UID: "14d67d35-1369-4d25-ba5e-efd256f789e4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:27:00.912055 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.911949    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14d67d35-1369-4d25-ba5e-efd256f789e4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "14d67d35-1369-4d25-ba5e-efd256f789e4" (UID: "14d67d35-1369-4d25-ba5e-efd256f789e4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:27:00.912055 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:00.911988    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14d67d35-1369-4d25-ba5e-efd256f789e4-kube-api-access-s6qpf" (OuterVolumeSpecName: "kube-api-access-s6qpf") pod "14d67d35-1369-4d25-ba5e-efd256f789e4" (UID: "14d67d35-1369-4d25-ba5e-efd256f789e4"). InnerVolumeSpecName "kube-api-access-s6qpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:27:01.010896 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:01.010857    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14d67d35-1369-4d25-ba5e-efd256f789e4-tls-certs\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:27:01.010896 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:01.010890    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6qpf\" (UniqueName: \"kubernetes.io/projected/14d67d35-1369-4d25-ba5e-efd256f789e4-kube-api-access-s6qpf\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:27:01.010896 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:01.010900    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14d67d35-1369-4d25-ba5e-efd256f789e4-dshm\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:27:01.507047 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:01.507016    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7628c7de-d977-4e8a-a343-0b99c27122d4" path="/var/lib/kubelet/pods/7628c7de-d977-4e8a-a343-0b99c27122d4/volumes"
Jul 09 01:27:01.749575 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:01.749545    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"
Jul 09 01:27:01.749575 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:01.749563    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5" event={"ID":"14d67d35-1369-4d25-ba5e-efd256f789e4","Type":"ContainerDied","Data":"bf48893ce10dcbd6043769fdd580f8f191c00c945e491349bc388a31c9ccb927"}
Jul 09 01:27:01.750116 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:01.749613    2565 scope.go:117] "RemoveContainer" containerID="147ff3a9fe5056ebe2543c719e15e6ef63b3458adbedbdee0598cb3ba80dec98"
Jul 09 01:27:01.766144 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:01.766123    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"]
Jul 09 01:27:01.772132 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:01.772109    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-adaf0e/test-model-adaf0e-kserve-dd7c48f87-56tw5"]
Jul 09 01:27:03.506392 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:27:03.506355    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14d67d35-1369-4d25-ba5e-efd256f789e4" path="/var/lib/kubelet/pods/14d67d35-1369-4d25-ba5e-efd256f789e4/volumes"
Jul 09 01:28:56.331442 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.331401    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"]
Jul 09 01:28:56.332065 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.332048    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7628c7de-d977-4e8a-a343-0b99c27122d4" containerName="main"
Jul 09 01:28:56.332114 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.332068    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7628c7de-d977-4e8a-a343-0b99c27122d4" containerName="main"
Jul 09 01:28:56.332114 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.332104    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14d67d35-1369-4d25-ba5e-efd256f789e4" containerName="main"
Jul 09 01:28:56.332178 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.332113    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="14d67d35-1369-4d25-ba5e-efd256f789e4" containerName="main"
Jul 09 01:28:56.332278 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.332266    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7628c7de-d977-4e8a-a343-0b99c27122d4" containerName="main"
Jul 09 01:28:56.332323 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.332284    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="14d67d35-1369-4d25-ba5e-efd256f789e4" containerName="main"
Jul 09 01:28:56.335277 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.335253    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.337762 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.337740    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-88a238\"/\"openshift-service-ca.crt\""
Jul 09 01:28:56.338897 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.338879    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-88a238\"/\"kube-root-ca.crt\""
Jul 09 01:28:56.339007 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.338916    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-88a238\"/\"auth-test-model-88a238-kserve-self-signed-certs\""
Jul 09 01:28:56.339007 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.338916    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-88a238\"/\"default-dockercfg-zf6pf\""
Jul 09 01:28:56.343906 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.343881    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"]
Jul 09 01:28:56.456096 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.456062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-dshm\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.456303 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.456174    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-model-cache\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.456303 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.456255    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31c71d87-db82-47f5-b605-bcfa6feb7a4b-tls-certs\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.456303 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.456289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-tmp-dir\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.456445 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.456339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95kt9\" (UniqueName: \"kubernetes.io/projected/31c71d87-db82-47f5-b605-bcfa6feb7a4b-kube-api-access-95kt9\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.456445 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.456369    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-home\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.557058 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.557017    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95kt9\" (UniqueName: \"kubernetes.io/projected/31c71d87-db82-47f5-b605-bcfa6feb7a4b-kube-api-access-95kt9\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.557310 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.557075    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-home\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.557310 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.557127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-dshm\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.557310 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.557198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-model-cache\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.557310 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.557270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31c71d87-db82-47f5-b605-bcfa6feb7a4b-tls-certs\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.557310 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.557297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-tmp-dir\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.557624 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.557599    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-home\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.557685 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.557647    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-model-cache\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.557776 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.557756    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-tmp-dir\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.559543 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.559520    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-dshm\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.559714 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.559695    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31c71d87-db82-47f5-b605-bcfa6feb7a4b-tls-certs\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.564993 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.564967    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95kt9\" (UniqueName: \"kubernetes.io/projected/31c71d87-db82-47f5-b605-bcfa6feb7a4b-kube-api-access-95kt9\") pod \"auth-test-model-88a238-kserve-844cbcbbc5-t9g6z\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") " pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.646715 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.646604    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:28:56.785849 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:56.785824    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"]
Jul 09 01:28:56.787635 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:28:56.787602    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31c71d87_db82_47f5_b605_bcfa6feb7a4b.slice/crio-3c0e315ce7e95bb3ef5f77a2e104fadc1ac2fd0f29fa723d8d038e7d820082a7 WatchSource:0}: Error finding container 3c0e315ce7e95bb3ef5f77a2e104fadc1ac2fd0f29fa723d8d038e7d820082a7: Status 404 returned error can't find the container with id 3c0e315ce7e95bb3ef5f77a2e104fadc1ac2fd0f29fa723d8d038e7d820082a7
Jul 09 01:28:57.432253 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:57.432193    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z" event={"ID":"31c71d87-db82-47f5-b605-bcfa6feb7a4b","Type":"ContainerStarted","Data":"09b449ccc3bba453e4ede5a172481c730be5a581f3bb9b77a3ccc36950748aa2"}
Jul 09 01:28:57.432253 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:57.432258    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z" event={"ID":"31c71d87-db82-47f5-b605-bcfa6feb7a4b","Type":"ContainerStarted","Data":"3c0e315ce7e95bb3ef5f77a2e104fadc1ac2fd0f29fa723d8d038e7d820082a7"}
Jul 09 01:28:57.450960 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:28:57.450909    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z" podStartSLOduration=1.450893845 podStartE2EDuration="1.450893845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:28:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:28:57.448386609 +0000 UTC m=+2022.511881315" watchObservedRunningTime="2026-07-09 01:28:57.450893845 +0000 UTC m=+2022.514388550"
Jul 09 01:29:06.647364 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:06.647323    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:29:06.647844 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:06.647411    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:29:06.659935 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:06.659914    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:29:07.514452 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:07.514422    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:29:23.138515 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.138481    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"]
Jul 09 01:29:23.142394 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.142365    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.146147 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.146119    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-52d242\"/\"openshift-service-ca.crt\""
Jul 09 01:29:23.146312 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.146153    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-52d242\"/\"auth-test-model-52d242-kserve-self-signed-certs\""
Jul 09 01:29:23.146312 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.146167    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-52d242\"/\"default-dockercfg-kh25v\""
Jul 09 01:29:23.146503 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.146486    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-52d242\"/\"kube-root-ca.crt\""
Jul 09 01:29:23.151802 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.151617    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"]
Jul 09 01:29:23.221840 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.221801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-dshm\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.221840 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.221838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-tmp-dir\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.222060 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.221866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfn5f\" (UniqueName: \"kubernetes.io/projected/a4204bee-876c-471a-b987-e6c250b01955-kube-api-access-jfn5f\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.222060 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.221954    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4204bee-876c-471a-b987-e6c250b01955-tls-certs\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.222060 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.221977    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-home\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.222060 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.222058    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-model-cache\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.322904 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.322865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-dshm\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.322904 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.322902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-tmp-dir\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.323153 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.323034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfn5f\" (UniqueName: \"kubernetes.io/projected/a4204bee-876c-471a-b987-e6c250b01955-kube-api-access-jfn5f\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.323153 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.323112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4204bee-876c-471a-b987-e6c250b01955-tls-certs\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.323153 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.323134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-home\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.323346 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.323270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-model-cache\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.323346 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.323292    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-tmp-dir\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.323559 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.323533    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-home\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.323559 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.323553    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-model-cache\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.325282 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.325260    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-dshm\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.325567 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.325548    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4204bee-876c-471a-b987-e6c250b01955-tls-certs\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.330724 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.330705    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfn5f\" (UniqueName: \"kubernetes.io/projected/a4204bee-876c-471a-b987-e6c250b01955-kube-api-access-jfn5f\") pod \"auth-test-model-52d242-kserve-56754bd8cf-6d857\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") " pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.455339 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.455240    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:23.602274 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:23.602248    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"]
Jul 09 01:29:23.603935 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:29:23.603906    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4204bee_876c_471a_b987_e6c250b01955.slice/crio-c282a78464141a54911d5d970e17b0eff31406a14817c4f98662770001b5c71a WatchSource:0}: Error finding container c282a78464141a54911d5d970e17b0eff31406a14817c4f98662770001b5c71a: Status 404 returned error can't find the container with id c282a78464141a54911d5d970e17b0eff31406a14817c4f98662770001b5c71a
Jul 09 01:29:24.603707 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:24.603666    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857" event={"ID":"a4204bee-876c-471a-b987-e6c250b01955","Type":"ContainerStarted","Data":"019232c200ce37b0ccfcacb8d75ed3fa57adac668e6e6333df7d74229f9e5e41"}
Jul 09 01:29:24.603707 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:24.603711    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857" event={"ID":"a4204bee-876c-471a-b987-e6c250b01955","Type":"ContainerStarted","Data":"c282a78464141a54911d5d970e17b0eff31406a14817c4f98662770001b5c71a"}
Jul 09 01:29:24.620140 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:24.620085    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857" podStartSLOduration=1.6200688159999999 podStartE2EDuration="1.620068816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:29:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:29:24.619114704 +0000 UTC m=+2049.682609407" watchObservedRunningTime="2026-07-09 01:29:24.620068816 +0000 UTC m=+2049.683563541"
Jul 09 01:29:33.455802 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:33.455757    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:33.456258 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:33.455998    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:33.468416 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:33.468389    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:29:33.666895 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:29:33.666862    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:31:42.371053 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:42.371009    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"]
Jul 09 01:31:43.145579 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:43.145548    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"]
Jul 09 01:31:57.393102 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.393038    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z" podUID="31c71d87-db82-47f5-b605-bcfa6feb7a4b" containerName="main" containerID="cri-o://09b449ccc3bba453e4ede5a172481c730be5a581f3bb9b77a3ccc36950748aa2" gracePeriod=45
Jul 09 01:31:57.493607 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.493568    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z" podUID="31c71d87-db82-47f5-b605-bcfa6feb7a4b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": dial tcp 10.133.0.70:8000: connect: connection refused"
Jul 09 01:31:57.518507 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.518477    2565 generic.go:356] "Generic (PLEG): container finished" podID="31c71d87-db82-47f5-b605-bcfa6feb7a4b" containerID="09b449ccc3bba453e4ede5a172481c730be5a581f3bb9b77a3ccc36950748aa2" exitCode=0
Jul 09 01:31:57.518638 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.518544    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z" event={"ID":"31c71d87-db82-47f5-b605-bcfa6feb7a4b","Type":"ContainerDied","Data":"09b449ccc3bba453e4ede5a172481c730be5a581f3bb9b77a3ccc36950748aa2"}
Jul 09 01:31:57.656024 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.655956    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:31:57.681974 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.681940    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-model-cache\") pod \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") "
Jul 09 01:31:57.682164 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.682012    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-home\") pod \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") "
Jul 09 01:31:57.682164 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.682105    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-dshm\") pod \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") "
Jul 09 01:31:57.682164 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.682157    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31c71d87-db82-47f5-b605-bcfa6feb7a4b-tls-certs\") pod \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") "
Jul 09 01:31:57.682351 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.682235    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95kt9\" (UniqueName: \"kubernetes.io/projected/31c71d87-db82-47f5-b605-bcfa6feb7a4b-kube-api-access-95kt9\") pod \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") "
Jul 09 01:31:57.682351 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.682263    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-tmp-dir\") pod \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\" (UID: \"31c71d87-db82-47f5-b605-bcfa6feb7a4b\") "
Jul 09 01:31:57.682351 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.682276    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-model-cache" (OuterVolumeSpecName: "model-cache") pod "31c71d87-db82-47f5-b605-bcfa6feb7a4b" (UID: "31c71d87-db82-47f5-b605-bcfa6feb7a4b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:31:57.682351 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.682285    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-home" (OuterVolumeSpecName: "home") pod "31c71d87-db82-47f5-b605-bcfa6feb7a4b" (UID: "31c71d87-db82-47f5-b605-bcfa6feb7a4b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:31:57.682562 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.682527    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "31c71d87-db82-47f5-b605-bcfa6feb7a4b" (UID: "31c71d87-db82-47f5-b605-bcfa6feb7a4b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:31:57.682705 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.682688    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-tmp-dir\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:31:57.682770 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.682710    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-model-cache\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:31:57.682770 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.682722    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-home\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:31:57.684458 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.684426    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-dshm" (OuterVolumeSpecName: "dshm") pod "31c71d87-db82-47f5-b605-bcfa6feb7a4b" (UID: "31c71d87-db82-47f5-b605-bcfa6feb7a4b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:31:57.684736 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.684717    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31c71d87-db82-47f5-b605-bcfa6feb7a4b-kube-api-access-95kt9" (OuterVolumeSpecName: "kube-api-access-95kt9") pod "31c71d87-db82-47f5-b605-bcfa6feb7a4b" (UID: "31c71d87-db82-47f5-b605-bcfa6feb7a4b"). InnerVolumeSpecName "kube-api-access-95kt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:31:57.684805 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.684779    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31c71d87-db82-47f5-b605-bcfa6feb7a4b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "31c71d87-db82-47f5-b605-bcfa6feb7a4b" (UID: "31c71d87-db82-47f5-b605-bcfa6feb7a4b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:31:57.783950 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.783917    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95kt9\" (UniqueName: \"kubernetes.io/projected/31c71d87-db82-47f5-b605-bcfa6feb7a4b-kube-api-access-95kt9\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:31:57.783950 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.783948    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31c71d87-db82-47f5-b605-bcfa6feb7a4b-dshm\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:31:57.784152 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:57.783960    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31c71d87-db82-47f5-b605-bcfa6feb7a4b-tls-certs\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:31:58.166561 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.166520    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857" podUID="a4204bee-876c-471a-b987-e6c250b01955" containerName="main" containerID="cri-o://019232c200ce37b0ccfcacb8d75ed3fa57adac668e6e6333df7d74229f9e5e41" gracePeriod=45
Jul 09 01:31:58.434882 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.434853    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:31:58.491825 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.491790    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-dshm\") pod \"a4204bee-876c-471a-b987-e6c250b01955\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") "
Jul 09 01:31:58.492017 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.491833    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-model-cache\") pod \"a4204bee-876c-471a-b987-e6c250b01955\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") "
Jul 09 01:31:58.492017 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.491913    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4204bee-876c-471a-b987-e6c250b01955-tls-certs\") pod \"a4204bee-876c-471a-b987-e6c250b01955\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") "
Jul 09 01:31:58.492017 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.491991    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfn5f\" (UniqueName: \"kubernetes.io/projected/a4204bee-876c-471a-b987-e6c250b01955-kube-api-access-jfn5f\") pod \"a4204bee-876c-471a-b987-e6c250b01955\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") "
Jul 09 01:31:58.492192 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.492020    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-home\") pod \"a4204bee-876c-471a-b987-e6c250b01955\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") "
Jul 09 01:31:58.492192 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.492058    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-tmp-dir\") pod \"a4204bee-876c-471a-b987-e6c250b01955\" (UID: \"a4204bee-876c-471a-b987-e6c250b01955\") "
Jul 09 01:31:58.492192 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.492129    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-model-cache" (OuterVolumeSpecName: "model-cache") pod "a4204bee-876c-471a-b987-e6c250b01955" (UID: "a4204bee-876c-471a-b987-e6c250b01955"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:31:58.492356 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.492293    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-home" (OuterVolumeSpecName: "home") pod "a4204bee-876c-471a-b987-e6c250b01955" (UID: "a4204bee-876c-471a-b987-e6c250b01955"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:31:58.492463 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.492434    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a4204bee-876c-471a-b987-e6c250b01955" (UID: "a4204bee-876c-471a-b987-e6c250b01955"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:31:58.492587 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.492570    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-model-cache\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:31:58.492642 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.492593    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-home\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:31:58.492642 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.492606    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-tmp-dir\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:31:58.494168 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.494133    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-dshm" (OuterVolumeSpecName: "dshm") pod "a4204bee-876c-471a-b987-e6c250b01955" (UID: "a4204bee-876c-471a-b987-e6c250b01955"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:31:58.494305 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.494188    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4204bee-876c-471a-b987-e6c250b01955-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a4204bee-876c-471a-b987-e6c250b01955" (UID: "a4204bee-876c-471a-b987-e6c250b01955"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:31:58.494305 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.494185    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4204bee-876c-471a-b987-e6c250b01955-kube-api-access-jfn5f" (OuterVolumeSpecName: "kube-api-access-jfn5f") pod "a4204bee-876c-471a-b987-e6c250b01955" (UID: "a4204bee-876c-471a-b987-e6c250b01955"). InnerVolumeSpecName "kube-api-access-jfn5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:31:58.525322 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.525290    2565 generic.go:356] "Generic (PLEG): container finished" podID="a4204bee-876c-471a-b987-e6c250b01955" containerID="019232c200ce37b0ccfcacb8d75ed3fa57adac668e6e6333df7d74229f9e5e41" exitCode=0
Jul 09 01:31:58.525513 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.525333    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"
Jul 09 01:31:58.525513 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.525381    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857" event={"ID":"a4204bee-876c-471a-b987-e6c250b01955","Type":"ContainerDied","Data":"019232c200ce37b0ccfcacb8d75ed3fa57adac668e6e6333df7d74229f9e5e41"}
Jul 09 01:31:58.525513 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.525421    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857" event={"ID":"a4204bee-876c-471a-b987-e6c250b01955","Type":"ContainerDied","Data":"c282a78464141a54911d5d970e17b0eff31406a14817c4f98662770001b5c71a"}
Jul 09 01:31:58.525513 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.525441    2565 scope.go:117] "RemoveContainer" containerID="019232c200ce37b0ccfcacb8d75ed3fa57adac668e6e6333df7d74229f9e5e41"
Jul 09 01:31:58.526966 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.526941    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"
Jul 09 01:31:58.527065 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.526985    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z" event={"ID":"31c71d87-db82-47f5-b605-bcfa6feb7a4b","Type":"ContainerDied","Data":"3c0e315ce7e95bb3ef5f77a2e104fadc1ac2fd0f29fa723d8d038e7d820082a7"}
Jul 09 01:31:58.538584 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.538561    2565 scope.go:117] "RemoveContainer" containerID="019232c200ce37b0ccfcacb8d75ed3fa57adac668e6e6333df7d74229f9e5e41"
Jul 09 01:31:58.538943 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:31:58.538871    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"019232c200ce37b0ccfcacb8d75ed3fa57adac668e6e6333df7d74229f9e5e41\": container with ID starting with 019232c200ce37b0ccfcacb8d75ed3fa57adac668e6e6333df7d74229f9e5e41 not found: ID does not exist" containerID="019232c200ce37b0ccfcacb8d75ed3fa57adac668e6e6333df7d74229f9e5e41"
Jul 09 01:31:58.538943 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.538910    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"019232c200ce37b0ccfcacb8d75ed3fa57adac668e6e6333df7d74229f9e5e41"} err="failed to get container status \"019232c200ce37b0ccfcacb8d75ed3fa57adac668e6e6333df7d74229f9e5e41\": rpc error: code = NotFound desc = could not find container \"019232c200ce37b0ccfcacb8d75ed3fa57adac668e6e6333df7d74229f9e5e41\": container with ID starting with 019232c200ce37b0ccfcacb8d75ed3fa57adac668e6e6333df7d74229f9e5e41 not found: ID does not exist"
Jul 09 01:31:58.538943 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.538934    2565 scope.go:117] "RemoveContainer" containerID="09b449ccc3bba453e4ede5a172481c730be5a581f3bb9b77a3ccc36950748aa2"
Jul 09 01:31:58.547981 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.547952    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"]
Jul 09 01:31:58.552039 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.552017    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-52d242/auth-test-model-52d242-kserve-56754bd8cf-6d857"]
Jul 09 01:31:58.561443 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.561413    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"]
Jul 09 01:31:58.565419 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.565390    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-88a238/auth-test-model-88a238-kserve-844cbcbbc5-t9g6z"]
Jul 09 01:31:58.594127 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.594096    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4204bee-876c-471a-b987-e6c250b01955-dshm\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:31:58.594127 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.594121    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4204bee-876c-471a-b987-e6c250b01955-tls-certs\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:31:58.594127 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:58.594131    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfn5f\" (UniqueName: \"kubernetes.io/projected/a4204bee-876c-471a-b987-e6c250b01955-kube-api-access-jfn5f\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:31:59.507200 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:59.507167    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31c71d87-db82-47f5-b605-bcfa6feb7a4b" path="/var/lib/kubelet/pods/31c71d87-db82-47f5-b605-bcfa6feb7a4b/volumes"
Jul 09 01:31:59.507600 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:31:59.507585    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4204bee-876c-471a-b987-e6c250b01955" path="/var/lib/kubelet/pods/a4204bee-876c-471a-b987-e6c250b01955/volumes"
Jul 09 01:32:18.920444 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:18.920407    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"]
Jul 09 01:32:18.921039 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:18.921022    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31c71d87-db82-47f5-b605-bcfa6feb7a4b" containerName="main"
Jul 09 01:32:18.921083 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:18.921042    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="31c71d87-db82-47f5-b605-bcfa6feb7a4b" containerName="main"
Jul 09 01:32:18.921083 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:18.921065    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4204bee-876c-471a-b987-e6c250b01955" containerName="main"
Jul 09 01:32:18.921083 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:18.921070    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4204bee-876c-471a-b987-e6c250b01955" containerName="main"
Jul 09 01:32:18.921185 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:18.921150    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="31c71d87-db82-47f5-b605-bcfa6feb7a4b" containerName="main"
Jul 09 01:32:18.921185 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:18.921160    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4204bee-876c-471a-b987-e6c250b01955" containerName="main"
Jul 09 01:32:18.926045 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:18.926023    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:18.928568 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:18.928541    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-52d242\"/\"kube-root-ca.crt\""
Jul 09 01:32:18.928697 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:18.928541    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-52d242\"/\"openshift-service-ca.crt\""
Jul 09 01:32:18.929636 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:18.929615    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-52d242\"/\"sub-test-model-52d242-kserve-self-signed-certs\""
Jul 09 01:32:18.929887 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:18.929625    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-52d242\"/\"default-dockercfg-kh25v\""
Jul 09 01:32:18.933698 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:18.933675    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"]
Jul 09 01:32:19.103569 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.103537    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-dshm\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.103752 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.103576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th6g5\" (UniqueName: \"kubernetes.io/projected/7c5622f9-a961-4f98-ab8b-acdbec913dcd-kube-api-access-th6g5\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.103752 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.103596    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c5622f9-a961-4f98-ab8b-acdbec913dcd-tls-certs\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.103752 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.103685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-tmp-dir\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.103888 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.103775    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-model-cache\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.103927 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.103883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-home\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.205201 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.205110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-home\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.205201 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.205187    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-dshm\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.205481 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.205233    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th6g5\" (UniqueName: \"kubernetes.io/projected/7c5622f9-a961-4f98-ab8b-acdbec913dcd-kube-api-access-th6g5\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.205481 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.205252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c5622f9-a961-4f98-ab8b-acdbec913dcd-tls-certs\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.205481 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.205274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-tmp-dir\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.205481 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.205293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-model-cache\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.205694 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.205587    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-home\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.205694 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.205678    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-tmp-dir\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.205760 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.205694    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-model-cache\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.207476 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.207445    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-dshm\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.207692 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.207675    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c5622f9-a961-4f98-ab8b-acdbec913dcd-tls-certs\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.212442 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.212423    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th6g5\" (UniqueName: \"kubernetes.io/projected/7c5622f9-a961-4f98-ab8b-acdbec913dcd-kube-api-access-th6g5\") pod \"sub-test-model-52d242-kserve-74d865f889-7b2r4\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") " pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.237130 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.237103    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:19.380038 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.380013    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"]
Jul 09 01:32:19.381516 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:32:19.381481    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c5622f9_a961_4f98_ab8b_acdbec913dcd.slice/crio-a85698ff9b1213e4a197e78c5ba5a4df22dc7442c5b949e69255a3b2dfa6ae39 WatchSource:0}: Error finding container a85698ff9b1213e4a197e78c5ba5a4df22dc7442c5b949e69255a3b2dfa6ae39: Status 404 returned error can't find the container with id a85698ff9b1213e4a197e78c5ba5a4df22dc7442c5b949e69255a3b2dfa6ae39
Jul 09 01:32:19.657437 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.657405    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4" event={"ID":"7c5622f9-a961-4f98-ab8b-acdbec913dcd","Type":"ContainerStarted","Data":"02d15bd4304c678113e07b5945badeb1be62f2a5b9566cb4aa89620398714d17"}
Jul 09 01:32:19.657629 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.657454    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4" event={"ID":"7c5622f9-a961-4f98-ab8b-acdbec913dcd","Type":"ContainerStarted","Data":"a85698ff9b1213e4a197e78c5ba5a4df22dc7442c5b949e69255a3b2dfa6ae39"}
Jul 09 01:32:19.674591 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:19.674537    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4" podStartSLOduration=1.674520773 podStartE2EDuration="1.674520773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:32:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:32:19.671432471 +0000 UTC m=+2224.734927187" watchObservedRunningTime="2026-07-09 01:32:19.674520773 +0000 UTC m=+2224.738015504"
Jul 09 01:32:29.238312 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:29.238273    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:29.238756 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:29.238348    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:29.252382 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:29.252347    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:32:29.725980 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:32:29.725951    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:33:05.714146 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:05.714111    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"]
Jul 09 01:33:16.931842 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:16.931809    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"]
Jul 09 01:33:16.935483 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:16.935464    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:16.938763 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:16.938738    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-88a238\"/\"rate-test-model-88a238-kserve-self-signed-certs\""
Jul 09 01:33:16.938906 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:16.938766    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-88a238\"/\"kube-root-ca.crt\""
Jul 09 01:33:16.938906 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:16.938764    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-88a238\"/\"default-dockercfg-zf6pf\""
Jul 09 01:33:16.939091 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:16.939076    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-88a238\"/\"openshift-service-ca.crt\""
Jul 09 01:33:16.947226 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:16.947164    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"]
Jul 09 01:33:16.981032 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:16.980991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f628e0cf-d212-4b25-96d4-a18119dbfe90-tls-certs\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:16.981032 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:16.981032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-home\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:16.981341 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:16.981170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-tmp-dir\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:16.981341 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:16.981282    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzpch\" (UniqueName: \"kubernetes.io/projected/f628e0cf-d212-4b25-96d4-a18119dbfe90-kube-api-access-pzpch\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:16.981341 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:16.981322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-model-cache\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:16.981517 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:16.981387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-dshm\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:17.082479 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:17.082449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-tmp-dir\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:17.082664 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:17.082507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzpch\" (UniqueName: \"kubernetes.io/projected/f628e0cf-d212-4b25-96d4-a18119dbfe90-kube-api-access-pzpch\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:17.082664 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:17.082538    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-model-cache\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:17.082664 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:17.082575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-dshm\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:17.082664 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:17.082604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f628e0cf-d212-4b25-96d4-a18119dbfe90-tls-certs\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:17.082664 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:17.082628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-home\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:17.082940 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:17.082919    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-tmp-dir\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:17.083037 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:17.082993    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-model-cache\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:17.083098 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:17.083064    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-home\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:17.084858 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:17.084827    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-dshm\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:17.085033 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:17.085012    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f628e0cf-d212-4b25-96d4-a18119dbfe90-tls-certs\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:17.091380 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:17.091353    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzpch\" (UniqueName: \"kubernetes.io/projected/f628e0cf-d212-4b25-96d4-a18119dbfe90-kube-api-access-pzpch\") pod \"rate-test-model-88a238-kserve-6755b59759-chqqz\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") " pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:17.252120 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:17.252085    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:17.400340 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:17.400310    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"]
Jul 09 01:33:17.401286 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:33:17.401259    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf628e0cf_d212_4b25_96d4_a18119dbfe90.slice/crio-2979a457c43ba512b6120fb8388b97cf465c3b13112d60f4984760d5e2406a74 WatchSource:0}: Error finding container 2979a457c43ba512b6120fb8388b97cf465c3b13112d60f4984760d5e2406a74: Status 404 returned error can't find the container with id 2979a457c43ba512b6120fb8388b97cf465c3b13112d60f4984760d5e2406a74
Jul 09 01:33:17.996143 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:17.996104    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz" event={"ID":"f628e0cf-d212-4b25-96d4-a18119dbfe90","Type":"ContainerStarted","Data":"eda4a9d671566b93b64b054f45e0ca3afbff16f7a08fc060300881ea898a8268"}
Jul 09 01:33:17.996143 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:17.996153    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz" event={"ID":"f628e0cf-d212-4b25-96d4-a18119dbfe90","Type":"ContainerStarted","Data":"2979a457c43ba512b6120fb8388b97cf465c3b13112d60f4984760d5e2406a74"}
Jul 09 01:33:18.014491 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:18.014437    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz" podStartSLOduration=2.014418447 podStartE2EDuration="2.014418447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:33:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:33:18.011740833 +0000 UTC m=+2283.075235545" watchObservedRunningTime="2026-07-09 01:33:18.014418447 +0000 UTC m=+2283.077913155"
Jul 09 01:33:20.736178 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:20.736111    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4" podUID="7c5622f9-a961-4f98-ab8b-acdbec913dcd" containerName="main" containerID="cri-o://02d15bd4304c678113e07b5945badeb1be62f2a5b9566cb4aa89620398714d17" gracePeriod=45
Jul 09 01:33:20.999959 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:20.999931    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:33:21.013932 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.013902    2565 generic.go:356] "Generic (PLEG): container finished" podID="7c5622f9-a961-4f98-ab8b-acdbec913dcd" containerID="02d15bd4304c678113e07b5945badeb1be62f2a5b9566cb4aa89620398714d17" exitCode=0
Jul 09 01:33:21.014090 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.013943    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"
Jul 09 01:33:21.014090 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.013982    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4" event={"ID":"7c5622f9-a961-4f98-ab8b-acdbec913dcd","Type":"ContainerDied","Data":"02d15bd4304c678113e07b5945badeb1be62f2a5b9566cb4aa89620398714d17"}
Jul 09 01:33:21.014090 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.014025    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4" event={"ID":"7c5622f9-a961-4f98-ab8b-acdbec913dcd","Type":"ContainerDied","Data":"a85698ff9b1213e4a197e78c5ba5a4df22dc7442c5b949e69255a3b2dfa6ae39"}
Jul 09 01:33:21.014090 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.014042    2565 scope.go:117] "RemoveContainer" containerID="02d15bd4304c678113e07b5945badeb1be62f2a5b9566cb4aa89620398714d17"
Jul 09 01:33:21.023943 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.023926    2565 scope.go:117] "RemoveContainer" containerID="02d15bd4304c678113e07b5945badeb1be62f2a5b9566cb4aa89620398714d17"
Jul 09 01:33:21.024301 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:33:21.024282    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02d15bd4304c678113e07b5945badeb1be62f2a5b9566cb4aa89620398714d17\": container with ID starting with 02d15bd4304c678113e07b5945badeb1be62f2a5b9566cb4aa89620398714d17 not found: ID does not exist" containerID="02d15bd4304c678113e07b5945badeb1be62f2a5b9566cb4aa89620398714d17"
Jul 09 01:33:21.024387 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.024311    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02d15bd4304c678113e07b5945badeb1be62f2a5b9566cb4aa89620398714d17"} err="failed to get container status \"02d15bd4304c678113e07b5945badeb1be62f2a5b9566cb4aa89620398714d17\": rpc error: code = NotFound desc = could not find container \"02d15bd4304c678113e07b5945badeb1be62f2a5b9566cb4aa89620398714d17\": container with ID starting with 02d15bd4304c678113e07b5945badeb1be62f2a5b9566cb4aa89620398714d17 not found: ID does not exist"
Jul 09 01:33:21.128839 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.128805    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-dshm\") pod \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") "
Jul 09 01:33:21.129054 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.128894    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-home\") pod \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") "
Jul 09 01:33:21.129054 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.128957    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-model-cache\") pod \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") "
Jul 09 01:33:21.129054 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.128988    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-th6g5\" (UniqueName: \"kubernetes.io/projected/7c5622f9-a961-4f98-ab8b-acdbec913dcd-kube-api-access-th6g5\") pod \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") "
Jul 09 01:33:21.129054 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.129034    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c5622f9-a961-4f98-ab8b-acdbec913dcd-tls-certs\") pod \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") "
Jul 09 01:33:21.129317 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.129157    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-tmp-dir\") pod \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\" (UID: \"7c5622f9-a961-4f98-ab8b-acdbec913dcd\") "
Jul 09 01:33:21.129317 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.129186    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-home" (OuterVolumeSpecName: "home") pod "7c5622f9-a961-4f98-ab8b-acdbec913dcd" (UID: "7c5622f9-a961-4f98-ab8b-acdbec913dcd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:33:21.129317 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.129251    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-model-cache" (OuterVolumeSpecName: "model-cache") pod "7c5622f9-a961-4f98-ab8b-acdbec913dcd" (UID: "7c5622f9-a961-4f98-ab8b-acdbec913dcd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:33:21.129474 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.129420    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7c5622f9-a961-4f98-ab8b-acdbec913dcd" (UID: "7c5622f9-a961-4f98-ab8b-acdbec913dcd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:33:21.129547 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.129529    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-home\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:33:21.129607 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.129550    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-model-cache\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:33:21.129607 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.129563    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-tmp-dir\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:33:21.131059 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.131033    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c5622f9-a961-4f98-ab8b-acdbec913dcd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7c5622f9-a961-4f98-ab8b-acdbec913dcd" (UID: "7c5622f9-a961-4f98-ab8b-acdbec913dcd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:33:21.131178 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.131069    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-dshm" (OuterVolumeSpecName: "dshm") pod "7c5622f9-a961-4f98-ab8b-acdbec913dcd" (UID: "7c5622f9-a961-4f98-ab8b-acdbec913dcd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:33:21.131178 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.131132    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c5622f9-a961-4f98-ab8b-acdbec913dcd-kube-api-access-th6g5" (OuterVolumeSpecName: "kube-api-access-th6g5") pod "7c5622f9-a961-4f98-ab8b-acdbec913dcd" (UID: "7c5622f9-a961-4f98-ab8b-acdbec913dcd"). InnerVolumeSpecName "kube-api-access-th6g5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:33:21.230525 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.230487    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-th6g5\" (UniqueName: \"kubernetes.io/projected/7c5622f9-a961-4f98-ab8b-acdbec913dcd-kube-api-access-th6g5\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:33:21.230525 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.230517    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c5622f9-a961-4f98-ab8b-acdbec913dcd-tls-certs\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:33:21.230525 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.230526    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c5622f9-a961-4f98-ab8b-acdbec913dcd-dshm\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:33:21.337699 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.337664    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"]
Jul 09 01:33:21.340277 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.340250    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-52d242/sub-test-model-52d242-kserve-74d865f889-7b2r4"]
Jul 09 01:33:21.507660 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:21.507629    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c5622f9-a961-4f98-ab8b-acdbec913dcd" path="/var/lib/kubelet/pods/7c5622f9-a961-4f98-ab8b-acdbec913dcd/volumes"
Jul 09 01:33:27.252373 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:27.252328    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:27.252373 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:27.252390    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:27.265244 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:27.265191    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:33:28.069142 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:33:28.069106    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:34:28.045129 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:28.045097    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"]
Jul 09 01:34:29.875892 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:29.875854    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7700-140124469915056"]
Jul 09 01:34:29.876328 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:29.876314    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c5622f9-a961-4f98-ab8b-acdbec913dcd" containerName="main"
Jul 09 01:34:29.876328 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:29.876329    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c5622f9-a961-4f98-ab8b-acdbec913dcd" containerName="main"
Jul 09 01:34:29.876417 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:29.876394    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c5622f9-a961-4f98-ab8b-acdbec913dcd" containerName="main"
Jul 09 01:34:29.879472 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:29.879456    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124469915056"
Jul 09 01:34:29.882028 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:29.882006    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-g6w64\""
Jul 09 01:34:29.885180 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:29.885159    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7700-140124469915056"]
Jul 09 01:34:29.919765 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:29.919726    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-792kw\" (UniqueName: \"kubernetes.io/projected/cc28fc62-3061-4233-92cb-544f63c21916-kube-api-access-792kw\") pod \"test-curl-7700-140124469915056\" (UID: \"cc28fc62-3061-4233-92cb-544f63c21916\") " pod="openshift-ingress/test-curl-7700-140124469915056"
Jul 09 01:34:30.020913 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:30.020874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-792kw\" (UniqueName: \"kubernetes.io/projected/cc28fc62-3061-4233-92cb-544f63c21916-kube-api-access-792kw\") pod \"test-curl-7700-140124469915056\" (UID: \"cc28fc62-3061-4233-92cb-544f63c21916\") " pod="openshift-ingress/test-curl-7700-140124469915056"
Jul 09 01:34:30.028956 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:30.028918    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-792kw\" (UniqueName: \"kubernetes.io/projected/cc28fc62-3061-4233-92cb-544f63c21916-kube-api-access-792kw\") pod \"test-curl-7700-140124469915056\" (UID: \"cc28fc62-3061-4233-92cb-544f63c21916\") " pod="openshift-ingress/test-curl-7700-140124469915056"
Jul 09 01:34:30.190393 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:30.190302    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124469915056"
Jul 09 01:34:30.339509 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:30.339468    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7700-140124469915056"]
Jul 09 01:34:30.340532 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:34:30.340509    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc28fc62_3061_4233_92cb_544f63c21916.slice/crio-ae512890593fe112edd6ea5d6869e230584a199d2cc916998a15ba1cb6cf2030 WatchSource:0}: Error finding container ae512890593fe112edd6ea5d6869e230584a199d2cc916998a15ba1cb6cf2030: Status 404 returned error can't find the container with id ae512890593fe112edd6ea5d6869e230584a199d2cc916998a15ba1cb6cf2030
Jul 09 01:34:30.342338 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:30.342317    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 01:34:30.430096 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:30.430065    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7700-140124469915056" event={"ID":"cc28fc62-3061-4233-92cb-544f63c21916","Type":"ContainerStarted","Data":"ae512890593fe112edd6ea5d6869e230584a199d2cc916998a15ba1cb6cf2030"}
Jul 09 01:34:31.436797 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:31.436705    2565 generic.go:356] "Generic (PLEG): container finished" podID="cc28fc62-3061-4233-92cb-544f63c21916" containerID="cfed2fb06b6c9a751f0402229f4cc883d6f266bdcfe67185c5ee099be4cc13a5" exitCode=0
Jul 09 01:34:31.437164 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:31.436796    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7700-140124469915056" event={"ID":"cc28fc62-3061-4233-92cb-544f63c21916","Type":"ContainerDied","Data":"cfed2fb06b6c9a751f0402229f4cc883d6f266bdcfe67185c5ee099be4cc13a5"}
Jul 09 01:34:32.594791 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:32.594757    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124469915056"
Jul 09 01:34:32.628084 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:32.628053    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7700-140124469915056_cc28fc62-3061-4233-92cb-544f63c21916/test-curl-7700-140124469915056/0.log"
Jul 09 01:34:32.645324 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:32.645288    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-792kw\" (UniqueName: \"kubernetes.io/projected/cc28fc62-3061-4233-92cb-544f63c21916-kube-api-access-792kw\") pod \"cc28fc62-3061-4233-92cb-544f63c21916\" (UID: \"cc28fc62-3061-4233-92cb-544f63c21916\") "
Jul 09 01:34:32.647533 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:32.647495    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc28fc62-3061-4233-92cb-544f63c21916-kube-api-access-792kw" (OuterVolumeSpecName: "kube-api-access-792kw") pod "cc28fc62-3061-4233-92cb-544f63c21916" (UID: "cc28fc62-3061-4233-92cb-544f63c21916"). InnerVolumeSpecName "kube-api-access-792kw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:34:32.652252 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:32.652224    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7700-140124469915056"]
Jul 09 01:34:32.656145 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:32.656124    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7700-140124469915056"]
Jul 09 01:34:32.746913 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:32.746881    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-792kw\" (UniqueName: \"kubernetes.io/projected/cc28fc62-3061-4233-92cb-544f63c21916-kube-api-access-792kw\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:34:32.773641 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:32.773607    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7700-140124469915696"]
Jul 09 01:34:32.774042 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:32.774029    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc28fc62-3061-4233-92cb-544f63c21916" containerName="test-curl-7700-140124469915056"
Jul 09 01:34:32.774102 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:32.774043    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc28fc62-3061-4233-92cb-544f63c21916" containerName="test-curl-7700-140124469915056"
Jul 09 01:34:32.774139 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:32.774117    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc28fc62-3061-4233-92cb-544f63c21916" containerName="test-curl-7700-140124469915056"
Jul 09 01:34:32.777127 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:32.777111    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124469915696"
Jul 09 01:34:32.783380 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:32.783351    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7700-140124469915696"]
Jul 09 01:34:32.848429 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:32.848396    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxtzg\" (UniqueName: \"kubernetes.io/projected/0cc6c785-27ae-4ed1-9292-9cfcc5721d63-kube-api-access-xxtzg\") pod \"test-curl-7700-140124469915696\" (UID: \"0cc6c785-27ae-4ed1-9292-9cfcc5721d63\") " pod="openshift-ingress/test-curl-7700-140124469915696"
Jul 09 01:34:32.950089 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:32.950037    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxtzg\" (UniqueName: \"kubernetes.io/projected/0cc6c785-27ae-4ed1-9292-9cfcc5721d63-kube-api-access-xxtzg\") pod \"test-curl-7700-140124469915696\" (UID: \"0cc6c785-27ae-4ed1-9292-9cfcc5721d63\") " pod="openshift-ingress/test-curl-7700-140124469915696"
Jul 09 01:34:32.958412 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:32.958388    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxtzg\" (UniqueName: \"kubernetes.io/projected/0cc6c785-27ae-4ed1-9292-9cfcc5721d63-kube-api-access-xxtzg\") pod \"test-curl-7700-140124469915696\" (UID: \"0cc6c785-27ae-4ed1-9292-9cfcc5721d63\") " pod="openshift-ingress/test-curl-7700-140124469915696"
Jul 09 01:34:33.087268 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:33.087138    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124469915696"
Jul 09 01:34:33.227266 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:33.227235    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7700-140124469915696"]
Jul 09 01:34:33.228109 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:34:33.228084    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0cc6c785_27ae_4ed1_9292_9cfcc5721d63.slice/crio-c3b25ccf4bd57104d16ffaef3a1455e53c2e9010af10e90186b2a4c692a74242 WatchSource:0}: Error finding container c3b25ccf4bd57104d16ffaef3a1455e53c2e9010af10e90186b2a4c692a74242: Status 404 returned error can't find the container with id c3b25ccf4bd57104d16ffaef3a1455e53c2e9010af10e90186b2a4c692a74242
Jul 09 01:34:33.449784 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:33.449692    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7700-140124469915696" event={"ID":"0cc6c785-27ae-4ed1-9292-9cfcc5721d63","Type":"ContainerStarted","Data":"c3b25ccf4bd57104d16ffaef3a1455e53c2e9010af10e90186b2a4c692a74242"}
Jul 09 01:34:33.450872 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:33.450849    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae512890593fe112edd6ea5d6869e230584a199d2cc916998a15ba1cb6cf2030"
Jul 09 01:34:33.450872 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:33.450859    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124469915056"
Jul 09 01:34:33.464162 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:34:33.464135    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7700-140124469915056\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="cc28fc62-3061-4233-92cb-544f63c21916" pod="openshift-ingress/test-curl-7700-140124469915056"
Jul 09 01:34:33.507364 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:33.507336    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc28fc62-3061-4233-92cb-544f63c21916" path="/var/lib/kubelet/pods/cc28fc62-3061-4233-92cb-544f63c21916/volumes"
Jul 09 01:34:34.457628 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:34.457593    2565 generic.go:356] "Generic (PLEG): container finished" podID="0cc6c785-27ae-4ed1-9292-9cfcc5721d63" containerID="cb743fb7851efba4ec63f79426d6d07889210712b52a456d6f40734a0f37f37f" exitCode=0
Jul 09 01:34:34.457988 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:34.457680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7700-140124469915696" event={"ID":"0cc6c785-27ae-4ed1-9292-9cfcc5721d63","Type":"ContainerDied","Data":"cb743fb7851efba4ec63f79426d6d07889210712b52a456d6f40734a0f37f37f"}
Jul 09 01:34:35.610551 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:35.610524    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124469915696"
Jul 09 01:34:35.628028 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:35.627994    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7700-140124469915696_0cc6c785-27ae-4ed1-9292-9cfcc5721d63/test-curl-7700-140124469915696/0.log"
Jul 09 01:34:35.651551 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:35.651498    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7700-140124469915696"]
Jul 09 01:34:35.654540 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:35.654513    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7700-140124469915696"]
Jul 09 01:34:35.678493 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:35.678467    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxtzg\" (UniqueName: \"kubernetes.io/projected/0cc6c785-27ae-4ed1-9292-9cfcc5721d63-kube-api-access-xxtzg\") pod \"0cc6c785-27ae-4ed1-9292-9cfcc5721d63\" (UID: \"0cc6c785-27ae-4ed1-9292-9cfcc5721d63\") "
Jul 09 01:34:35.680542 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:35.680511    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cc6c785-27ae-4ed1-9292-9cfcc5721d63-kube-api-access-xxtzg" (OuterVolumeSpecName: "kube-api-access-xxtzg") pod "0cc6c785-27ae-4ed1-9292-9cfcc5721d63" (UID: "0cc6c785-27ae-4ed1-9292-9cfcc5721d63"). InnerVolumeSpecName "kube-api-access-xxtzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:34:35.779744 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:35.779707    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxtzg\" (UniqueName: \"kubernetes.io/projected/0cc6c785-27ae-4ed1-9292-9cfcc5721d63-kube-api-access-xxtzg\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:34:35.853576 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:35.853534    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7700-140124472305536"]
Jul 09 01:34:35.854047 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:35.854029    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cc6c785-27ae-4ed1-9292-9cfcc5721d63" containerName="test-curl-7700-140124469915696"
Jul 09 01:34:35.854140 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:35.854050    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cc6c785-27ae-4ed1-9292-9cfcc5721d63" containerName="test-curl-7700-140124469915696"
Jul 09 01:34:35.854194 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:35.854164    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cc6c785-27ae-4ed1-9292-9cfcc5721d63" containerName="test-curl-7700-140124469915696"
Jul 09 01:34:35.857470 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:35.857447    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124472305536"
Jul 09 01:34:35.862623 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:35.862589    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7700-140124472305536"]
Jul 09 01:34:35.981535 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:35.981501    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vnwp\" (UniqueName: \"kubernetes.io/projected/aa0f91af-dfe8-43f8-b1be-552de16f1d4c-kube-api-access-2vnwp\") pod \"test-curl-7700-140124472305536\" (UID: \"aa0f91af-dfe8-43f8-b1be-552de16f1d4c\") " pod="openshift-ingress/test-curl-7700-140124472305536"
Jul 09 01:34:36.082993 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:36.082889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vnwp\" (UniqueName: \"kubernetes.io/projected/aa0f91af-dfe8-43f8-b1be-552de16f1d4c-kube-api-access-2vnwp\") pod \"test-curl-7700-140124472305536\" (UID: \"aa0f91af-dfe8-43f8-b1be-552de16f1d4c\") " pod="openshift-ingress/test-curl-7700-140124472305536"
Jul 09 01:34:36.091009 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:36.090975    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vnwp\" (UniqueName: \"kubernetes.io/projected/aa0f91af-dfe8-43f8-b1be-552de16f1d4c-kube-api-access-2vnwp\") pod \"test-curl-7700-140124472305536\" (UID: \"aa0f91af-dfe8-43f8-b1be-552de16f1d4c\") " pod="openshift-ingress/test-curl-7700-140124472305536"
Jul 09 01:34:36.169145 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:36.169089    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124472305536"
Jul 09 01:34:36.308221 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:36.308184    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7700-140124472305536"]
Jul 09 01:34:36.309388 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:34:36.309359    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa0f91af_dfe8_43f8_b1be_552de16f1d4c.slice/crio-9c12ca5a183d99da5c35d6daeb2d7e45691c48b3353df09b524ce6f897ef281c WatchSource:0}: Error finding container 9c12ca5a183d99da5c35d6daeb2d7e45691c48b3353df09b524ce6f897ef281c: Status 404 returned error can't find the container with id 9c12ca5a183d99da5c35d6daeb2d7e45691c48b3353df09b524ce6f897ef281c
Jul 09 01:34:36.471182 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:36.471146    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124469915696"
Jul 09 01:34:36.471182 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:36.471173    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3b25ccf4bd57104d16ffaef3a1455e53c2e9010af10e90186b2a4c692a74242"
Jul 09 01:34:36.472442 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:36.472406    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7700-140124472305536" event={"ID":"aa0f91af-dfe8-43f8-b1be-552de16f1d4c","Type":"ContainerStarted","Data":"9c12ca5a183d99da5c35d6daeb2d7e45691c48b3353df09b524ce6f897ef281c"}
Jul 09 01:34:36.481543 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:34:36.481519    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7700-140124469915696\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="0cc6c785-27ae-4ed1-9292-9cfcc5721d63" pod="openshift-ingress/test-curl-7700-140124469915696"
Jul 09 01:34:37.480734 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:37.480698    2565 generic.go:356] "Generic (PLEG): container finished" podID="aa0f91af-dfe8-43f8-b1be-552de16f1d4c" containerID="6622c999e61a078ab2385b5fbfa8b4bd1bb8e79caf6a60a8774f587f9562971a" exitCode=0
Jul 09 01:34:37.481188 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:37.480783    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7700-140124472305536" event={"ID":"aa0f91af-dfe8-43f8-b1be-552de16f1d4c","Type":"ContainerDied","Data":"6622c999e61a078ab2385b5fbfa8b4bd1bb8e79caf6a60a8774f587f9562971a"}
Jul 09 01:34:37.495485 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:34:37.495448    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7700-140124469915696\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="0cc6c785-27ae-4ed1-9292-9cfcc5721d63" pod="openshift-ingress/test-curl-7700-140124469915696"
Jul 09 01:34:37.506817 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:37.506789    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cc6c785-27ae-4ed1-9292-9cfcc5721d63" path="/var/lib/kubelet/pods/0cc6c785-27ae-4ed1-9292-9cfcc5721d63/volumes"
Jul 09 01:34:38.641292 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:38.641266    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124472305536"
Jul 09 01:34:38.659106 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:38.659069    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7700-140124472305536_aa0f91af-dfe8-43f8-b1be-552de16f1d4c/test-curl-7700-140124472305536/0.log"
Jul 09 01:34:38.685061 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:38.685029    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7700-140124472305536"]
Jul 09 01:34:38.689536 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:38.689507    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7700-140124472305536"]
Jul 09 01:34:38.707107 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:38.707074    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vnwp\" (UniqueName: \"kubernetes.io/projected/aa0f91af-dfe8-43f8-b1be-552de16f1d4c-kube-api-access-2vnwp\") pod \"aa0f91af-dfe8-43f8-b1be-552de16f1d4c\" (UID: \"aa0f91af-dfe8-43f8-b1be-552de16f1d4c\") "
Jul 09 01:34:38.709178 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:38.709145    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa0f91af-dfe8-43f8-b1be-552de16f1d4c-kube-api-access-2vnwp" (OuterVolumeSpecName: "kube-api-access-2vnwp") pod "aa0f91af-dfe8-43f8-b1be-552de16f1d4c" (UID: "aa0f91af-dfe8-43f8-b1be-552de16f1d4c"). InnerVolumeSpecName "kube-api-access-2vnwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:34:38.801960 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:38.801921    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7700-140124472305536"]
Jul 09 01:34:38.802384 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:38.802359    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa0f91af-dfe8-43f8-b1be-552de16f1d4c" containerName="test-curl-7700-140124472305536"
Jul 09 01:34:38.802384 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:38.802386    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa0f91af-dfe8-43f8-b1be-552de16f1d4c" containerName="test-curl-7700-140124472305536"
Jul 09 01:34:38.802477 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:38.802465    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa0f91af-dfe8-43f8-b1be-552de16f1d4c" containerName="test-curl-7700-140124472305536"
Jul 09 01:34:38.805389 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:38.805373    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124472305536"
Jul 09 01:34:38.807939 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:38.807917    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vnwp\" (UniqueName: \"kubernetes.io/projected/aa0f91af-dfe8-43f8-b1be-552de16f1d4c-kube-api-access-2vnwp\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:34:38.813793 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:38.813486    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7700-140124472305536"]
Jul 09 01:34:38.908959 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:38.908922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9npd\" (UniqueName: \"kubernetes.io/projected/62d89364-419a-4628-9f40-2f98387425bb-kube-api-access-g9npd\") pod \"test-curl-7700-140124472305536\" (UID: \"62d89364-419a-4628-9f40-2f98387425bb\") " pod="openshift-ingress/test-curl-7700-140124472305536"
Jul 09 01:34:39.010037 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:39.009987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9npd\" (UniqueName: \"kubernetes.io/projected/62d89364-419a-4628-9f40-2f98387425bb-kube-api-access-g9npd\") pod \"test-curl-7700-140124472305536\" (UID: \"62d89364-419a-4628-9f40-2f98387425bb\") " pod="openshift-ingress/test-curl-7700-140124472305536"
Jul 09 01:34:39.017328 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:39.017300    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9npd\" (UniqueName: \"kubernetes.io/projected/62d89364-419a-4628-9f40-2f98387425bb-kube-api-access-g9npd\") pod \"test-curl-7700-140124472305536\" (UID: \"62d89364-419a-4628-9f40-2f98387425bb\") " pod="openshift-ingress/test-curl-7700-140124472305536"
Jul 09 01:34:39.116319 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:39.116225    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124472305536"
Jul 09 01:34:39.254541 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:39.254517    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7700-140124472305536"]
Jul 09 01:34:39.256514 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:34:39.256483    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62d89364_419a_4628_9f40_2f98387425bb.slice/crio-2d41a3da09965029fd37bd66b04db24c0279c6b92e915bf38f36ac8dec46bb22 WatchSource:0}: Error finding container 2d41a3da09965029fd37bd66b04db24c0279c6b92e915bf38f36ac8dec46bb22: Status 404 returned error can't find the container with id 2d41a3da09965029fd37bd66b04db24c0279c6b92e915bf38f36ac8dec46bb22
Jul 09 01:34:39.493575 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:39.493545    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124472305536"
Jul 09 01:34:39.493575 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:39.493560    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c12ca5a183d99da5c35d6daeb2d7e45691c48b3353df09b524ce6f897ef281c"
Jul 09 01:34:39.494764 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:39.494738    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7700-140124472305536" event={"ID":"62d89364-419a-4628-9f40-2f98387425bb","Type":"ContainerStarted","Data":"2d41a3da09965029fd37bd66b04db24c0279c6b92e915bf38f36ac8dec46bb22"}
Jul 09 01:34:39.505994 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:39.505957    2565 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7700-140124472305536" oldPodUID="aa0f91af-dfe8-43f8-b1be-552de16f1d4c" podUID="62d89364-419a-4628-9f40-2f98387425bb"
Jul 09 01:34:39.507121 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:39.507101    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa0f91af-dfe8-43f8-b1be-552de16f1d4c" path="/var/lib/kubelet/pods/aa0f91af-dfe8-43f8-b1be-552de16f1d4c/volumes"
Jul 09 01:34:40.502376 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:40.502337    2565 generic.go:356] "Generic (PLEG): container finished" podID="62d89364-419a-4628-9f40-2f98387425bb" containerID="5328b01c790408514981f0760357320ce2a30a29662b719ec6409ae9f6189122" exitCode=0
Jul 09 01:34:40.502749 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:40.502417    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7700-140124472305536" event={"ID":"62d89364-419a-4628-9f40-2f98387425bb","Type":"ContainerDied","Data":"5328b01c790408514981f0760357320ce2a30a29662b719ec6409ae9f6189122"}
Jul 09 01:34:41.660345 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:41.660313    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124472305536"
Jul 09 01:34:41.678479 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:41.678446    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7700-140124472305536_62d89364-419a-4628-9f40-2f98387425bb/test-curl-7700-140124472305536/0.log"
Jul 09 01:34:41.703954 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:41.703914    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7700-140124472305536"]
Jul 09 01:34:41.706598 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:41.706568    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7700-140124472305536"]
Jul 09 01:34:41.737958 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:41.737932    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9npd\" (UniqueName: \"kubernetes.io/projected/62d89364-419a-4628-9f40-2f98387425bb-kube-api-access-g9npd\") pod \"62d89364-419a-4628-9f40-2f98387425bb\" (UID: \"62d89364-419a-4628-9f40-2f98387425bb\") "
Jul 09 01:34:41.740148 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:41.740118    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62d89364-419a-4628-9f40-2f98387425bb-kube-api-access-g9npd" (OuterVolumeSpecName: "kube-api-access-g9npd") pod "62d89364-419a-4628-9f40-2f98387425bb" (UID: "62d89364-419a-4628-9f40-2f98387425bb"). InnerVolumeSpecName "kube-api-access-g9npd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:34:41.834373 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:41.834287    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7700-140124470191856"]
Jul 09 01:34:41.834744 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:41.834732    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d89364-419a-4628-9f40-2f98387425bb" containerName="test-curl-7700-140124472305536"
Jul 09 01:34:41.834788 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:41.834747    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d89364-419a-4628-9f40-2f98387425bb" containerName="test-curl-7700-140124472305536"
Jul 09 01:34:41.834823 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:41.834811    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="62d89364-419a-4628-9f40-2f98387425bb" containerName="test-curl-7700-140124472305536"
Jul 09 01:34:41.838025 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:41.838006    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124470191856"
Jul 09 01:34:41.838799 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:41.838777    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9npd\" (UniqueName: \"kubernetes.io/projected/62d89364-419a-4628-9f40-2f98387425bb-kube-api-access-g9npd\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:34:41.844583 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:41.844530    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7700-140124470191856"]
Jul 09 01:34:41.939436 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:41.939407    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq2zv\" (UniqueName: \"kubernetes.io/projected/682dc6c3-4394-400b-a360-c55a1f8b35d4-kube-api-access-sq2zv\") pod \"test-curl-7700-140124470191856\" (UID: \"682dc6c3-4394-400b-a360-c55a1f8b35d4\") " pod="openshift-ingress/test-curl-7700-140124470191856"
Jul 09 01:34:42.040159 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:42.040118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq2zv\" (UniqueName: \"kubernetes.io/projected/682dc6c3-4394-400b-a360-c55a1f8b35d4-kube-api-access-sq2zv\") pod \"test-curl-7700-140124470191856\" (UID: \"682dc6c3-4394-400b-a360-c55a1f8b35d4\") " pod="openshift-ingress/test-curl-7700-140124470191856"
Jul 09 01:34:42.047845 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:42.047818    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq2zv\" (UniqueName: \"kubernetes.io/projected/682dc6c3-4394-400b-a360-c55a1f8b35d4-kube-api-access-sq2zv\") pod \"test-curl-7700-140124470191856\" (UID: \"682dc6c3-4394-400b-a360-c55a1f8b35d4\") " pod="openshift-ingress/test-curl-7700-140124470191856"
Jul 09 01:34:42.148942 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:42.148850    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124470191856"
Jul 09 01:34:42.287090 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:42.287061    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7700-140124470191856"]
Jul 09 01:34:42.287886 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:34:42.287850    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod682dc6c3_4394_400b_a360_c55a1f8b35d4.slice/crio-584727e0bde128cfc83a44fea1cf4fb734a3e5dc5fa9f076f92e72e7f3a21cff WatchSource:0}: Error finding container 584727e0bde128cfc83a44fea1cf4fb734a3e5dc5fa9f076f92e72e7f3a21cff: Status 404 returned error can't find the container with id 584727e0bde128cfc83a44fea1cf4fb734a3e5dc5fa9f076f92e72e7f3a21cff
Jul 09 01:34:42.515897 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:42.515866    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d41a3da09965029fd37bd66b04db24c0279c6b92e915bf38f36ac8dec46bb22"
Jul 09 01:34:42.515897 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:42.515873    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124472305536"
Jul 09 01:34:42.517162 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:42.517133    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7700-140124470191856" event={"ID":"682dc6c3-4394-400b-a360-c55a1f8b35d4","Type":"ContainerStarted","Data":"584727e0bde128cfc83a44fea1cf4fb734a3e5dc5fa9f076f92e72e7f3a21cff"}
Jul 09 01:34:42.526494 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:34:42.526464    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7700-140124472305536\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="62d89364-419a-4628-9f40-2f98387425bb" pod="openshift-ingress/test-curl-7700-140124472305536"
Jul 09 01:34:43.066025 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.065983    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz" podUID="f628e0cf-d212-4b25-96d4-a18119dbfe90" containerName="main" containerID="cri-o://eda4a9d671566b93b64b054f45e0ca3afbff16f7a08fc060300881ea898a8268" gracePeriod=45
Jul 09 01:34:43.329387 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.329323    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:34:43.331309 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:34:43.331278    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7700-140124472305536\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="62d89364-419a-4628-9f40-2f98387425bb" pod="openshift-ingress/test-curl-7700-140124472305536"
Jul 09 01:34:43.457437 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.457389    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-home\") pod \"f628e0cf-d212-4b25-96d4-a18119dbfe90\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") "
Jul 09 01:34:43.457610 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.457548    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-tmp-dir\") pod \"f628e0cf-d212-4b25-96d4-a18119dbfe90\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") "
Jul 09 01:34:43.457610 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.457582    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-dshm\") pod \"f628e0cf-d212-4b25-96d4-a18119dbfe90\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") "
Jul 09 01:34:43.457747 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.457646    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-model-cache\") pod \"f628e0cf-d212-4b25-96d4-a18119dbfe90\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") "
Jul 09 01:34:43.457747 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.457677    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzpch\" (UniqueName: \"kubernetes.io/projected/f628e0cf-d212-4b25-96d4-a18119dbfe90-kube-api-access-pzpch\") pod \"f628e0cf-d212-4b25-96d4-a18119dbfe90\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") "
Jul 09 01:34:43.457747 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.457702    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-home" (OuterVolumeSpecName: "home") pod "f628e0cf-d212-4b25-96d4-a18119dbfe90" (UID: "f628e0cf-d212-4b25-96d4-a18119dbfe90"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:34:43.457896 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.457715    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f628e0cf-d212-4b25-96d4-a18119dbfe90-tls-certs\") pod \"f628e0cf-d212-4b25-96d4-a18119dbfe90\" (UID: \"f628e0cf-d212-4b25-96d4-a18119dbfe90\") "
Jul 09 01:34:43.457896 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.457785    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f628e0cf-d212-4b25-96d4-a18119dbfe90" (UID: "f628e0cf-d212-4b25-96d4-a18119dbfe90"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:34:43.458089 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.458057    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-tmp-dir\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:34:43.458089 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.458089    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-home\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:34:43.458308 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.458284    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-model-cache" (OuterVolumeSpecName: "model-cache") pod "f628e0cf-d212-4b25-96d4-a18119dbfe90" (UID: "f628e0cf-d212-4b25-96d4-a18119dbfe90"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:34:43.459752 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.459731    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-dshm" (OuterVolumeSpecName: "dshm") pod "f628e0cf-d212-4b25-96d4-a18119dbfe90" (UID: "f628e0cf-d212-4b25-96d4-a18119dbfe90"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 01:34:43.460181 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.460166    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f628e0cf-d212-4b25-96d4-a18119dbfe90-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f628e0cf-d212-4b25-96d4-a18119dbfe90" (UID: "f628e0cf-d212-4b25-96d4-a18119dbfe90"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 01:34:43.460259 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.460197    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f628e0cf-d212-4b25-96d4-a18119dbfe90-kube-api-access-pzpch" (OuterVolumeSpecName: "kube-api-access-pzpch") pod "f628e0cf-d212-4b25-96d4-a18119dbfe90" (UID: "f628e0cf-d212-4b25-96d4-a18119dbfe90"). InnerVolumeSpecName "kube-api-access-pzpch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:34:43.506228 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.506188    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62d89364-419a-4628-9f40-2f98387425bb" path="/var/lib/kubelet/pods/62d89364-419a-4628-9f40-2f98387425bb/volumes"
Jul 09 01:34:43.524654 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.524625    2565 generic.go:356] "Generic (PLEG): container finished" podID="682dc6c3-4394-400b-a360-c55a1f8b35d4" containerID="fa13ea23abcd4bedcdccbf9801bb8f230f1b947ba3e5b3fec2b59359ecd35a27" exitCode=0
Jul 09 01:34:43.524797 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.524711    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7700-140124470191856" event={"ID":"682dc6c3-4394-400b-a360-c55a1f8b35d4","Type":"ContainerDied","Data":"fa13ea23abcd4bedcdccbf9801bb8f230f1b947ba3e5b3fec2b59359ecd35a27"}
Jul 09 01:34:43.525973 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.525950    2565 generic.go:356] "Generic (PLEG): container finished" podID="f628e0cf-d212-4b25-96d4-a18119dbfe90" containerID="eda4a9d671566b93b64b054f45e0ca3afbff16f7a08fc060300881ea898a8268" exitCode=0
Jul 09 01:34:43.526050 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.525990    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"
Jul 09 01:34:43.526050 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.526029    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz" event={"ID":"f628e0cf-d212-4b25-96d4-a18119dbfe90","Type":"ContainerDied","Data":"eda4a9d671566b93b64b054f45e0ca3afbff16f7a08fc060300881ea898a8268"}
Jul 09 01:34:43.526119 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.526065    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz" event={"ID":"f628e0cf-d212-4b25-96d4-a18119dbfe90","Type":"ContainerDied","Data":"2979a457c43ba512b6120fb8388b97cf465c3b13112d60f4984760d5e2406a74"}
Jul 09 01:34:43.526119 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.526081    2565 scope.go:117] "RemoveContainer" containerID="eda4a9d671566b93b64b054f45e0ca3afbff16f7a08fc060300881ea898a8268"
Jul 09 01:34:43.535186 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.535157    2565 scope.go:117] "RemoveContainer" containerID="eda4a9d671566b93b64b054f45e0ca3afbff16f7a08fc060300881ea898a8268"
Jul 09 01:34:43.535465 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:34:43.535445    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eda4a9d671566b93b64b054f45e0ca3afbff16f7a08fc060300881ea898a8268\": container with ID starting with eda4a9d671566b93b64b054f45e0ca3afbff16f7a08fc060300881ea898a8268 not found: ID does not exist" containerID="eda4a9d671566b93b64b054f45e0ca3afbff16f7a08fc060300881ea898a8268"
Jul 09 01:34:43.535511 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.535474    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eda4a9d671566b93b64b054f45e0ca3afbff16f7a08fc060300881ea898a8268"} err="failed to get container status \"eda4a9d671566b93b64b054f45e0ca3afbff16f7a08fc060300881ea898a8268\": rpc error: code = NotFound desc = could not find container \"eda4a9d671566b93b64b054f45e0ca3afbff16f7a08fc060300881ea898a8268\": container with ID starting with eda4a9d671566b93b64b054f45e0ca3afbff16f7a08fc060300881ea898a8268 not found: ID does not exist"
Jul 09 01:34:43.552192 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.552158    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"]
Jul 09 01:34:43.557390 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.557363    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-88a238/rate-test-model-88a238-kserve-6755b59759-chqqz"]
Jul 09 01:34:43.559393 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.559371    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f628e0cf-d212-4b25-96d4-a18119dbfe90-tls-certs\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:34:43.559477 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.559395    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-dshm\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:34:43.559477 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.559407    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f628e0cf-d212-4b25-96d4-a18119dbfe90-model-cache\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:34:43.559477 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:43.559418    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzpch\" (UniqueName: \"kubernetes.io/projected/f628e0cf-d212-4b25-96d4-a18119dbfe90-kube-api-access-pzpch\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:34:44.692248 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:44.692191    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124470191856"
Jul 09 01:34:44.709529 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:44.709477    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7700-140124470191856_682dc6c3-4394-400b-a360-c55a1f8b35d4/test-curl-7700-140124470191856/0.log"
Jul 09 01:34:44.731444 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:44.731415    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7700-140124470191856"]
Jul 09 01:34:44.733912 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:44.733892    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7700-140124470191856"]
Jul 09 01:34:44.772951 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:44.772908    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sq2zv\" (UniqueName: \"kubernetes.io/projected/682dc6c3-4394-400b-a360-c55a1f8b35d4-kube-api-access-sq2zv\") pod \"682dc6c3-4394-400b-a360-c55a1f8b35d4\" (UID: \"682dc6c3-4394-400b-a360-c55a1f8b35d4\") "
Jul 09 01:34:44.775035 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:44.775004    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/682dc6c3-4394-400b-a360-c55a1f8b35d4-kube-api-access-sq2zv" (OuterVolumeSpecName: "kube-api-access-sq2zv") pod "682dc6c3-4394-400b-a360-c55a1f8b35d4" (UID: "682dc6c3-4394-400b-a360-c55a1f8b35d4"). InnerVolumeSpecName "kube-api-access-sq2zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:34:44.870512 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:44.870422    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7700-140124470191856"]
Jul 09 01:34:44.870930 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:44.870911    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="682dc6c3-4394-400b-a360-c55a1f8b35d4" containerName="test-curl-7700-140124470191856"
Jul 09 01:34:44.871009 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:44.870933    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="682dc6c3-4394-400b-a360-c55a1f8b35d4" containerName="test-curl-7700-140124470191856"
Jul 09 01:34:44.871009 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:44.870963    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f628e0cf-d212-4b25-96d4-a18119dbfe90" containerName="main"
Jul 09 01:34:44.871009 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:44.870972    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f628e0cf-d212-4b25-96d4-a18119dbfe90" containerName="main"
Jul 09 01:34:44.871164 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:44.871097    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="682dc6c3-4394-400b-a360-c55a1f8b35d4" containerName="test-curl-7700-140124470191856"
Jul 09 01:34:44.871164 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:44.871111    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f628e0cf-d212-4b25-96d4-a18119dbfe90" containerName="main"
Jul 09 01:34:44.874195 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:44.874168    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sq2zv\" (UniqueName: \"kubernetes.io/projected/682dc6c3-4394-400b-a360-c55a1f8b35d4-kube-api-access-sq2zv\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:34:44.874314 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:44.874266    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124470191856"
Jul 09 01:34:44.892203 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:44.892171    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7700-140124470191856"]
Jul 09 01:34:44.975488 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:44.975452    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p879\" (UniqueName: \"kubernetes.io/projected/4384c446-96c2-431e-94a0-429d9aca9a7b-kube-api-access-2p879\") pod \"test-curl-7700-140124470191856\" (UID: \"4384c446-96c2-431e-94a0-429d9aca9a7b\") " pod="openshift-ingress/test-curl-7700-140124470191856"
Jul 09 01:34:45.076555 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:45.076518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p879\" (UniqueName: \"kubernetes.io/projected/4384c446-96c2-431e-94a0-429d9aca9a7b-kube-api-access-2p879\") pod \"test-curl-7700-140124470191856\" (UID: \"4384c446-96c2-431e-94a0-429d9aca9a7b\") " pod="openshift-ingress/test-curl-7700-140124470191856"
Jul 09 01:34:45.087416 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:45.087387    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p879\" (UniqueName: \"kubernetes.io/projected/4384c446-96c2-431e-94a0-429d9aca9a7b-kube-api-access-2p879\") pod \"test-curl-7700-140124470191856\" (UID: \"4384c446-96c2-431e-94a0-429d9aca9a7b\") " pod="openshift-ingress/test-curl-7700-140124470191856"
Jul 09 01:34:45.183670 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:45.183580    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124470191856"
Jul 09 01:34:45.322285 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:45.322257    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7700-140124470191856"]
Jul 09 01:34:45.324122 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:34:45.324098    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4384c446_96c2_431e_94a0_429d9aca9a7b.slice/crio-a26452cb631a009e1314c49c644ddc5c194eedcef484d5f64047c6e4b1a49c29 WatchSource:0}: Error finding container a26452cb631a009e1314c49c644ddc5c194eedcef484d5f64047c6e4b1a49c29: Status 404 returned error can't find the container with id a26452cb631a009e1314c49c644ddc5c194eedcef484d5f64047c6e4b1a49c29
Jul 09 01:34:45.507047 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:45.507005    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="682dc6c3-4394-400b-a360-c55a1f8b35d4" path="/var/lib/kubelet/pods/682dc6c3-4394-400b-a360-c55a1f8b35d4/volumes"
Jul 09 01:34:45.507536 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:45.507515    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f628e0cf-d212-4b25-96d4-a18119dbfe90" path="/var/lib/kubelet/pods/f628e0cf-d212-4b25-96d4-a18119dbfe90/volumes"
Jul 09 01:34:45.541021 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:45.540987    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7700-140124470191856" event={"ID":"4384c446-96c2-431e-94a0-429d9aca9a7b","Type":"ContainerStarted","Data":"a26452cb631a009e1314c49c644ddc5c194eedcef484d5f64047c6e4b1a49c29"}
Jul 09 01:34:45.542423 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:45.542400    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124470191856"
Jul 09 01:34:45.542553 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:45.542424    2565 scope.go:117] "RemoveContainer" containerID="fa13ea23abcd4bedcdccbf9801bb8f230f1b947ba3e5b3fec2b59359ecd35a27"
Jul 09 01:34:46.550082 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:46.550039    2565 generic.go:356] "Generic (PLEG): container finished" podID="4384c446-96c2-431e-94a0-429d9aca9a7b" containerID="523f4daf9e046060b6b109f0093b5432e9ae4193c3578bbbf37fa667dd2cb2bb" exitCode=0
Jul 09 01:34:46.550592 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:46.550129    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7700-140124470191856" event={"ID":"4384c446-96c2-431e-94a0-429d9aca9a7b","Type":"ContainerDied","Data":"523f4daf9e046060b6b109f0093b5432e9ae4193c3578bbbf37fa667dd2cb2bb"}
Jul 09 01:34:47.707973 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:47.707949    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124470191856"
Jul 09 01:34:47.726515 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:47.726481    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7700-140124470191856_4384c446-96c2-431e-94a0-429d9aca9a7b/test-curl-7700-140124470191856/0.log"
Jul 09 01:34:47.747482 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:47.747440    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7700-140124470191856"]
Jul 09 01:34:47.751237 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:47.751199    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7700-140124470191856"]
Jul 09 01:34:47.803531 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:47.803496    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2p879\" (UniqueName: \"kubernetes.io/projected/4384c446-96c2-431e-94a0-429d9aca9a7b-kube-api-access-2p879\") pod \"4384c446-96c2-431e-94a0-429d9aca9a7b\" (UID: \"4384c446-96c2-431e-94a0-429d9aca9a7b\") "
Jul 09 01:34:47.805621 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:47.805586    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4384c446-96c2-431e-94a0-429d9aca9a7b-kube-api-access-2p879" (OuterVolumeSpecName: "kube-api-access-2p879") pod "4384c446-96c2-431e-94a0-429d9aca9a7b" (UID: "4384c446-96c2-431e-94a0-429d9aca9a7b"). InnerVolumeSpecName "kube-api-access-2p879". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 01:34:47.905535 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:47.905495    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2p879\" (UniqueName: \"kubernetes.io/projected/4384c446-96c2-431e-94a0-429d9aca9a7b-kube-api-access-2p879\") on node \"ip-10-0-134-227.ec2.internal\" DevicePath \"\""
Jul 09 01:34:48.566681 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:48.566648    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a26452cb631a009e1314c49c644ddc5c194eedcef484d5f64047c6e4b1a49c29"
Jul 09 01:34:48.566681 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:48.566650    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7700-140124470191856"
Jul 09 01:34:48.576649 ip-10-0-134-227 kubenswrapper[2565]: E0709 01:34:48.576618    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7700-140124470191856\" is forbidden: User \"system:node:ip-10-0-134-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-227.ec2.internal' and this object" podUID="4384c446-96c2-431e-94a0-429d9aca9a7b" pod="openshift-ingress/test-curl-7700-140124470191856"
Jul 09 01:34:49.507327 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:34:49.507295    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4384c446-96c2-431e-94a0-429d9aca9a7b" path="/var/lib/kubelet/pods/4384c446-96c2-431e-94a0-429d9aca9a7b/volumes"
Jul 09 01:35:02.215871 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:02.215835    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c5f9f5fdd-5g645_34fc5a3a-4443-46d0-92c6-b430b885315f/authorino/0.log"
Jul 09 01:35:07.283003 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:07.282964    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c89db8b46-scgq7_014b31d7-7f20-4a5e-86d6-65ecb380a2d8/manager/0.log"
Jul 09 01:35:07.387764 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:07.387735    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-m9bgh_a4e85460-41a3-43e3-a960-e080183b6a87/server/0.log"
Jul 09 01:35:07.505123 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:07.505091    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bm452_61f2de59-b173-49be-9f17-28f0eb661091/manager/0.log"
Jul 09 01:35:07.882691 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:07.882661    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85699f56b9-tt2xl_ef98fd89-f041-420d-9447-31ec62d8fefb/copy-manifests/0.log"
Jul 09 01:35:07.889239 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:07.889202    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85699f56b9-tt2xl_ef98fd89-f041-420d-9447-31ec62d8fefb/manager/0.log"
Jul 09 01:35:08.235334 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:08.235235    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6987d8886-ng82l_a7b097f5-1877-453c-bca3-68ea78e7f2a5/maas-api/0.log"
Jul 09 01:35:08.347250 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:08.347201    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-n2qsq_77b9d026-7f3f-40f7-98fe-a16259bbf7d9/postgres/0.log"
Jul 09 01:35:09.124262 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:09.124234    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd_a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7/util/0.log"
Jul 09 01:35:09.134760 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:09.134737    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd_a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7/pull/0.log"
Jul 09 01:35:09.141041 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:09.141015    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd_a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7/extract/0.log"
Jul 09 01:35:09.253195 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:09.253163    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz_a62333e8-afef-40a0-b55f-5d4ac4f51c30/extract/0.log"
Jul 09 01:35:09.259992 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:09.259968    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz_a62333e8-afef-40a0-b55f-5d4ac4f51c30/util/0.log"
Jul 09 01:35:09.266648 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:09.266627    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz_a62333e8-afef-40a0-b55f-5d4ac4f51c30/pull/0.log"
Jul 09 01:35:09.372068 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:09.372037    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt_b5d8ae8f-4a16-4930-a20f-a0badef1f5e3/util/0.log"
Jul 09 01:35:09.378149 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:09.378081    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt_b5d8ae8f-4a16-4930-a20f-a0badef1f5e3/pull/0.log"
Jul 09 01:35:09.383881 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:09.383856    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt_b5d8ae8f-4a16-4930-a20f-a0badef1f5e3/extract/0.log"
Jul 09 01:35:09.502162 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:09.502131    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r_72fc3db9-fce7-4ef6-a7b4-319083194991/util/0.log"
Jul 09 01:35:09.508526 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:09.508497    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r_72fc3db9-fce7-4ef6-a7b4-319083194991/pull/0.log"
Jul 09 01:35:09.515787 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:09.515763    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r_72fc3db9-fce7-4ef6-a7b4-319083194991/extract/0.log"
Jul 09 01:35:09.637149 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:09.637051    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c5f9f5fdd-5g645_34fc5a3a-4443-46d0-92c6-b430b885315f/authorino/0.log"
Jul 09 01:35:09.753317 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:09.753289    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-27fp8_7cf8a3f2-980f-4bc3-89c0-c1a209d35c66/manager/0.log"
Jul 09 01:35:09.868111 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:09.868077    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vvrrj_622792d1-cab6-42cf-9b1c-0b740da0507d/manager/0.log"
Jul 09 01:35:09.981928 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:09.981849    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nxh4t_31b69a16-63dc-4e61-8bbe-6d2c7c02a880/kuadrant-console-plugin/0.log"
Jul 09 01:35:10.109902 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:10.109869    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-d5wj7_894202e1-6dff-439f-970a-a4103d29c493/registry-server/0.log"
Jul 09 01:35:10.234317 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:10.234233    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-478m9_acfa1386-aec0-4f59-8e98-db8c25c69e44/manager/0.log"
Jul 09 01:35:10.463367 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:10.463333    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6mzkh_6cf050b4-fe6f-4113-8230-47c492a431bc/manager/0.log"
Jul 09 01:35:11.140661 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:11.140619    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7556c75c9b-848b5_5b8296be-5aa0-44ed-8285-930b05703c81/kube-auth-proxy/0.log"
Jul 09 01:35:11.266909 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:11.266876    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-5mpgg_1ba4ae3c-07ab-4252-829f-56a0e07337ed/istio-proxy/1.log"
Jul 09 01:35:11.386901 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:11.386862    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-v9n8r_fd0fe6a9-57d4-487d-8e17-54e43f645104/payload-pre-processing/0.log"
Jul 09 01:35:11.506919 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:11.506891    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4cndj_e4b6f609-a070-4d4a-a699-e1815f71687e/payload-processing/0.log"
Jul 09 01:35:11.974949 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:11.974857    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-mz2q8_95966409-5857-4ff0-beb8-b5a6c20d0ad9/main/0.log"
Jul 09 01:35:12.083584 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:12.083549    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-bndz6_d43a308a-2b04-42bd-aa72-d6803711accf/main/0.log"
Jul 09 01:35:12.310220 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:12.310174    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnl8p7_f839b6fe-31e2-46c7-9d8e-95d4115ff65c/main/0.log"
Jul 09 01:35:12.538501 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:12.538472    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-f8ptz_ef60c197-4ce5-4e02-8f27-c5a3d7505732/main/0.log"
Jul 09 01:35:19.236658 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:19.236622    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8vx5f_93c25998-c800-4bf5-90cb-173986d24386/global-pull-secret-syncer/0.log"
Jul 09 01:35:19.354098 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:19.354067    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dfn4c_eb1420ad-db26-449b-8975-78ee8f8b94b8/konnectivity-agent/0.log"
Jul 09 01:35:19.463876 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:19.463844    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-227.ec2.internal_909e8761eb0f31e787ea2b2e42e45455/haproxy/0.log"
Jul 09 01:35:23.763370 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:23.763334    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd_a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7/extract/0.log"
Jul 09 01:35:23.795952 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:23.795918    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd_a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7/util/0.log"
Jul 09 01:35:23.823782 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:23.823749    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5gfd_a833c14c-962c-4d13-8fd0-fdcb5d8ea5a7/pull/0.log"
Jul 09 01:35:23.849806 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:23.849779    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz_a62333e8-afef-40a0-b55f-5d4ac4f51c30/extract/0.log"
Jul 09 01:35:23.879118 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:23.879087    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz_a62333e8-afef-40a0-b55f-5d4ac4f51c30/util/0.log"
Jul 09 01:35:23.900642 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:23.900610    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gftpz_a62333e8-afef-40a0-b55f-5d4ac4f51c30/pull/0.log"
Jul 09 01:35:23.933976 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:23.933950    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt_b5d8ae8f-4a16-4930-a20f-a0badef1f5e3/extract/0.log"
Jul 09 01:35:23.963655 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:23.963624    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt_b5d8ae8f-4a16-4930-a20f-a0badef1f5e3/util/0.log"
Jul 09 01:35:23.983927 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:23.983897    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wbsbt_b5d8ae8f-4a16-4930-a20f-a0badef1f5e3/pull/0.log"
Jul 09 01:35:24.009481 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:24.009455    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r_72fc3db9-fce7-4ef6-a7b4-319083194991/extract/0.log"
Jul 09 01:35:24.029451 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:24.029363    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r_72fc3db9-fce7-4ef6-a7b4-319083194991/util/0.log"
Jul 09 01:35:24.048757 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:24.048728    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jh54r_72fc3db9-fce7-4ef6-a7b4-319083194991/pull/0.log"
Jul 09 01:35:24.591626 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:24.591589    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c5f9f5fdd-5g645_34fc5a3a-4443-46d0-92c6-b430b885315f/authorino/0.log"
Jul 09 01:35:24.624126 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:24.624091    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-27fp8_7cf8a3f2-980f-4bc3-89c0-c1a209d35c66/manager/0.log"
Jul 09 01:35:24.645961 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:24.645927    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vvrrj_622792d1-cab6-42cf-9b1c-0b740da0507d/manager/0.log"
Jul 09 01:35:24.667396 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:24.667366    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nxh4t_31b69a16-63dc-4e61-8bbe-6d2c7c02a880/kuadrant-console-plugin/0.log"
Jul 09 01:35:24.713984 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:24.713950    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-d5wj7_894202e1-6dff-439f-970a-a4103d29c493/registry-server/0.log"
Jul 09 01:35:24.918606 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:24.918508    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-478m9_acfa1386-aec0-4f59-8e98-db8c25c69e44/manager/0.log"
Jul 09 01:35:25.046780 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:25.046744    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6mzkh_6cf050b4-fe6f-4113-8230-47c492a431bc/manager/0.log"
Jul 09 01:35:26.704811 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:26.704728    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a846d095-6946-47c7-b08e-caa445825afa/alertmanager/0.log"
Jul 09 01:35:26.723732 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:26.723703    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a846d095-6946-47c7-b08e-caa445825afa/config-reloader/0.log"
Jul 09 01:35:26.742353 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:26.742319    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a846d095-6946-47c7-b08e-caa445825afa/kube-rbac-proxy-web/0.log"
Jul 09 01:35:26.761868 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:26.761842    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a846d095-6946-47c7-b08e-caa445825afa/kube-rbac-proxy/0.log"
Jul 09 01:35:26.779673 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:26.779648    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a846d095-6946-47c7-b08e-caa445825afa/kube-rbac-proxy-metric/0.log"
Jul 09 01:35:26.797850 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:26.797825    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a846d095-6946-47c7-b08e-caa445825afa/prom-label-proxy/0.log"
Jul 09 01:35:26.817684 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:26.817657    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a846d095-6946-47c7-b08e-caa445825afa/init-config-reloader/0.log"
Jul 09 01:35:26.951374 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:26.951347    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5945849c67-6qwlr_189fe576-ca53-4362-aeb0-f807952b54f3/metrics-server/0.log"
Jul 09 01:35:27.018006 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:27.017975    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7chjs_5e886194-d4ac-49cc-9f50-5f4717186857/node-exporter/0.log"
Jul 09 01:35:27.040918 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:27.040890    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7chjs_5e886194-d4ac-49cc-9f50-5f4717186857/kube-rbac-proxy/0.log"
Jul 09 01:35:27.060266 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:27.060186    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7chjs_5e886194-d4ac-49cc-9f50-5f4717186857/init-textfile/0.log"
Jul 09 01:35:27.225157 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:27.225113    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5g6jx_1ccc9ff8-04d7-4272-b414-d60fd6a7f515/kube-rbac-proxy-main/0.log"
Jul 09 01:35:27.244859 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:27.244832    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5g6jx_1ccc9ff8-04d7-4272-b414-d60fd6a7f515/kube-rbac-proxy-self/0.log"
Jul 09 01:35:27.267678 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:27.267640    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5g6jx_1ccc9ff8-04d7-4272-b414-d60fd6a7f515/openshift-state-metrics/0.log"
Jul 09 01:35:27.502075 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:27.502035    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-ntp5p_c1306b82-e105-44f1-b1c9-bad475b4b691/prometheus-operator-admission-webhook/0.log"
Jul 09 01:35:27.526466 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:27.526438    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67ffcdccfb-vjcfk_a338da56-2c44-4535-a805-4729a1ad87bf/telemeter-client/0.log"
Jul 09 01:35:27.544125 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:27.544093    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67ffcdccfb-vjcfk_a338da56-2c44-4535-a805-4729a1ad87bf/reload/0.log"
Jul 09 01:35:27.562400 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:27.562371    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67ffcdccfb-vjcfk_a338da56-2c44-4535-a805-4729a1ad87bf/kube-rbac-proxy/0.log"
Jul 09 01:35:29.438662 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.438629    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"]
Jul 09 01:35:29.439086 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.439070    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4384c446-96c2-431e-94a0-429d9aca9a7b" containerName="test-curl-7700-140124470191856"
Jul 09 01:35:29.439130 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.439088    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4384c446-96c2-431e-94a0-429d9aca9a7b" containerName="test-curl-7700-140124470191856"
Jul 09 01:35:29.439178 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.439168    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4384c446-96c2-431e-94a0-429d9aca9a7b" containerName="test-curl-7700-140124470191856"
Jul 09 01:35:29.442483 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.442469    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:29.444759 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.444742    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6bs7j\"/\"default-dockercfg-r8h45\""
Jul 09 01:35:29.444843 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.444743    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6bs7j\"/\"kube-root-ca.crt\""
Jul 09 01:35:29.445607 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.445587    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6bs7j\"/\"openshift-service-ca.crt\""
Jul 09 01:35:29.450567 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.450546    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"]
Jul 09 01:35:29.507967 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.507935    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1-proc\") pod \"perf-node-gather-daemonset-fqwz5\" (UID: \"56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:29.508132 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.507986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2b69\" (UniqueName: \"kubernetes.io/projected/56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1-kube-api-access-n2b69\") pod \"perf-node-gather-daemonset-fqwz5\" (UID: \"56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:29.508132 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.508017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1-lib-modules\") pod \"perf-node-gather-daemonset-fqwz5\" (UID: \"56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:29.508132 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.508058    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1-sys\") pod \"perf-node-gather-daemonset-fqwz5\" (UID: \"56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:29.508132 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.508115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1-podres\") pod \"perf-node-gather-daemonset-fqwz5\" (UID: \"56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:29.608841 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.608802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1-proc\") pod \"perf-node-gather-daemonset-fqwz5\" (UID: \"56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:29.609047 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.608870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2b69\" (UniqueName: \"kubernetes.io/projected/56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1-kube-api-access-n2b69\") pod \"perf-node-gather-daemonset-fqwz5\" (UID: \"56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:29.609047 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.608902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1-lib-modules\") pod \"perf-node-gather-daemonset-fqwz5\" (UID: \"56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:29.609047 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.608933    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1-proc\") pod \"perf-node-gather-daemonset-fqwz5\" (UID: \"56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:29.609047 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.609044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1-sys\") pod \"perf-node-gather-daemonset-fqwz5\" (UID: \"56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:29.609269 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.609070    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1-lib-modules\") pod \"perf-node-gather-daemonset-fqwz5\" (UID: \"56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:29.609269 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.609087    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1-podres\") pod \"perf-node-gather-daemonset-fqwz5\" (UID: \"56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:29.609269 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.609131    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1-sys\") pod \"perf-node-gather-daemonset-fqwz5\" (UID: \"56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:29.609269 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.609240    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1-podres\") pod \"perf-node-gather-daemonset-fqwz5\" (UID: \"56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:29.616026 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.615999    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2b69\" (UniqueName: \"kubernetes.io/projected/56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1-kube-api-access-n2b69\") pod \"perf-node-gather-daemonset-fqwz5\" (UID: \"56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1\") " pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:29.753806 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.753775    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:29.893984 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:29.893953    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"]
Jul 09 01:35:29.895604 ip-10-0-134-227 kubenswrapper[2565]: W0709 01:35:29.895577    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod56f5d70d_d4f7_42d0_bd4a_39a1b06bf0a1.slice/crio-a4fb76a1c17e5fa7240d909165381b0ae5508dbbb7479f7c4afc602cf454b921 WatchSource:0}: Error finding container a4fb76a1c17e5fa7240d909165381b0ae5508dbbb7479f7c4afc602cf454b921: Status 404 returned error can't find the container with id a4fb76a1c17e5fa7240d909165381b0ae5508dbbb7479f7c4afc602cf454b921
Jul 09 01:35:30.096351 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:30.096271    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6dfcb6c6b4-lwhn8_16b783b5-c74b-4938-bdcd-ccd2a1203d24/console/0.log"
Jul 09 01:35:30.131105 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:30.131074    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-sjl6z_520c55e3-aabc-4449-8f91-f155b6fa6b5f/download-server/0.log"
Jul 09 01:35:30.826704 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:30.826674    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5" event={"ID":"56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1","Type":"ContainerStarted","Data":"49e51fbb6d001484e63ab91508be427dd9122b62072c36f2301a4b24a00a183e"}
Jul 09 01:35:30.827203 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:30.826723    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5" event={"ID":"56f5d70d-d4f7-42d0-bd4a-39a1b06bf0a1","Type":"ContainerStarted","Data":"a4fb76a1c17e5fa7240d909165381b0ae5508dbbb7479f7c4afc602cf454b921"}
Jul 09 01:35:30.827203 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:30.826744    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:30.843820 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:30.843768    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5" podStartSLOduration=1.843755134 podStartE2EDuration="1.843755134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:35:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:35:30.840726421 +0000 UTC m=+2415.904221122" watchObservedRunningTime="2026-07-09 01:35:30.843755134 +0000 UTC m=+2415.907249839"
Jul 09 01:35:31.758497 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:31.758469    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmhcq_1a1651df-abf2-4c74-8783-5cc32699d298/dns/0.log"
Jul 09 01:35:31.777117 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:31.777084    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmhcq_1a1651df-abf2-4c74-8783-5cc32699d298/kube-rbac-proxy/0.log"
Jul 09 01:35:31.798293 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:31.798254    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9qh2x_1252da54-e942-4e80-97c4-d34b84841d1a/dns-node-resolver/0.log"
Jul 09 01:35:32.362504 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:32.362432    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7d7bb587-w4gzp_88d009d0-16d5-47bc-84a7-6ef378bfa8ed/registry/0.log"
Jul 09 01:35:32.382621 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:32.382596    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-99x8l_5daf2603-bdab-405e-a733-a9ec1b51ab68/node-ca/0.log"
Jul 09 01:35:33.467222 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:33.467189    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7556c75c9b-848b5_5b8296be-5aa0-44ed-8285-930b05703c81/kube-auth-proxy/0.log"
Jul 09 01:35:33.493461 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:33.493432    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-5mpgg_1ba4ae3c-07ab-4252-829f-56a0e07337ed/istio-proxy/0.log"
Jul 09 01:35:33.548527 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:33.548497    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-5mpgg_1ba4ae3c-07ab-4252-829f-56a0e07337ed/istio-proxy/1.log"
Jul 09 01:35:33.603523 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:33.603495    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-v9n8r_fd0fe6a9-57d4-487d-8e17-54e43f645104/payload-pre-processing/0.log"
Jul 09 01:35:33.673742 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:33.673716    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4cndj_e4b6f609-a070-4d4a-a699-e1815f71687e/payload-processing/0.log"
Jul 09 01:35:34.431709 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:34.431676    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dtmg6_e2475349-184c-40c1-8825-45e4b8c349fe/serve-healthcheck-canary/0.log"
Jul 09 01:35:35.026406 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:35.026370    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p9n8r_f3a5efef-8d70-422c-9734-0da95678328e/kube-rbac-proxy/0.log"
Jul 09 01:35:35.044878 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:35.044854    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p9n8r_f3a5efef-8d70-422c-9734-0da95678328e/exporter/0.log"
Jul 09 01:35:35.065909 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:35.065851    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p9n8r_f3a5efef-8d70-422c-9734-0da95678328e/extractor/0.log"
Jul 09 01:35:36.843591 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:36.843561    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6bs7j/perf-node-gather-daemonset-fqwz5"
Jul 09 01:35:37.538717 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:37.538629    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c89db8b46-scgq7_014b31d7-7f20-4a5e-86d6-65ecb380a2d8/manager/0.log"
Jul 09 01:35:37.556355 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:37.556323    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-m9bgh_a4e85460-41a3-43e3-a960-e080183b6a87/server/0.log"
Jul 09 01:35:37.655926 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:37.655895    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bm452_61f2de59-b173-49be-9f17-28f0eb661091/manager/0.log"
Jul 09 01:35:37.869629 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:37.869539    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85699f56b9-tt2xl_ef98fd89-f041-420d-9447-31ec62d8fefb/manager/0.log"
Jul 09 01:35:37.887316 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:37.887290    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85699f56b9-tt2xl_ef98fd89-f041-420d-9447-31ec62d8fefb/copy-manifests/0.log"
Jul 09 01:35:40.081036 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:40.081003    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7556c75c9b-848b5_5b8296be-5aa0-44ed-8285-930b05703c81/kube-auth-proxy/0.log"
Jul 09 01:35:40.100505 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:40.100465    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-5mpgg_1ba4ae3c-07ab-4252-829f-56a0e07337ed/istio-proxy/0.log"
Jul 09 01:35:40.155521 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:40.155492    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-5mpgg_1ba4ae3c-07ab-4252-829f-56a0e07337ed/istio-proxy/1.log"
Jul 09 01:35:40.200834 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:40.200803    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-v9n8r_fd0fe6a9-57d4-487d-8e17-54e43f645104/payload-pre-processing/0.log"
Jul 09 01:35:40.268577 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:40.268546    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4cndj_e4b6f609-a070-4d4a-a699-e1815f71687e/payload-processing/0.log"
Jul 09 01:35:41.735063 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:41.735033    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7556c75c9b-848b5_5b8296be-5aa0-44ed-8285-930b05703c81/kube-auth-proxy/0.log"
Jul 09 01:35:41.763552 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:41.763515    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-5mpgg_1ba4ae3c-07ab-4252-829f-56a0e07337ed/istio-proxy/0.log"
Jul 09 01:35:41.817671 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:41.817637    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-5mpgg_1ba4ae3c-07ab-4252-829f-56a0e07337ed/istio-proxy/1.log"
Jul 09 01:35:41.868331 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:41.868297    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-v9n8r_fd0fe6a9-57d4-487d-8e17-54e43f645104/payload-pre-processing/0.log"
Jul 09 01:35:41.933746 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:41.933708    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4cndj_e4b6f609-a070-4d4a-a699-e1815f71687e/payload-processing/0.log"
Jul 09 01:35:45.901848 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:45.901820    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djxlj_11109ade-c94b-4ae7-8f23-bad58d31cadb/kube-multus-additional-cni-plugins/0.log"
Jul 09 01:35:45.921350 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:45.921322    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djxlj_11109ade-c94b-4ae7-8f23-bad58d31cadb/egress-router-binary-copy/0.log"
Jul 09 01:35:45.940019 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:45.939992    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djxlj_11109ade-c94b-4ae7-8f23-bad58d31cadb/cni-plugins/0.log"
Jul 09 01:35:45.958232 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:45.958184    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djxlj_11109ade-c94b-4ae7-8f23-bad58d31cadb/bond-cni-plugin/0.log"
Jul 09 01:35:45.975510 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:45.975476    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djxlj_11109ade-c94b-4ae7-8f23-bad58d31cadb/routeoverride-cni/0.log"
Jul 09 01:35:45.993962 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:45.993937    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djxlj_11109ade-c94b-4ae7-8f23-bad58d31cadb/whereabouts-cni-bincopy/0.log"
Jul 09 01:35:46.012984 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:46.012951    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djxlj_11109ade-c94b-4ae7-8f23-bad58d31cadb/whereabouts-cni/0.log"
Jul 09 01:35:46.231588 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:46.231483    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bxgnp_1cd58c28-12ba-4565-948b-0cd4ebfcf0f0/kube-multus/0.log"
Jul 09 01:35:46.295442 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:46.295404    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6jcwt_0c3cdb55-354c-454f-b498-64c2a1a329ee/network-metrics-daemon/0.log"
Jul 09 01:35:46.309348 ip-10-0-134-227 kubenswrapper[2565]: I0709 01:35:46.309318    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6jcwt_0c3cdb55-354c-454f-b498-64c2a1a329ee/kube-rbac-proxy/0.log"