Jul 06 13:48:31.174994 ip-10-0-134-29 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 13:48:31.175007 ip-10-0-134-29 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 13:48:31.175017 ip-10-0-134-29 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 13:48:31.175317 ip-10-0-134-29 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 13:48:41.185613 ip-10-0-134-29 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 13:48:41.185633 ip-10-0-134-29 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 776a45d63e8941b39c71a52474183f09 --
Jul 06 13:50:11.627677 ip-10-0-134-29 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 13:50:12.381842 ip-10-0-134-29 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 13:50:12.381842 ip-10-0-134-29 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 13:50:12.381842 ip-10-0-134-29 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 13:50:12.381842 ip-10-0-134-29 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 13:50:12.381842 ip-10-0-134-29 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 13:50:12.381842 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.079572    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 13:50:12.381842 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084446    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:50:12.381842 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084458    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:50:12.381842 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084461    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:50:12.381842 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084464    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:50:12.381842 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084467    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:50:12.381842 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084470    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:50:12.381842 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084473    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:50:12.381842 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084475    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084478    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084480    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084483    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084486    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084488    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084490    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084493    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084495    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084497    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084500    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084502    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084505    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084508    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084514    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084517    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084520    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084522    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084525    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084527    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:50:12.392565 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084529    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:50:12.156770 ip-10-0-134-29 systemd[1]: Started Kubernetes Kubelet.
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084532    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084534    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084536    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084539    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084541    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084543    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084546    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084548    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084550    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084553    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084555    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084557    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084560    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084562    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084564    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084567    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084569    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084572    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084574    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:50:12.393330 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084576    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084578    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084581    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084583    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084586    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084588    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084590    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084594    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084597    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084600    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084604    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084607    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084611    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084614    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084617    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084620    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084622    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084627    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:50:12.394153 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084631    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084633    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084636    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084639    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084642    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084645    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084648    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084650    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084653    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084656    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084658    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084661    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084663    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084666    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084668    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084671    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084673    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084676    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084678    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:50:12.394757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084680    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084682    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084685    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084688    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084690    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084693    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084696    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084700    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084702    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084705    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084708    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084711    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084713    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084716    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.084718    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086538    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086550    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086553    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086557    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086559    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:50:12.395363 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086562    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086564    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086567    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086570    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086572    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086575    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086577    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086579    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086582    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086584    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086587    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086590    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086592    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086595    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086597    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086600    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086602    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086605    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086608    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086610    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:50:12.396190 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086613    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086615    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086618    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086620    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086622    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086625    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086627    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086631    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086635    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086639    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086642    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086645    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086648    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086651    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086655    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086659    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086662    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086665    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086667    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:50:12.396994 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086670    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086673    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086676    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086678    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086680    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086683    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086685    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086688    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086690    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086693    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086695    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086698    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086701    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086703    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086706    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086708    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086710    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086713    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086715    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086717    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:50:12.397608 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086720    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086722    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086725    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086728    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086731    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086734    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086737    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086741    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086743    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086746    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086749    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086752    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086754    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086757    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086759    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086763    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086767    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086773    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086777    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:50:12.398217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086781    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086784    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086786    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086789    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086792    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086794    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086797    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086799    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086802    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086805    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086807    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086809    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086812    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086814    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086817    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.086819    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087185    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087190    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087193    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087196    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:50:12.398818 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087199    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087201    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087204    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087206    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087209    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087211    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087214    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087217    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087219    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087222    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087226    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087229    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087234    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087238    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087241    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087244    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087246    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087248    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087251    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:50:12.399412 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087253    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087256    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087259    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087261    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087263    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087266    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087268    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087271    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087273    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087276    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087278    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087280    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087283    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087285    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087288    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087290    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087292    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087295    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087297    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087299    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:50:12.399963 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087302    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087304    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087306    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087310    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087313    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087317    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087321    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087324    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087326    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087329    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087332    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087334    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087337    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087340    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087342    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087345    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087348    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087352    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087355    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:50:12.400576 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087358    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087361    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087363    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087365    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087368    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087370    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087373    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087375    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087377    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087380    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087382    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087385    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087387    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087389    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087392    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087394    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087397    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087401    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087404    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087406    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:50:12.401105 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087409    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087412    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087415    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087418    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087420    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087422    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087425    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087446    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087471    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087479    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087482    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087485    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087487    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087490    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087493    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087496    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.087498    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087570    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087576    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087582    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087586    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 13:50:12.401663 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087591    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087594    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087602    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087606    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087609    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087612    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087615    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087619    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087622    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087625    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087627    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087630    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087635    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087638    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087662    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087666    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087669    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087672    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087675    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087678    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087681    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087684    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087687    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087690    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 13:50:12.402187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087692    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087695    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087698    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087701    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087705    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087708    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087711    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087713    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087716    2562 flags.go:64] FLAG: --enable-server="true"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087719    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087723    2562 flags.go:64] FLAG: --event-burst="100"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087725    2562 flags.go:64] FLAG: --event-qps="50"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087729    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087732    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087734    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087738    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087741    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087744    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087746    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087749    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087752    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087756    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087758    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087761    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087764    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 13:50:12.402862 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087766    2562 flags.go:64] FLAG: --feature-gates=""
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087770    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087773    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087776    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087779    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087782    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087785    2562 flags.go:64] FLAG: --help="false"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087787    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087790    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087793    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087796    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087799    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087802    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087805    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087808    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087810    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087813    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087816    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087819    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087822    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087824    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087827    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087830    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087832    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 13:50:12.403570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087835    2562 flags.go:64] FLAG: --lock-file=""
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087838    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087843    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087845    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087850    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087853    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087856    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087859    2562 flags.go:64] FLAG: --logging-format="text"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087863    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087866    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087869    2562 flags.go:64] FLAG: --manifest-url=""
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087872    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087876    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087879    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087883    2562 flags.go:64] FLAG: --max-pods="110"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087885    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087888    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087891    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087894    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087897    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087899    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087902    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087909    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087912    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087915    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 13:50:12.404241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087917    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087920    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087925    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087928    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087931    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087933    2562 flags.go:64] FLAG: --port="10250"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087936    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087939    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-081b13dc03ce8be9b"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087942    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087945    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087949    2562 flags.go:64] FLAG: --register-node="true"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087951    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087954    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087958    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087960    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087964    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087968    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087971    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087973    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087976    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087979    2562 flags.go:64] FLAG: --runonce="false"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087981    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087984    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087987    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087990    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 13:50:12.405195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087993    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087995    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.087998    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088001    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088004    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088006    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088009    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088011    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088014    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088017    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088019    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088024    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088027    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088029    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088033    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088036    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088038    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088042    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088045    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088048    2562 flags.go:64] FLAG: --v="2"
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088051    2562 flags.go:64] FLAG: --version="false"
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088055    2562 flags.go:64] FLAG: --vmodule=""
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088060    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.088063    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088181    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:50:12.405917 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088186    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088189    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088192    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088195    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088198    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088200    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088203    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088205    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088208    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088210    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088213    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088215    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088217    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088220    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088222    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088225    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088228    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088230    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088233    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088235    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:50:12.564955 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088238    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088240    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088243    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088246    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088249    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088252    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088254    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088256    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088259    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088263    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088265    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088268    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088270    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088273    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088275    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088278    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088281    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088283    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088287    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:50:12.565757 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088291    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088293    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088296    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088299    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088301    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088304    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088306    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088308    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088311    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088313    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088316    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088318    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088321    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088323    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088326    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088329    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088331    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088336    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088339    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:50:12.566350 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088343    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088346    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088348    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088352    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088356    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088358    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088361    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088363    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088366    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088368    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088371    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088374    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088378    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088382    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088384    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088387    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088389    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088392    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088394    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088397    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:50:12.566895 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088399    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088402    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088405    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088407    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088410    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088412    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088414    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088417    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088419    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088422    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088425    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088443    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088446    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088449    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088452    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088456    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088458    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088462    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088465    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:50:12.567415 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.088467    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:50:12.567961 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.089202    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 13:50:12.567961 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.095914    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 13:50:12.567961 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.095929    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 13:50:12.567961 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.095948    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 13:50:12.567961 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.095958    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 13:50:12.567961 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096020    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:50:12.567961 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096024    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:50:12.567961 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096028    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:50:12.567961 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096031    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:50:12.567961 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096035    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:50:12.567961 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096038    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:50:12.567961 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096042    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:50:12.567961 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096045    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:50:12.567961 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096049    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:50:12.567961 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096053    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096057    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096061    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096065    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096068    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096073    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096076    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096081    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096085    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096090    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096095    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096099    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096104    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096107    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096111    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096117    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096121    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096125    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096129    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:50:12.568359 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096134    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096137    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096142    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096146    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096149    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096153    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096157    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096160    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096164    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096168    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096172    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096176    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096180    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096184    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096187    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096190    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096194    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096199    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096205    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:50:12.568904 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096210    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096214    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096218    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096222    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096226    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096231    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096235    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096238    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096243    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096246    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096255    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096259    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096262    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096266    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096270    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096274    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096278    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096282    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096286    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096289    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:50:12.569394 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096294    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096298    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096301    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096305    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096309    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096313    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096316    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096320    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096323    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096328    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096332    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096335    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096339    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096345    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096348    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096352    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096355    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096359    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096363    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096367    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:50:12.569948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096370    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:50:12.570469 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096374    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:50:12.570469 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096379    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:50:12.570469 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096383    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:50:12.570469 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096387    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:50:12.570469 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096391    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:50:12.570469 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096394    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:50:12.570469 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096398    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:50:12.570469 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096402    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:50:12.570469 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096405    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:50:12.570469 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096409    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:50:12.570469 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096413    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:50:12.570469 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.096418    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 13:50:12.570469 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096605    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:50:12.570469 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096611    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:50:12.570469 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096616    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096620    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096624    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096628    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096632    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096636    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096640    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096644    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096647    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096651    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096654    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096660    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096663    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096667    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096670    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096674    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096678    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096682    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096685    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:50:12.570903 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096690    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096694    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096698    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096702    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096706    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096710    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096714    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096718    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096721    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096725    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096729    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096732    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096736    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096740    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096743    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096747    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096753    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096758    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096762    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096766    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:50:12.571373 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096769    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096773    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096777    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096780    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096786    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096790    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096793    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096797    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096800    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096804    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096807    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096811    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096816    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096819    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096823    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096827    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096831    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096834    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096838    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096842    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096845    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:50:12.572078 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096849    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096852    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096856    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096859    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096863    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096867    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096870    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096874    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096877    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096881    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096885    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096888    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096892    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096895    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096899    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096905    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096910    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096914    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096917    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:50:12.572626 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096921    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:50:12.573150 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096925    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:50:12.573150 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096928    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:50:12.573150 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096932    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:50:12.573150 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096938    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:50:12.573150 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096942    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:50:12.573150 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096946    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:50:12.573150 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096949    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:50:12.573150 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096953    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:50:12.573150 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096957    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:50:12.573150 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096962    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:50:12.573150 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096967    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:50:12.573150 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096971    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:50:12.573150 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096974    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:50:12.573150 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096978    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:50:12.573150 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096981    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:50:12.573150 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096985    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:50:12.573150 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:12.096988    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:50:12.573606 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.096994    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 13:50:12.573606 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.097094    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 13:50:12.573606 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.100327    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 13:50:12.573606 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.101976    2562 server.go:1019] "Starting client certificate rotation"
Jul 06 13:50:12.573606 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.102067    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 13:50:12.573606 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.102100    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 13:50:12.573606 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.105608    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 13:50:12.573606 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.106599    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 13:50:12.573606 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.117810    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 06 13:50:12.573606 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.120181    2562 log.go:25] "Validated CRI v1 image API"
Jul 06 13:50:12.573606 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.121047    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 13:50:12.573606 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.126037    2562 fs.go:135] Filesystem UUIDs: map[6666b604-c42d-4c6d-a667-cde733166327:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a30d1084-75ec-452a-9b06-245cd3ae998c:/dev/nvme0n1p3]
Jul 06 13:50:12.573963 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.126050    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 13:50:12.574028 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.130837    2562 manager.go:216] Machine: {Timestamp:2026-07-06 13:50:12.129474706 +0000 UTC m=+0.370938776 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3222707 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27a262f128c3a47d362951d0a87e80 SystemUUID:ec27a262-f128-c3a4-7d36-2951d0a87e80 BootID:776a45d6-3e89-41b3-9c71-a52474183f09 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f6:4b:37:ef:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f6:4b:37:ef:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:24:8a:a3:ea:04 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 13:50:12.574028 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.130926    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 13:50:12.574028 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.130986    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 13:50:12.574028 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.131482    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 13:50:12.574028 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.134456    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 13:50:12.574028 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.134482    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-29.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 13:50:12.574028 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.135334    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.135345    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.135351    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.135364    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.136631    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.141207    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.141310    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.141336    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.141352    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.141366    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.141375    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.141383    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.141663    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.141677    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.144675    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.146625    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.146650    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.148779    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.148798    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.148806    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.148815    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.148827    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.148834    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.148847    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.148853    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.148862    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.148868    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.148879    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.148885    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.149798    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.149806    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.152454    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.152515    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-29.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.152527    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-29.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.152739    2562 server.go:1268] "Started kubelet"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.152793    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.155998    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.156423    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.159327    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.159459    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 13:50:12.574297 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.162762    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.164211    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-29.ec2.internal.18bfb7914d0b0aff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-29.ec2.internal,UID:ip-10-0-134-29.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-29.ec2.internal,},FirstTimestamp:2026-07-06 13:50:12.152716031 +0000 UTC m=+0.394180078,LastTimestamp:2026-07-06 13:50:12.152716031 +0000 UTC m=+0.394180078,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-29.ec2.internal,}"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.169023    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.169040    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.169086    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.169766    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.169779    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.169766    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.169854    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.169866    2562 factory.go:55] Registering systemd factory
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.169875    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.169866    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.169917    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.170113    2562 factory.go:153] Registering CRI-O factory
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.170127    2562 factory.go:223] Registration of the crio container factory successfully
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.170146    2562 factory.go:103] Registering Raw factory
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.170159    2562 manager.go:1196] Started watching for new ooms in manager
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.170624    2562 manager.go:349] Starting recovery of all containers
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.175607    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-29.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.175676    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.182166    2562 manager.go:354] Recovery completed
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.183236    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d7jxm"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.185952    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.187686    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.187709    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.187722    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.188792    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.188805    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.188822    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 13:50:12.575608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.189218    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.189613    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-29.ec2.internal.18bfb7914f20c9d6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-29.ec2.internal,UID:ip-10-0-134-29.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-29.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-29.ec2.internal,},FirstTimestamp:2026-07-06 13:50:12.187695574 +0000 UTC m=+0.429159620,LastTimestamp:2026-07-06 13:50:12.187695574 +0000 UTC m=+0.429159620,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-29.ec2.internal,}"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.191009    2562 policy_none.go:49] "None policy: Start"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.191110    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.191123    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.191132    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.191157    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.191270    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.192643    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d7jxm"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.194657    2562 policy_none.go:47] "Start"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.233977    2562 manager.go:337] "Starting Device Plugin manager"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.234005    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.234015    2562 server.go:87] "Starting device plugin registration server"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.234218    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.234226    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.234311    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.234407    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.234413    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.234818    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.234861    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.271791    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.272888    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.272929    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.272948    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.272985    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.275565    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.334848    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.335626    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.335647    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.335656    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.335676    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.347771    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.347787    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-29.ec2.internal\": node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 06 13:50:12.756216 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.359653    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.373924    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal"]
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.373971    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.375146    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.375174    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.375187    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.377450    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.377508    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.377555    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.378091    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.378109    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.378122    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.378151    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.378167    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.378187    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.380164    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.380182    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.380750    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.380766    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.380775    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.412549    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-29.ec2.internal\" not found" node="ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.417750    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-29.ec2.internal\" not found" node="ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.460458    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.560709    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.575054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27e27d054810d078240eb360988177e7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal\" (UID: \"27e27d054810d078240eb360988177e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.575078    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27e27d054810d078240eb360988177e7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal\" (UID: \"27e27d054810d078240eb360988177e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.575093    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/301d2e284fa3bf2b30f75ef544be44ae-config\") pod \"kube-apiserver-proxy-ip-10-0-134-29.ec2.internal\" (UID: \"301d2e284fa3bf2b30f75ef544be44ae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.760115 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.662121    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 06 13:50:12.760916 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.675469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27e27d054810d078240eb360988177e7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal\" (UID: \"27e27d054810d078240eb360988177e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.760916 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.675486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27e27d054810d078240eb360988177e7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal\" (UID: \"27e27d054810d078240eb360988177e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.760916 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.675505    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/301d2e284fa3bf2b30f75ef544be44ae-config\") pod \"kube-apiserver-proxy-ip-10-0-134-29.ec2.internal\" (UID: \"301d2e284fa3bf2b30f75ef544be44ae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.760916 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.675535    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/301d2e284fa3bf2b30f75ef544be44ae-config\") pod \"kube-apiserver-proxy-ip-10-0-134-29.ec2.internal\" (UID: \"301d2e284fa3bf2b30f75ef544be44ae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.760916 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.675568    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27e27d054810d078240eb360988177e7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal\" (UID: \"27e27d054810d078240eb360988177e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.760916 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.675589    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27e27d054810d078240eb360988177e7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal\" (UID: \"27e27d054810d078240eb360988177e7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.760916 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.714734    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.760916 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:12.720815    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal"
Jul 06 13:50:12.967747 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.762942    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 06 13:50:12.967747 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.863406    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 06 13:50:12.967747 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:12.964177    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-29.ec2.internal\" not found"
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.005809    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.069853    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal"
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.081901    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.083308    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal"
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.091388    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.101510    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.101604    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.142061    2562 apiserver.go:52] "Watching apiserver"
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.149321    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.149647    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-4x77l","openshift-ovn-kubernetes/ovnkube-node-nd55z","kube-system/konnectivity-agent-pqhrv","kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8zp9b","openshift-image-registry/node-ca-rgwl6","openshift-multus/network-metrics-daemon-cxr4t","openshift-network-operator/iptables-alerter-7b8qt","kube-system/global-pull-secret-syncer-phwdx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r","openshift-dns/node-resolver-f5jwm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal","openshift-multus/multus-additional-cni-plugins-hkvfk","openshift-multus/multus-rcvp6"]
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.152021    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.154098    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.154205    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.154216    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.156046    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.156056    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g67wq\""
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.156089    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.156056    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d922l\""
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.156159    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.156358    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.156532    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.156597    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.158914    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pqhrv"
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.160505    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.160675    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8gfj7\""
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.160693    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.161023    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:13.172701 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.162600    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 13:50:13.174397 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.162614    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vbtx2\""
Jul 06 13:50:13.174397 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.163087    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.174397 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.164757    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 13:50:13.174397 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.164975    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 13:50:13.174397 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.165097    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sldrn\""
Jul 06 13:50:13.174397 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.165220    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rgwl6"
Jul 06 13:50:13.174397 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.166833    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 13:50:13.174397 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.167132    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 13:50:13.174397 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.167202    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pl4rx\""
Jul 06 13:50:13.174397 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.167134    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 13:50:13.174397 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.167447    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:13.174397 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:13.167506    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phwdx" podUID="3a9a4e3f-18cb-454f-ac12-66bf74123320"
Jul 06 13:50:13.174397 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.169461    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 13:50:13.174397 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.169666    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:13.174397 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:13.169734    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:13.303539 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.182346    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.303539 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.183334    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-tuned\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.303539 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.184007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38acd46b-6d99-4d86-afc7-88f95742a5ae-host\") pod \"node-ca-rgwl6\" (UID: \"38acd46b-6d99-4d86-afc7-88f95742a5ae\") " pod="openshift-image-registry/node-ca-rgwl6"
Jul 06 13:50:13.303539 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.184044    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-slash\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.303539 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.184307    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-sys-fs\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:13.303539 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.184366    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-system-cni-dir\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:13.303539 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.184396    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-os-release\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:13.303539 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.184442    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-run\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.303539 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.184486    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 13:50:13.303539 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.184594    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-kubelet\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.303539 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.184638    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-etc-openvswitch\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.303539 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.184760    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-node-log\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.303539 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.184818    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-cni-bin\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.303539 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.184872    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 13:50:13.303539 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185061    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 13:50:13.303539 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185109    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 13:50:13.303539 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185144    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 13:50:13.304378 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185110    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2b3489c-dd27-4729-99cf-caf01ddf702f-ovn-node-metrics-cert\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.304378 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185254    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-socket-dir\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:13.304378 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185291    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-sysconfig\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.304378 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-lib-modules\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.304378 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-var-lib-kubelet\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.304378 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/38acd46b-6d99-4d86-afc7-88f95742a5ae-serviceca\") pod \"node-ca-rgwl6\" (UID: \"38acd46b-6d99-4d86-afc7-88f95742a5ae\") " pod="openshift-image-registry/node-ca-rgwl6"
Jul 06 13:50:13.304378 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185406    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-var-lib-openvswitch\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.304378 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-run-ovn\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.304378 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185614    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.304378 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-multus-cni-dir\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:13.304378 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185719    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-host\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.304378 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-run-systemd\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.304378 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185828    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c2b3489c-dd27-4729-99cf-caf01ddf702f-env-overrides\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.304378 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185882    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-multus-socket-dir-parent\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:13.305003 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185929    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-run-k8s-cni-cncf-io\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:13.305003 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185934    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 13:50:13.305003 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185962    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-kubernetes\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.305003 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185994    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8f48c\""
Jul 06 13:50:13.305003 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.185994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-systemd-units\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.305003 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.186050    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-run-netns\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.305003 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.186081    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c2b3489c-dd27-4729-99cf-caf01ddf702f-ovnkube-script-lib\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.305003 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.186119    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lpdv\" (UniqueName: \"kubernetes.io/projected/c2b3489c-dd27-4729-99cf-caf01ddf702f-kube-api-access-5lpdv\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.305003 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.186154    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:13.305003 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.186197    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 13:50:13.305003 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.186190    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18c06939-f48c-4f07-9be4-73b7f7968162-konnectivity-ca\") pod \"konnectivity-agent-pqhrv\" (UID: \"18c06939-f48c-4f07-9be4-73b7f7968162\") " pod="kube-system/konnectivity-agent-pqhrv"
Jul 06 13:50:13.305003 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.186231    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-cnibin\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:13.305003 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.186311    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:13.305003 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.186333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-sysctl-conf\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.305003 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.186365    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv444\" (UniqueName: \"kubernetes.io/projected/38acd46b-6d99-4d86-afc7-88f95742a5ae-kube-api-access-cv444\") pod \"node-ca-rgwl6\" (UID: \"38acd46b-6d99-4d86-afc7-88f95742a5ae\") " pod="openshift-image-registry/node-ca-rgwl6"
Jul 06 13:50:13.305003 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:13.186382    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4x77l" podUID="ef2654ab-e7e6-41c8-9631-cc4e714354ff"
Jul 06 13:50:13.305625 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.186405    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-run-openvswitch\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.305625 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.186482    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-cni-netd\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.305625 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.187119    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c2b3489c-dd27-4729-99cf-caf01ddf702f-ovnkube-config\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.305625 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.188938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-device-dir\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:13.305625 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.188961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-sysctl-d\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.305625 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.188977    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-sys\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.305625 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.189034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-log-socket\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.305625 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.189058    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-run-ovn-kubernetes\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.305625 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.189075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-etc-selinux\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:13.305625 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.189095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnwv4\" (UniqueName: \"kubernetes.io/projected/aad7c129-baa9-49de-a7fa-343f40af9319-kube-api-access-pnwv4\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:13.305625 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.189114    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f746ee95-1693-446d-a812-87d631385277-cni-binary-copy\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:13.305625 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.189132    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-systemd\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.305625 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.189147    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5aafc5d-d7cb-4860-a503-f248e2702592-tmp\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.305625 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.190603    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvmzt\" (UniqueName: \"kubernetes.io/projected/a5aafc5d-d7cb-4860-a503-f248e2702592-kube-api-access-cvmzt\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.191488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-registration-dir\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.191550    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18c06939-f48c-4f07-9be4-73b7f7968162-agent-certs\") pod \"konnectivity-agent-pqhrv\" (UID: \"18c06939-f48c-4f07-9be4-73b7f7968162\") " pod="kube-system/konnectivity-agent-pqhrv"
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.191626    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-modprobe-d\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.192995    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f5jwm"
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.195294    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7b8qt"
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.197245    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.197300    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.197356    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ljs9p\""
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.198842    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 13:45:13 +0000 UTC" deadline="2028-01-23 22:06:18.705127886 +0000 UTC"
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.198876    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13592h16m5.506253569s"
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.201845    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.201876    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.201918    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.202079    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5wrgx\""
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.231529    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tr8mw"
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.240306    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tr8mw"
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.270623    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292736    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5aafc5d-d7cb-4860-a503-f248e2702592-tmp\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292752    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-registration-dir\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292766    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18c06939-f48c-4f07-9be4-73b7f7968162-agent-certs\") pod \"konnectivity-agent-pqhrv\" (UID: \"18c06939-f48c-4f07-9be4-73b7f7968162\") " pod="kube-system/konnectivity-agent-pqhrv"
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292782    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a94e9db3-8b8e-462e-be17-8c0581a5063a-hosts-file\") pod \"node-resolver-f5jwm\" (UID: \"a94e9db3-8b8e-462e-be17-8c0581a5063a\") " pod="openshift-dns/node-resolver-f5jwm"
Jul 06 13:50:13.306241 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292797    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-modprobe-d\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.307059 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292812    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-tuned\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.307059 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38acd46b-6d99-4d86-afc7-88f95742a5ae-host\") pod \"node-ca-rgwl6\" (UID: \"38acd46b-6d99-4d86-afc7-88f95742a5ae\") " pod="openshift-image-registry/node-ca-rgwl6"
Jul 06 13:50:13.307059 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292838    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-sys-fs\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:13.307059 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292851    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-os-release\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:13.307059 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292866    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret\") pod \"global-pull-secret-syncer-phwdx\" (UID: \"3a9a4e3f-18cb-454f-ac12-66bf74123320\") " pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:13.307059 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292881    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs\") pod \"network-metrics-daemon-cxr4t\" (UID: \"aab6a8f0-2336-4d20-996a-2ac646db3fa9\") " pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:13.307059 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292896    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-run\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.307059 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292909    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-cni-bin\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.307059 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2b3489c-dd27-4729-99cf-caf01ddf702f-ovn-node-metrics-cert\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.307059 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292936    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-socket-dir\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:13.307059 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c87f08a-3127-4a61-996f-bc6587e6aac0-system-cni-dir\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:13.307059 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292966    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4mcg\" (UniqueName: \"kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg\") pod \"network-check-target-4x77l\" (UID: \"ef2654ab-e7e6-41c8-9631-cc4e714354ff\") " pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:13.307059 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.292992    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qszmz\" (UniqueName: \"kubernetes.io/projected/a94e9db3-8b8e-462e-be17-8c0581a5063a-kube-api-access-qszmz\") pod \"node-resolver-f5jwm\" (UID: \"a94e9db3-8b8e-462e-be17-8c0581a5063a\") " pod="openshift-dns/node-resolver-f5jwm"
Jul 06 13:50:13.307059 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-sysconfig\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.307684 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293028    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-var-lib-openvswitch\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.307684 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293049    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c87f08a-3127-4a61-996f-bc6587e6aac0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:13.307684 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293066    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-run-systemd\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.307684 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293080    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c87f08a-3127-4a61-996f-bc6587e6aac0-cnibin\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:13.307684 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293093    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-run-netns\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.307684 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lpdv\" (UniqueName: \"kubernetes.io/projected/c2b3489c-dd27-4729-99cf-caf01ddf702f-kube-api-access-5lpdv\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.307684 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293127    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18c06939-f48c-4f07-9be4-73b7f7968162-konnectivity-ca\") pod \"konnectivity-agent-pqhrv\" (UID: \"18c06939-f48c-4f07-9be4-73b7f7968162\") " pod="kube-system/konnectivity-agent-pqhrv"
Jul 06 13:50:13.307684 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293140    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3a9a4e3f-18cb-454f-ac12-66bf74123320-dbus\") pod \"global-pull-secret-syncer-phwdx\" (UID: \"3a9a4e3f-18cb-454f-ac12-66bf74123320\") " pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:13.307684 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293157    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmgtc\" (UniqueName: \"kubernetes.io/projected/76f82006-d8f6-4783-9872-14bb85bd9712-kube-api-access-mmgtc\") pod \"iptables-alerter-7b8qt\" (UID: \"76f82006-d8f6-4783-9872-14bb85bd9712\") " pod="openshift-network-operator/iptables-alerter-7b8qt"
Jul 06 13:50:13.307684 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-cni-netd\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.307684 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293200    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c2b3489c-dd27-4729-99cf-caf01ddf702f-ovnkube-config\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:13.307684 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293214    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-sysctl-d\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.307684 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-sys\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:13.307684 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293240    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-log-socket\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.506228 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293254    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-run-ovn-kubernetes\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.506228 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293276    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-etc-selinux\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:14.506228 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293294    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f746ee95-1693-446d-a812-87d631385277-cni-binary-copy\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.506228 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293309    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8xgj\" (UniqueName: \"kubernetes.io/projected/5c87f08a-3127-4a61-996f-bc6587e6aac0-kube-api-access-l8xgj\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.506228 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293324    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-systemd\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.506228 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvmzt\" (UniqueName: \"kubernetes.io/projected/a5aafc5d-d7cb-4860-a503-f248e2702592-kube-api-access-cvmzt\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.506228 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293371    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-hostroot\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.506228 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293409    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-etc-kubernetes\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.506228 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293423    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a94e9db3-8b8e-462e-be17-8c0581a5063a-tmp-dir\") pod \"node-resolver-f5jwm\" (UID: \"a94e9db3-8b8e-462e-be17-8c0581a5063a\") " pod="openshift-dns/node-resolver-f5jwm"
Jul 06 13:50:14.506228 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-slash\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.506228 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-system-cni-dir\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.506228 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293484    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-run-k8s-cni-cncf-io\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.506228 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-run-multus-certs\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.506228 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76f82006-d8f6-4783-9872-14bb85bd9712-host-slash\") pod \"iptables-alerter-7b8qt\" (UID: \"76f82006-d8f6-4783-9872-14bb85bd9712\") " pod="openshift-network-operator/iptables-alerter-7b8qt"
Jul 06 13:50:14.507124 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293566    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-kubelet\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.507124 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293582    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-etc-openvswitch\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.507124 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293596    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-node-log\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.507124 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293611    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-multus-cni-dir\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.507124 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293627    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-var-lib-kubelet\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.507124 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293641    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f746ee95-1693-446d-a812-87d631385277-multus-daemon-config\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.507124 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293657    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thdxd\" (UniqueName: \"kubernetes.io/projected/aab6a8f0-2336-4d20-996a-2ac646db3fa9-kube-api-access-thdxd\") pod \"network-metrics-daemon-cxr4t\" (UID: \"aab6a8f0-2336-4d20-996a-2ac646db3fa9\") " pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:14.507124 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293682    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-lib-modules\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.507124 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293703    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-var-lib-kubelet\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.507124 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293737    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/38acd46b-6d99-4d86-afc7-88f95742a5ae-serviceca\") pod \"node-ca-rgwl6\" (UID: \"38acd46b-6d99-4d86-afc7-88f95742a5ae\") " pod="openshift-image-registry/node-ca-rgwl6"
Jul 06 13:50:14.507124 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293761    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-run-ovn\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.507124 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293787    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.507124 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c87f08a-3127-4a61-996f-bc6587e6aac0-cni-binary-copy\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.507124 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293871    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c87f08a-3127-4a61-996f-bc6587e6aac0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.508024 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293902    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-host\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.508024 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293928    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c2b3489c-dd27-4729-99cf-caf01ddf702f-env-overrides\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.508024 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-multus-socket-dir-parent\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.508024 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.293982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-run-netns\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.508024 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpgcz\" (UniqueName: \"kubernetes.io/projected/f746ee95-1693-446d-a812-87d631385277-kube-api-access-bpgcz\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.508024 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294039    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-kubernetes\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.508024 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294073    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-systemd-units\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.508024 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294103    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c2b3489c-dd27-4729-99cf-caf01ddf702f-ovnkube-script-lib\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.508024 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294132    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:14.508024 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294157    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-cnibin\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.508024 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294184    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3a9a4e3f-18cb-454f-ac12-66bf74123320-kubelet-config\") pod \"global-pull-secret-syncer-phwdx\" (UID: \"3a9a4e3f-18cb-454f-ac12-66bf74123320\") " pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:14.508024 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294210    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c87f08a-3127-4a61-996f-bc6587e6aac0-os-release\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.508024 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c87f08a-3127-4a61-996f-bc6587e6aac0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.508024 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294260    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-sysctl-conf\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.508911 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294286    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv444\" (UniqueName: \"kubernetes.io/projected/38acd46b-6d99-4d86-afc7-88f95742a5ae-kube-api-access-cv444\") pod \"node-ca-rgwl6\" (UID: \"38acd46b-6d99-4d86-afc7-88f95742a5ae\") " pod="openshift-image-registry/node-ca-rgwl6"
Jul 06 13:50:14.508911 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294311    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-run-openvswitch\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.508911 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294336    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-device-dir\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:14.508911 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-var-lib-cni-multus\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.508911 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294385    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-multus-conf-dir\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.508911 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294410    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnwv4\" (UniqueName: \"kubernetes.io/projected/aad7c129-baa9-49de-a7fa-343f40af9319-kube-api-access-pnwv4\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:14.508911 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-var-lib-cni-bin\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.508911 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294483    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/76f82006-d8f6-4783-9872-14bb85bd9712-iptables-alerter-script\") pod \"iptables-alerter-7b8qt\" (UID: \"76f82006-d8f6-4783-9872-14bb85bd9712\") " pod="openshift-network-operator/iptables-alerter-7b8qt"
Jul 06 13:50:14.508911 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.294741    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 13:50:14.508911 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.297399    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-registration-dir\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:14.508911 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.297659    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5aafc5d-d7cb-4860-a503-f248e2702592-tmp\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.508911 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.297767    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-modprobe-d\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.508911 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298051    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-system-cni-dir\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.508911 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298099    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38acd46b-6d99-4d86-afc7-88f95742a5ae-host\") pod \"node-ca-rgwl6\" (UID: \"38acd46b-6d99-4d86-afc7-88f95742a5ae\") " pod="openshift-image-registry/node-ca-rgwl6"
Jul 06 13:50:14.508911 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298150    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-sys-fs\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:14.509752 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298215    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-os-release\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.509752 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298310    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-run\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.509752 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298368    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-run-k8s-cni-cncf-io\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.509752 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298383    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-multus-socket-dir-parent\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.509752 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298422    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.509752 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298484    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-kubernetes\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.509752 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298496    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-sysconfig\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.509752 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298493    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-kubelet\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.509752 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298565    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-systemd-units\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.509752 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298576    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-multus-cni-dir\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.509752 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298604    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-var-lib-openvswitch\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.509752 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298610    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-var-lib-kubelet\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.509752 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298652    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-run-ovn\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.509752 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298667    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:14.509752 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298675    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-run-netns\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.510765 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298718    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-cnibin\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.510765 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298723    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-sysctl-conf\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.510765 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298747    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-run-openvswitch\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.510765 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298799    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-etc-selinux\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:14.510765 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298355    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-cni-bin\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.510765 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298866    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-systemd\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.510765 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298945    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-node-log\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.510765 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298963    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-socket-dir\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:14.510765 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298995    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-sys\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.510765 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.299020    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-cni-netd\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.510765 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.299055    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-etc-openvswitch\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.510765 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.299360    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f746ee95-1693-446d-a812-87d631385277-cni-binary-copy\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.510765 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.299548    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18c06939-f48c-4f07-9be4-73b7f7968162-konnectivity-ca\") pod \"konnectivity-agent-pqhrv\" (UID: \"18c06939-f48c-4f07-9be4-73b7f7968162\") " pod="kube-system/konnectivity-agent-pqhrv"
Jul 06 13:50:14.510765 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.299561    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/38acd46b-6d99-4d86-afc7-88f95742a5ae-serviceca\") pod \"node-ca-rgwl6\" (UID: \"38acd46b-6d99-4d86-afc7-88f95742a5ae\") " pod="openshift-image-registry/node-ca-rgwl6"
Jul 06 13:50:14.510765 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.299795    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18c06939-f48c-4f07-9be4-73b7f7968162-agent-certs\") pod \"konnectivity-agent-pqhrv\" (UID: \"18c06939-f48c-4f07-9be4-73b7f7968162\") " pod="kube-system/konnectivity-agent-pqhrv"
Jul 06 13:50:14.511598 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.298702    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aad7c129-baa9-49de-a7fa-343f40af9319-device-dir\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:14.511598 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.303488    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-log-socket\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.511598 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.303574    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-tuned\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.511598 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.303591    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-etc-sysctl-d\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.511598 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.303635    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-host\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.511598 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.303672    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-slash\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.511598 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.303706    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c2b3489c-dd27-4729-99cf-caf01ddf702f-ovnkube-config\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.511598 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.303776    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-host-run-ovn-kubernetes\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.511598 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.303922    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5aafc5d-d7cb-4860-a503-f248e2702592-lib-modules\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.511598 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.303943    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c2b3489c-dd27-4729-99cf-caf01ddf702f-env-overrides\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.511598 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.304078    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c2b3489c-dd27-4729-99cf-caf01ddf702f-run-systemd\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.511598 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.304311    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c2b3489c-dd27-4729-99cf-caf01ddf702f-ovnkube-script-lib\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.511598 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.305845    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2b3489c-dd27-4729-99cf-caf01ddf702f-ovn-node-metrics-cert\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.511598 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.306251    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnwv4\" (UniqueName: \"kubernetes.io/projected/aad7c129-baa9-49de-a7fa-343f40af9319-kube-api-access-pnwv4\") pod \"aws-ebs-csi-driver-node-xbm2r\" (UID: \"aad7c129-baa9-49de-a7fa-343f40af9319\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:14.511598 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:13.306400    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv444\" (UniqueName: \"kubernetes.io/projected/38acd46b-6d99-4d86-afc7-88f95742a5ae-kube-api-access-cv444\") pod \"node-ca-rgwl6\" (UID: \"38acd46b-6d99-4d86-afc7-88f95742a5ae\") " pod="openshift-image-registry/node-ca-rgwl6"
Jul 06 13:50:14.512770 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.508473    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvmzt\" (UniqueName: \"kubernetes.io/projected/a5aafc5d-d7cb-4860-a503-f248e2702592-kube-api-access-cvmzt\") pod \"tuned-8zp9b\" (UID: \"a5aafc5d-d7cb-4860-a503-f248e2702592\") " pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.512770 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.509023    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lpdv\" (UniqueName: \"kubernetes.io/projected/c2b3489c-dd27-4729-99cf-caf01ddf702f-kube-api-access-5lpdv\") pod \"ovnkube-node-nd55z\" (UID: \"c2b3489c-dd27-4729-99cf-caf01ddf702f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.512770 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.510711    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 13:50:14.692671 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.520081    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:14.692671 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.540259    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 13:50:14.692671 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.592679    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-var-lib-cni-multus\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.692671 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.592709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-multus-conf-dir\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.692671 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.592724    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-var-lib-cni-bin\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.692671 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.592738    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/76f82006-d8f6-4783-9872-14bb85bd9712-iptables-alerter-script\") pod \"iptables-alerter-7b8qt\" (UID: \"76f82006-d8f6-4783-9872-14bb85bd9712\") " pod="openshift-network-operator/iptables-alerter-7b8qt"
Jul 06 13:50:14.692671 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.592755    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a94e9db3-8b8e-462e-be17-8c0581a5063a-hosts-file\") pod \"node-resolver-f5jwm\" (UID: \"a94e9db3-8b8e-462e-be17-8c0581a5063a\") " pod="openshift-dns/node-resolver-f5jwm"
Jul 06 13:50:14.692671 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.592778    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret\") pod \"global-pull-secret-syncer-phwdx\" (UID: \"3a9a4e3f-18cb-454f-ac12-66bf74123320\") " pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:14.692671 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.592779    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-multus-conf-dir\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.692671 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.592800    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs\") pod \"network-metrics-daemon-cxr4t\" (UID: \"aab6a8f0-2336-4d20-996a-2ac646db3fa9\") " pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:14.692671 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.592799    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-var-lib-cni-bin\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.692671 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.592840    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a94e9db3-8b8e-462e-be17-8c0581a5063a-hosts-file\") pod \"node-resolver-f5jwm\" (UID: \"a94e9db3-8b8e-462e-be17-8c0581a5063a\") " pod="openshift-dns/node-resolver-f5jwm"
Jul 06 13:50:14.692671 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.592841    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c87f08a-3127-4a61-996f-bc6587e6aac0-system-cni-dir\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.692671 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.592878    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4mcg\" (UniqueName: \"kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg\") pod \"network-check-target-4x77l\" (UID: \"ef2654ab-e7e6-41c8-9631-cc4e714354ff\") " pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:14.692671 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:14.592883    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:50:14.692671 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.592901    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qszmz\" (UniqueName: \"kubernetes.io/projected/a94e9db3-8b8e-462e-be17-8c0581a5063a-kube-api-access-qszmz\") pod \"node-resolver-f5jwm\" (UID: \"a94e9db3-8b8e-462e-be17-8c0581a5063a\") " pod="openshift-dns/node-resolver-f5jwm"
Jul 06 13:50:14.692671 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:14.592910    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:50:14.694878 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.592958    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c87f08a-3127-4a61-996f-bc6587e6aac0-system-cni-dir\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.694878 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.592907    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-var-lib-cni-multus\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.694878 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:14.592937    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret podName:3a9a4e3f-18cb-454f-ac12-66bf74123320 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:15.092917261 +0000 UTC m=+2.136528273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret") pod "global-pull-secret-syncer-phwdx" (UID: "3a9a4e3f-18cb-454f-ac12-66bf74123320") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:50:14.694878 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593153    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c87f08a-3127-4a61-996f-bc6587e6aac0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.694878 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593183    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c87f08a-3127-4a61-996f-bc6587e6aac0-cnibin\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.694878 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593208    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/76f82006-d8f6-4783-9872-14bb85bd9712-iptables-alerter-script\") pod \"iptables-alerter-7b8qt\" (UID: \"76f82006-d8f6-4783-9872-14bb85bd9712\") " pod="openshift-network-operator/iptables-alerter-7b8qt"
Jul 06 13:50:14.694878 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3a9a4e3f-18cb-454f-ac12-66bf74123320-dbus\") pod \"global-pull-secret-syncer-phwdx\" (UID: \"3a9a4e3f-18cb-454f-ac12-66bf74123320\") " pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:14.694878 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:14.593248    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs podName:aab6a8f0-2336-4d20-996a-2ac646db3fa9 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:15.093220341 +0000 UTC m=+2.136831365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs") pod "network-metrics-daemon-cxr4t" (UID: "aab6a8f0-2336-4d20-996a-2ac646db3fa9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:50:14.694878 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593253    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c87f08a-3127-4a61-996f-bc6587e6aac0-cnibin\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.694878 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593273    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3a9a4e3f-18cb-454f-ac12-66bf74123320-dbus\") pod \"global-pull-secret-syncer-phwdx\" (UID: \"3a9a4e3f-18cb-454f-ac12-66bf74123320\") " pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:14.694878 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593302    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmgtc\" (UniqueName: \"kubernetes.io/projected/76f82006-d8f6-4783-9872-14bb85bd9712-kube-api-access-mmgtc\") pod \"iptables-alerter-7b8qt\" (UID: \"76f82006-d8f6-4783-9872-14bb85bd9712\") " pod="openshift-network-operator/iptables-alerter-7b8qt"
Jul 06 13:50:14.694878 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593355    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8xgj\" (UniqueName: \"kubernetes.io/projected/5c87f08a-3127-4a61-996f-bc6587e6aac0-kube-api-access-l8xgj\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.696181 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-hostroot\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.696181 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593406    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-etc-kubernetes\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.696181 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593427    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a94e9db3-8b8e-462e-be17-8c0581a5063a-tmp-dir\") pod \"node-resolver-f5jwm\" (UID: \"a94e9db3-8b8e-462e-be17-8c0581a5063a\") " pod="openshift-dns/node-resolver-f5jwm"
Jul 06 13:50:14.696181 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-run-multus-certs\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.696181 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593485    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76f82006-d8f6-4783-9872-14bb85bd9712-host-slash\") pod \"iptables-alerter-7b8qt\" (UID: \"76f82006-d8f6-4783-9872-14bb85bd9712\") " pod="openshift-network-operator/iptables-alerter-7b8qt"
Jul 06 13:50:14.696181 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593511    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-etc-kubernetes\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.696181 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593512    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-var-lib-kubelet\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.696181 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593554    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-var-lib-kubelet\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.696181 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593583    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76f82006-d8f6-4783-9872-14bb85bd9712-host-slash\") pod \"iptables-alerter-7b8qt\" (UID: \"76f82006-d8f6-4783-9872-14bb85bd9712\") " pod="openshift-network-operator/iptables-alerter-7b8qt"
Jul 06 13:50:14.696181 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593616    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c87f08a-3127-4a61-996f-bc6587e6aac0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.696181 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593660    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-hostroot\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.696181 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593709    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-run-multus-certs\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.696181 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593734    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f746ee95-1693-446d-a812-87d631385277-multus-daemon-config\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.696181 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593763    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a94e9db3-8b8e-462e-be17-8c0581a5063a-tmp-dir\") pod \"node-resolver-f5jwm\" (UID: \"a94e9db3-8b8e-462e-be17-8c0581a5063a\") " pod="openshift-dns/node-resolver-f5jwm"
Jul 06 13:50:14.696181 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thdxd\" (UniqueName: \"kubernetes.io/projected/aab6a8f0-2336-4d20-996a-2ac646db3fa9-kube-api-access-thdxd\") pod \"network-metrics-daemon-cxr4t\" (UID: \"aab6a8f0-2336-4d20-996a-2ac646db3fa9\") " pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:14.696775 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593806    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c87f08a-3127-4a61-996f-bc6587e6aac0-cni-binary-copy\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.696775 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.593829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c87f08a-3127-4a61-996f-bc6587e6aac0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.696775 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.594007    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-run-netns\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.696775 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.594036    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpgcz\" (UniqueName: \"kubernetes.io/projected/f746ee95-1693-446d-a812-87d631385277-kube-api-access-bpgcz\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.696775 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.594072    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c87f08a-3127-4a61-996f-bc6587e6aac0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.696775 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.594079    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3a9a4e3f-18cb-454f-ac12-66bf74123320-kubelet-config\") pod \"global-pull-secret-syncer-phwdx\" (UID: \"3a9a4e3f-18cb-454f-ac12-66bf74123320\") " pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:14.696775 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.594076    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f746ee95-1693-446d-a812-87d631385277-host-run-netns\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.696775 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.594115    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f746ee95-1693-446d-a812-87d631385277-multus-daemon-config\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.696775 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.594240    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c87f08a-3127-4a61-996f-bc6587e6aac0-cni-binary-copy\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.696775 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.594541    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3a9a4e3f-18cb-454f-ac12-66bf74123320-kubelet-config\") pod \"global-pull-secret-syncer-phwdx\" (UID: \"3a9a4e3f-18cb-454f-ac12-66bf74123320\") " pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:14.696775 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.594512    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c87f08a-3127-4a61-996f-bc6587e6aac0-os-release\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.696775 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.594584    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c87f08a-3127-4a61-996f-bc6587e6aac0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.696775 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.594603    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c87f08a-3127-4a61-996f-bc6587e6aac0-os-release\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.696775 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.594965    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c87f08a-3127-4a61-996f-bc6587e6aac0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.697217 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:14.603726    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:50:14.697217 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:14.603739    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:50:14.697217 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:14.603747    2562 projected.go:196] Error preparing data for projected volume kube-api-access-x4mcg for pod openshift-network-diagnostics/network-check-target-4x77l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:50:14.697217 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:14.603798    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg podName:ef2654ab-e7e6-41c8-9631-cc4e714354ff nodeName:}" failed. No retries permitted until 2026-07-06 13:50:15.103787547 +0000 UTC m=+2.147398679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x4mcg" (UniqueName: "kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg") pod "network-check-target-4x77l" (UID: "ef2654ab-e7e6-41c8-9631-cc4e714354ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:50:14.697217 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.606636    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmgtc\" (UniqueName: \"kubernetes.io/projected/76f82006-d8f6-4783-9872-14bb85bd9712-kube-api-access-mmgtc\") pod \"iptables-alerter-7b8qt\" (UID: \"76f82006-d8f6-4783-9872-14bb85bd9712\") " pod="openshift-network-operator/iptables-alerter-7b8qt"
Jul 06 13:50:14.697217 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.607056    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qszmz\" (UniqueName: \"kubernetes.io/projected/a94e9db3-8b8e-462e-be17-8c0581a5063a-kube-api-access-qszmz\") pod \"node-resolver-f5jwm\" (UID: \"a94e9db3-8b8e-462e-be17-8c0581a5063a\") " pod="openshift-dns/node-resolver-f5jwm"
Jul 06 13:50:14.697217 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.607331    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpgcz\" (UniqueName: \"kubernetes.io/projected/f746ee95-1693-446d-a812-87d631385277-kube-api-access-bpgcz\") pod \"multus-rcvp6\" (UID: \"f746ee95-1693-446d-a812-87d631385277\") " pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.697217 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.607439    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thdxd\" (UniqueName: \"kubernetes.io/projected/aab6a8f0-2336-4d20-996a-2ac646db3fa9-kube-api-access-thdxd\") pod \"network-metrics-daemon-cxr4t\" (UID: \"aab6a8f0-2336-4d20-996a-2ac646db3fa9\") " pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:14.697217 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.607901    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8xgj\" (UniqueName: \"kubernetes.io/projected/5c87f08a-3127-4a61-996f-bc6587e6aac0-kube-api-access-l8xgj\") pod \"multus-additional-cni-plugins-hkvfk\" (UID: \"5c87f08a-3127-4a61-996f-bc6587e6aac0\") " pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.697217 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.673685    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r"
Jul 06 13:50:14.697217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:14.680155    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod301d2e284fa3bf2b30f75ef544be44ae.slice/crio-8302b354ea58f915e77714015437a73cace327c0dc8af6ebb456a0c51f68bca1 WatchSource:0}: Error finding container 8302b354ea58f915e77714015437a73cace327c0dc8af6ebb456a0c51f68bca1: Status 404 returned error can't find the container with id 8302b354ea58f915e77714015437a73cace327c0dc8af6ebb456a0c51f68bca1
Jul 06 13:50:14.697217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:14.681958    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e27d054810d078240eb360988177e7.slice/crio-2022437ad81fbbaaec5ca4949350d37f072737dd8b85bdc3aae4b2064c5ed079 WatchSource:0}: Error finding container 2022437ad81fbbaaec5ca4949350d37f072737dd8b85bdc3aae4b2064c5ed079: Status 404 returned error can't find the container with id 2022437ad81fbbaaec5ca4949350d37f072737dd8b85bdc3aae4b2064c5ed079
Jul 06 13:50:14.697217 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.685679    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 13:50:14.697217 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:14.685800    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad7c129_baa9_49de_a7fa_343f40af9319.slice/crio-ffff732e30dcc4b220b9a2905d74e0145ffaf2396740f77bfc5cc32a80151427 WatchSource:0}: Error finding container ffff732e30dcc4b220b9a2905d74e0145ffaf2396740f77bfc5cc32a80151427: Status 404 returned error can't find the container with id ffff732e30dcc4b220b9a2905d74e0145ffaf2396740f77bfc5cc32a80151427
Jul 06 13:50:14.882240 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.710623    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hkvfk"
Jul 06 13:50:14.882240 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:14.718503    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c87f08a_3127_4a61_996f_bc6587e6aac0.slice/crio-c57c7e53cffef73babdbcb30426f957b1a9f6426a0a976df0bd541fd1fafee41 WatchSource:0}: Error finding container c57c7e53cffef73babdbcb30426f957b1a9f6426a0a976df0bd541fd1fafee41: Status 404 returned error can't find the container with id c57c7e53cffef73babdbcb30426f957b1a9f6426a0a976df0bd541fd1fafee41
Jul 06 13:50:14.882240 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.731219    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pqhrv"
Jul 06 13:50:14.882240 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:14.738343    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c06939_f48c_4f07_9be4_73b7f7968162.slice/crio-bec21c323f33992b4e6497ba8a827a0457555c6d98301b4f0e8a2ed39c76d8e8 WatchSource:0}: Error finding container bec21c323f33992b4e6497ba8a827a0457555c6d98301b4f0e8a2ed39c76d8e8: Status 404 returned error can't find the container with id bec21c323f33992b4e6497ba8a827a0457555c6d98301b4f0e8a2ed39c76d8e8
Jul 06 13:50:14.882240 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.747143    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rcvp6"
Jul 06 13:50:14.882240 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:14.756230    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf746ee95_1693_446d_a812_87d631385277.slice/crio-166088a466337818e04dc53a2840653546eae7e7ad49f764bcb725e0cda51b6c WatchSource:0}: Error finding container 166088a466337818e04dc53a2840653546eae7e7ad49f764bcb725e0cda51b6c: Status 404 returned error can't find the container with id 166088a466337818e04dc53a2840653546eae7e7ad49f764bcb725e0cda51b6c
Jul 06 13:50:14.882240 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.766719    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8zp9b"
Jul 06 13:50:14.882240 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.774086    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rgwl6"
Jul 06 13:50:14.882240 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:14.775764    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5aafc5d_d7cb_4860_a503_f248e2702592.slice/crio-189748fe4ebbadc057876a54a6b4f528784bae303ae79ee274b83d9b2ea2a645 WatchSource:0}: Error finding container 189748fe4ebbadc057876a54a6b4f528784bae303ae79ee274b83d9b2ea2a645: Status 404 returned error can't find the container with id 189748fe4ebbadc057876a54a6b4f528784bae303ae79ee274b83d9b2ea2a645
Jul 06 13:50:14.882240 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:14.780969    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38acd46b_6d99_4d86_afc7_88f95742a5ae.slice/crio-d145bdc4a3d8219da17383478e0031ed0dd3b4e224eb513d01bdf055e0e90b63 WatchSource:0}: Error finding container d145bdc4a3d8219da17383478e0031ed0dd3b4e224eb513d01bdf055e0e90b63: Status 404 returned error can't find the container with id d145bdc4a3d8219da17383478e0031ed0dd3b4e224eb513d01bdf055e0e90b63
Jul 06 13:50:14.882240 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.839238    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f5jwm"
Jul 06 13:50:14.882240 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:14.843745    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7b8qt"
Jul 06 13:50:14.882240 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:14.847326    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda94e9db3_8b8e_462e_be17_8c0581a5063a.slice/crio-fbb53a90918bd9112c2f68557197bd3e017b2d9a238b261ffc738243253347a7 WatchSource:0}: Error finding container fbb53a90918bd9112c2f68557197bd3e017b2d9a238b261ffc738243253347a7: Status 404 returned error can't find the container with id fbb53a90918bd9112c2f68557197bd3e017b2d9a238b261ffc738243253347a7
Jul 06 13:50:14.882240 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:14.853196    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f82006_d8f6_4783_9872_14bb85bd9712.slice/crio-d7db351becc1ffdcc0ee1e018f8b006524f4d4298a21de5817a4b169654b9639 WatchSource:0}: Error finding container d7db351becc1ffdcc0ee1e018f8b006524f4d4298a21de5817a4b169654b9639: Status 404 returned error can't find the container with id d7db351becc1ffdcc0ee1e018f8b006524f4d4298a21de5817a4b169654b9639
Jul 06 13:50:15.095080 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:14.894490    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b3489c_dd27_4729_99cf_caf01ddf702f.slice/crio-26083d7d89d674187bf0e844a00ad9e6eb5e9986cd1a2933046a28ad9a82284b WatchSource:0}: Error finding container 26083d7d89d674187bf0e844a00ad9e6eb5e9986cd1a2933046a28ad9a82284b: Status 404 returned error can't find the container with id 26083d7d89d674187bf0e844a00ad9e6eb5e9986cd1a2933046a28ad9a82284b
Jul 06 13:50:15.299145 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.098189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret\") pod \"global-pull-secret-syncer-phwdx\" (UID: \"3a9a4e3f-18cb-454f-ac12-66bf74123320\") " pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:15.299145 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.098213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs\") pod \"network-metrics-daemon-cxr4t\" (UID: \"aab6a8f0-2336-4d20-996a-2ac646db3fa9\") " pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:15.299145 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:15.098309    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:50:15.299145 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:15.098325    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:50:15.299145 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:15.098351    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs podName:aab6a8f0-2336-4d20-996a-2ac646db3fa9 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:16.098336953 +0000 UTC m=+3.141947968 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs") pod "network-metrics-daemon-cxr4t" (UID: "aab6a8f0-2336-4d20-996a-2ac646db3fa9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:50:15.299145 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:15.098366    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret podName:3a9a4e3f-18cb-454f-ac12-66bf74123320 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:16.098355749 +0000 UTC m=+3.141966761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret") pod "global-pull-secret-syncer-phwdx" (UID: "3a9a4e3f-18cb-454f-ac12-66bf74123320") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:50:15.299145 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.199162    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4mcg\" (UniqueName: \"kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg\") pod \"network-check-target-4x77l\" (UID: \"ef2654ab-e7e6-41c8-9631-cc4e714354ff\") " pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:15.299145 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:15.199302    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:50:15.299145 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:15.199316    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:50:15.299145 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:15.199324    2562 projected.go:196] Error preparing data for projected volume kube-api-access-x4mcg for pod openshift-network-diagnostics/network-check-target-4x77l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:50:15.299145 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:15.199363    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg podName:ef2654ab-e7e6-41c8-9631-cc4e714354ff nodeName:}" failed. No retries permitted until 2026-07-06 13:50:16.199351763 +0000 UTC m=+3.242962775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4mcg" (UniqueName: "kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg") pod "network-check-target-4x77l" (UID: "ef2654ab-e7e6-41c8-9631-cc4e714354ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:50:15.448746 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.448239    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 13:45:14 +0000 UTC" deadline="2027-12-08 01:47:16.673917467 +0000 UTC"
Jul 06 13:50:15.448746 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.448301    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12467h57m1.225639322s"
Jul 06 13:50:15.512678 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.474609    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:15.512678 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:15.474734    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:15.512678 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.503342    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pqhrv" event={"ID":"18c06939-f48c-4f07-9be4-73b7f7968162","Type":"ContainerStarted","Data":"bec21c323f33992b4e6497ba8a827a0457555c6d98301b4f0e8a2ed39c76d8e8"}
Jul 06 13:50:15.575977 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.521054    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkvfk" event={"ID":"5c87f08a-3127-4a61-996f-bc6587e6aac0","Type":"ContainerStarted","Data":"c57c7e53cffef73babdbcb30426f957b1a9f6426a0a976df0bd541fd1fafee41"}
Jul 06 13:50:15.575977 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.529937    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal" event={"ID":"301d2e284fa3bf2b30f75ef544be44ae","Type":"ContainerStarted","Data":"8302b354ea58f915e77714015437a73cace327c0dc8af6ebb456a0c51f68bca1"}
Jul 06 13:50:15.575977 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.533185    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rgwl6" event={"ID":"38acd46b-6d99-4d86-afc7-88f95742a5ae","Type":"ContainerStarted","Data":"d145bdc4a3d8219da17383478e0031ed0dd3b4e224eb513d01bdf055e0e90b63"}
Jul 06 13:50:15.575977 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.537089    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r" event={"ID":"aad7c129-baa9-49de-a7fa-343f40af9319","Type":"ContainerStarted","Data":"ffff732e30dcc4b220b9a2905d74e0145ffaf2396740f77bfc5cc32a80151427"}
Jul 06 13:50:15.575977 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.540172    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal" event={"ID":"27e27d054810d078240eb360988177e7","Type":"ContainerStarted","Data":"2022437ad81fbbaaec5ca4949350d37f072737dd8b85bdc3aae4b2064c5ed079"}
Jul 06 13:50:15.575977 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.541713    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z" event={"ID":"c2b3489c-dd27-4729-99cf-caf01ddf702f","Type":"ContainerStarted","Data":"26083d7d89d674187bf0e844a00ad9e6eb5e9986cd1a2933046a28ad9a82284b"}
Jul 06 13:50:15.575977 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.545239    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7b8qt" event={"ID":"76f82006-d8f6-4783-9872-14bb85bd9712","Type":"ContainerStarted","Data":"d7db351becc1ffdcc0ee1e018f8b006524f4d4298a21de5817a4b169654b9639"}
Jul 06 13:50:15.575977 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.548202    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f5jwm" event={"ID":"a94e9db3-8b8e-462e-be17-8c0581a5063a","Type":"ContainerStarted","Data":"fbb53a90918bd9112c2f68557197bd3e017b2d9a238b261ffc738243253347a7"}
Jul 06 13:50:15.575977 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.551839    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8zp9b" event={"ID":"a5aafc5d-d7cb-4860-a503-f248e2702592","Type":"ContainerStarted","Data":"189748fe4ebbadc057876a54a6b4f528784bae303ae79ee274b83d9b2ea2a645"}
Jul 06 13:50:15.575977 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.555738    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rcvp6" event={"ID":"f746ee95-1693-446d-a812-87d631385277","Type":"ContainerStarted","Data":"166088a466337818e04dc53a2840653546eae7e7ad49f764bcb725e0cda51b6c"}
Jul 06 13:50:15.719934 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:15.672195    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 13:50:16.153849 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:16.153774    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret\") pod \"global-pull-secret-syncer-phwdx\" (UID: \"3a9a4e3f-18cb-454f-ac12-66bf74123320\") " pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:16.153849 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:16.153820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs\") pod \"network-metrics-daemon-cxr4t\" (UID: \"aab6a8f0-2336-4d20-996a-2ac646db3fa9\") " pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:16.154075 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:16.153938    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:50:16.154075 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:16.154005    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret podName:3a9a4e3f-18cb-454f-ac12-66bf74123320 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:18.153985844 +0000 UTC m=+5.197596875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret") pod "global-pull-secret-syncer-phwdx" (UID: "3a9a4e3f-18cb-454f-ac12-66bf74123320") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:50:16.154075 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:16.153947    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:50:16.154075 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:16.154065    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs podName:aab6a8f0-2336-4d20-996a-2ac646db3fa9 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:18.154048983 +0000 UTC m=+5.197660000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs") pod "network-metrics-daemon-cxr4t" (UID: "aab6a8f0-2336-4d20-996a-2ac646db3fa9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:50:16.254356 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:16.254245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4mcg\" (UniqueName: \"kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg\") pod \"network-check-target-4x77l\" (UID: \"ef2654ab-e7e6-41c8-9631-cc4e714354ff\") " pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:16.254506 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:16.254406    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:50:16.254506 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:16.254423    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:50:16.254506 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:16.254436    2562 projected.go:196] Error preparing data for projected volume kube-api-access-x4mcg for pod openshift-network-diagnostics/network-check-target-4x77l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:50:16.254506 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:16.254483    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg podName:ef2654ab-e7e6-41c8-9631-cc4e714354ff nodeName:}" failed. No retries permitted until 2026-07-06 13:50:18.254466927 +0000 UTC m=+5.298077941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4mcg" (UniqueName: "kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg") pod "network-check-target-4x77l" (UID: "ef2654ab-e7e6-41c8-9631-cc4e714354ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:50:16.450861 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:16.450727    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 13:45:14 +0000 UTC" deadline="2027-12-25 21:55:14.081393085 +0000 UTC"
Jul 06 13:50:16.450861 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:16.450778    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12896h4m57.630618803s"
Jul 06 13:50:16.472133 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:16.471528    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:16.472133 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:16.471643    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4x77l" podUID="ef2654ab-e7e6-41c8-9631-cc4e714354ff"
Jul 06 13:50:16.472133 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:16.472003    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:16.472133 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:16.472089    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phwdx" podUID="3a9a4e3f-18cb-454f-ac12-66bf74123320"
Jul 06 13:50:17.472690 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:17.472174    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:17.472690 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:17.472335    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:18.169311 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:18.169266    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret\") pod \"global-pull-secret-syncer-phwdx\" (UID: \"3a9a4e3f-18cb-454f-ac12-66bf74123320\") " pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:18.169478 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:18.169329    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs\") pod \"network-metrics-daemon-cxr4t\" (UID: \"aab6a8f0-2336-4d20-996a-2ac646db3fa9\") " pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:18.169478 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:18.169438    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:50:18.169581 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:18.169480    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:50:18.169581 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:18.169505    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret podName:3a9a4e3f-18cb-454f-ac12-66bf74123320 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:22.169487039 +0000 UTC m=+9.213098052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret") pod "global-pull-secret-syncer-phwdx" (UID: "3a9a4e3f-18cb-454f-ac12-66bf74123320") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:50:18.169581 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:18.169532    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs podName:aab6a8f0-2336-4d20-996a-2ac646db3fa9 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:22.169516891 +0000 UTC m=+9.213127906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs") pod "network-metrics-daemon-cxr4t" (UID: "aab6a8f0-2336-4d20-996a-2ac646db3fa9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:50:18.269919 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:18.269887    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4mcg\" (UniqueName: \"kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg\") pod \"network-check-target-4x77l\" (UID: \"ef2654ab-e7e6-41c8-9631-cc4e714354ff\") " pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:18.270079 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:18.270032    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:50:18.270079 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:18.270052    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:50:18.270079 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:18.270063    2562 projected.go:196] Error preparing data for projected volume kube-api-access-x4mcg for pod openshift-network-diagnostics/network-check-target-4x77l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:50:18.270244 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:18.270115    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg podName:ef2654ab-e7e6-41c8-9631-cc4e714354ff nodeName:}" failed. No retries permitted until 2026-07-06 13:50:22.270096628 +0000 UTC m=+9.313707644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4mcg" (UniqueName: "kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg") pod "network-check-target-4x77l" (UID: "ef2654ab-e7e6-41c8-9631-cc4e714354ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:50:18.471208 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:18.471140    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:18.471367 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:18.471277    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4x77l" podUID="ef2654ab-e7e6-41c8-9631-cc4e714354ff"
Jul 06 13:50:18.471468 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:18.471140    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:18.471578 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:18.471544    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phwdx" podUID="3a9a4e3f-18cb-454f-ac12-66bf74123320"
Jul 06 13:50:19.473111 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:19.473082    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:19.473606 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:19.473214    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:20.471314 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:20.471267    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:20.471569 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:20.471405    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4x77l" podUID="ef2654ab-e7e6-41c8-9631-cc4e714354ff"
Jul 06 13:50:20.471569 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:20.471447    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:20.471854 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:20.471744    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phwdx" podUID="3a9a4e3f-18cb-454f-ac12-66bf74123320"
Jul 06 13:50:21.471586 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:21.471549    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:21.472010 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:21.471702    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:22.195248 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:22.195017    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret\") pod \"global-pull-secret-syncer-phwdx\" (UID: \"3a9a4e3f-18cb-454f-ac12-66bf74123320\") " pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:22.195248 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:22.195063    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs\") pod \"network-metrics-daemon-cxr4t\" (UID: \"aab6a8f0-2336-4d20-996a-2ac646db3fa9\") " pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:22.195248 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:22.195139    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:50:22.195248 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:22.195150    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:50:22.195248 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:22.195207    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret podName:3a9a4e3f-18cb-454f-ac12-66bf74123320 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:30.19519051 +0000 UTC m=+17.238801525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret") pod "global-pull-secret-syncer-phwdx" (UID: "3a9a4e3f-18cb-454f-ac12-66bf74123320") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:50:22.195248 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:22.195226    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs podName:aab6a8f0-2336-4d20-996a-2ac646db3fa9 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:30.1952171 +0000 UTC m=+17.238828124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs") pod "network-metrics-daemon-cxr4t" (UID: "aab6a8f0-2336-4d20-996a-2ac646db3fa9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:50:22.296449 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:22.296298    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4mcg\" (UniqueName: \"kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg\") pod \"network-check-target-4x77l\" (UID: \"ef2654ab-e7e6-41c8-9631-cc4e714354ff\") " pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:22.296620 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:22.296467    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:50:22.296620 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:22.296486    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:50:22.296620 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:22.296498    2562 projected.go:196] Error preparing data for projected volume kube-api-access-x4mcg for pod openshift-network-diagnostics/network-check-target-4x77l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:50:22.296620 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:22.296563    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg podName:ef2654ab-e7e6-41c8-9631-cc4e714354ff nodeName:}" failed. No retries permitted until 2026-07-06 13:50:30.296536553 +0000 UTC m=+17.340147582 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4mcg" (UniqueName: "kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg") pod "network-check-target-4x77l" (UID: "ef2654ab-e7e6-41c8-9631-cc4e714354ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:50:22.472396 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:22.471765    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:22.472396 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:22.471872    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4x77l" podUID="ef2654ab-e7e6-41c8-9631-cc4e714354ff"
Jul 06 13:50:22.472396 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:22.472176    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:22.472396 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:22.472294    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phwdx" podUID="3a9a4e3f-18cb-454f-ac12-66bf74123320"
Jul 06 13:50:23.474011 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:23.472765    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:23.474011 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:23.472884    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:24.471195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:24.471147    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:24.471195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:24.471183    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:24.471461 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:24.471263    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4x77l" podUID="ef2654ab-e7e6-41c8-9631-cc4e714354ff"
Jul 06 13:50:24.471461 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:24.471393    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phwdx" podUID="3a9a4e3f-18cb-454f-ac12-66bf74123320"
Jul 06 13:50:25.471454 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:25.471331    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:25.471910 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:25.471481    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:26.471921 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:26.471892    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:26.472377 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:26.471891    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:26.472377 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:26.472020    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phwdx" podUID="3a9a4e3f-18cb-454f-ac12-66bf74123320"
Jul 06 13:50:26.472377 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:26.472087    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4x77l" podUID="ef2654ab-e7e6-41c8-9631-cc4e714354ff"
Jul 06 13:50:27.472001 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:27.471970    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:27.472397 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:27.472110    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:28.471499 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:28.471444    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:28.471656 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:28.471556    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4x77l" podUID="ef2654ab-e7e6-41c8-9631-cc4e714354ff"
Jul 06 13:50:28.471656 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:28.471615    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:28.471773 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:28.471718    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phwdx" podUID="3a9a4e3f-18cb-454f-ac12-66bf74123320"
Jul 06 13:50:29.471652 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:29.471615    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:29.472108 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:29.471737    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:30.265062 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:30.265032    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret\") pod \"global-pull-secret-syncer-phwdx\" (UID: \"3a9a4e3f-18cb-454f-ac12-66bf74123320\") " pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:30.265233 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:30.265071    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs\") pod \"network-metrics-daemon-cxr4t\" (UID: \"aab6a8f0-2336-4d20-996a-2ac646db3fa9\") " pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:30.265233 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:30.265192    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:50:30.265233 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:30.265196    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:50:30.265436 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:30.265251    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs podName:aab6a8f0-2336-4d20-996a-2ac646db3fa9 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:46.265232671 +0000 UTC m=+33.308843685 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs") pod "network-metrics-daemon-cxr4t" (UID: "aab6a8f0-2336-4d20-996a-2ac646db3fa9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:50:30.265436 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:30.265269    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret podName:3a9a4e3f-18cb-454f-ac12-66bf74123320 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:46.265259926 +0000 UTC m=+33.308870938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret") pod "global-pull-secret-syncer-phwdx" (UID: "3a9a4e3f-18cb-454f-ac12-66bf74123320") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:50:30.365733 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:30.365706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4mcg\" (UniqueName: \"kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg\") pod \"network-check-target-4x77l\" (UID: \"ef2654ab-e7e6-41c8-9631-cc4e714354ff\") " pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:30.365909 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:30.365891    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:50:30.365955 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:30.365917    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:50:30.365955 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:30.365931    2562 projected.go:196] Error preparing data for projected volume kube-api-access-x4mcg for pod openshift-network-diagnostics/network-check-target-4x77l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:50:30.366030 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:30.365989    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg podName:ef2654ab-e7e6-41c8-9631-cc4e714354ff nodeName:}" failed. No retries permitted until 2026-07-06 13:50:46.365970683 +0000 UTC m=+33.409581702 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4mcg" (UniqueName: "kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg") pod "network-check-target-4x77l" (UID: "ef2654ab-e7e6-41c8-9631-cc4e714354ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:50:30.471410 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:30.471381    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:30.471571 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:30.471491    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4x77l" podUID="ef2654ab-e7e6-41c8-9631-cc4e714354ff"
Jul 06 13:50:30.471571 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:30.471527    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:30.471679 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:30.471588    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phwdx" podUID="3a9a4e3f-18cb-454f-ac12-66bf74123320"
Jul 06 13:50:31.471707 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:31.471677    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:31.472084 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:31.471811    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:32.471145 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:32.470957    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:32.471310 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:32.470969    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:32.471310 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:32.471212    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phwdx" podUID="3a9a4e3f-18cb-454f-ac12-66bf74123320"
Jul 06 13:50:32.471412 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:32.471312    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4x77l" podUID="ef2654ab-e7e6-41c8-9631-cc4e714354ff"
Jul 06 13:50:33.472007 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:33.471976    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:33.472456 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:33.472092    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:34.471255 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:34.471199    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:34.471370 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:34.471322    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4x77l" podUID="ef2654ab-e7e6-41c8-9631-cc4e714354ff"
Jul 06 13:50:34.471370 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:34.471356    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:34.471473 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:34.471433    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phwdx" podUID="3a9a4e3f-18cb-454f-ac12-66bf74123320"
Jul 06 13:50:34.595489 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:34.595465    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8zp9b" event={"ID":"a5aafc5d-d7cb-4860-a503-f248e2702592","Type":"ContainerStarted","Data":"f496336ace68f3cd5f481e19020784dfa393cccbfab4690ec978d01424ce0b70"}
Jul 06 13:50:34.597133 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:34.596907    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rcvp6" event={"ID":"f746ee95-1693-446d-a812-87d631385277","Type":"ContainerStarted","Data":"db73344e14701e599a5b91302045bd723f3a8298f764570c7042de10ac9bca2c"}
Jul 06 13:50:34.598370 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:34.598347    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal" event={"ID":"301d2e284fa3bf2b30f75ef544be44ae","Type":"ContainerStarted","Data":"b0b5f7d805a3a752f1fa597cbde4ae621386d4b02511b79c67f9923a1723bb97"}
Jul 06 13:50:34.634213 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:34.634165    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rcvp6" podStartSLOduration=2.2661825110000002 podStartE2EDuration="21.634146852s" totalImagesPullingTime="19.367964341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:34.632562959 +0000 UTC m=+21.676173986" watchObservedRunningTime="2026-07-06 13:50:34.634146852 +0000 UTC m=+21.677757886"
Jul 06 13:50:34.634818 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:34.634778    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8zp9b" podStartSLOduration=2.30129846 podStartE2EDuration="21.634766165s" totalImagesPullingTime="19.333467705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:34.61358076 +0000 UTC m=+21.657191793" watchObservedRunningTime="2026-07-06 13:50:34.634766165 +0000 UTC m=+21.678377199"
Jul 06 13:50:35.472116 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:35.471895    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:35.472265 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:35.472227    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:35.604205 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:35.604188    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 13:50:35.604899 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:35.604589    2562 generic.go:356] "Generic (PLEG): container finished" podID="c2b3489c-dd27-4729-99cf-caf01ddf702f" containerID="121fbb444660e8bd2bf200459a92fde966ff9f63ea597b77598d0b61533b4fdd" exitCode=1
Jul 06 13:50:35.604899 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:35.604656    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z" event={"ID":"c2b3489c-dd27-4729-99cf-caf01ddf702f","Type":"ContainerStarted","Data":"e1f2eebf318cc2f8e61cc88ee79e5aa1bf35edf7702853fd11b718029cac602b"}
Jul 06 13:50:35.604899 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:35.604718    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z" event={"ID":"c2b3489c-dd27-4729-99cf-caf01ddf702f","Type":"ContainerStarted","Data":"e83caa6e0cb80e04ed217fb9eb9a999628f73f8ca9f59c0edc0763f897715094"}
Jul 06 13:50:35.604899 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:35.604748    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z" event={"ID":"c2b3489c-dd27-4729-99cf-caf01ddf702f","Type":"ContainerStarted","Data":"a1afca7c642ff05dfaae5aed8afadb909a987338bdf2da5e750d09d5cf33c92a"}
Jul 06 13:50:35.604899 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:35.604783    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z" event={"ID":"c2b3489c-dd27-4729-99cf-caf01ddf702f","Type":"ContainerStarted","Data":"6383b933a42d0dc4ba743ef732eb8e049295bc8ac6d3083d661d3b4c298a078f"}
Jul 06 13:50:35.604899 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:35.604813    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z" event={"ID":"c2b3489c-dd27-4729-99cf-caf01ddf702f","Type":"ContainerDied","Data":"121fbb444660e8bd2bf200459a92fde966ff9f63ea597b77598d0b61533b4fdd"}
Jul 06 13:50:35.604899 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:35.604850    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z" event={"ID":"c2b3489c-dd27-4729-99cf-caf01ddf702f","Type":"ContainerStarted","Data":"636b4c5c147ba0e02a61b536dc5e31e46b48ea8eac7f15261183a50042d63ffd"}
Jul 06 13:50:35.606203 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:35.606180    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7b8qt" event={"ID":"76f82006-d8f6-4783-9872-14bb85bd9712","Type":"ContainerStarted","Data":"e118e0b99e618fa671f36eb4bd2a643e974234172bee12a3bbaacf42b7084e2e"}
Jul 06 13:50:35.631674 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:35.631639    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7b8qt" podStartSLOduration=3.375726666 podStartE2EDuration="22.631627884s" totalImagesPullingTime="19.255901218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:35.631619275 +0000 UTC m=+22.675230308" watchObservedRunningTime="2026-07-06 13:50:35.631627884 +0000 UTC m=+22.675238917"
Jul 06 13:50:35.632104 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:35.632084    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-29.ec2.internal" podStartSLOduration=21.632077914 podStartE2EDuration="21.632077914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:50:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:34.666350739 +0000 UTC m=+21.709961799" watchObservedRunningTime="2026-07-06 13:50:35.632077914 +0000 UTC m=+22.675688993"
Jul 06 13:50:36.472051 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:36.471871    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:36.472191 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:36.471875    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:36.472191 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:36.472118    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4x77l" podUID="ef2654ab-e7e6-41c8-9631-cc4e714354ff"
Jul 06 13:50:36.472310 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:36.472184    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phwdx" podUID="3a9a4e3f-18cb-454f-ac12-66bf74123320"
Jul 06 13:50:36.609999 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:36.609967    2562 generic.go:356] "Generic (PLEG): container finished" podID="27e27d054810d078240eb360988177e7" containerID="88398cb8222988a5a60817ea8acd71fbc3f80cb1ee7742db48b673c3a2943f6d" exitCode=0
Jul 06 13:50:36.609999 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:36.609985    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal" event={"ID":"27e27d054810d078240eb360988177e7","Type":"ContainerDied","Data":"88398cb8222988a5a60817ea8acd71fbc3f80cb1ee7742db48b673c3a2943f6d"}
Jul 06 13:50:36.611889 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:36.611860    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f5jwm" event={"ID":"a94e9db3-8b8e-462e-be17-8c0581a5063a","Type":"ContainerStarted","Data":"e0bfe2b4e38cc4c566c0484651bcdfe09a770da33860a038b3026cf96bb448a2"}
Jul 06 13:50:36.614350 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:36.614324    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pqhrv" event={"ID":"18c06939-f48c-4f07-9be4-73b7f7968162","Type":"ContainerStarted","Data":"86b31f8445d3a074d2bbeb60e5660928053408039a493ae3a5d129dec1a35dcf"}
Jul 06 13:50:36.617377 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:36.617352    2562 generic.go:356] "Generic (PLEG): container finished" podID="5c87f08a-3127-4a61-996f-bc6587e6aac0" containerID="9d4868559a6e5705b5ac5ecef7051f7aa071c3bee7b45e507a0e07ddb2eb5282" exitCode=0
Jul 06 13:50:36.617478 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:36.617451    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkvfk" event={"ID":"5c87f08a-3127-4a61-996f-bc6587e6aac0","Type":"ContainerDied","Data":"9d4868559a6e5705b5ac5ecef7051f7aa071c3bee7b45e507a0e07ddb2eb5282"}
Jul 06 13:50:36.619234 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:36.619211    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rgwl6" event={"ID":"38acd46b-6d99-4d86-afc7-88f95742a5ae","Type":"ContainerStarted","Data":"7a6e072fe2e3832863074436ff0b823c0f372dcafd6a6c9b9037e21b3921aa55"}
Jul 06 13:50:36.620808 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:36.620772    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r" event={"ID":"aad7c129-baa9-49de-a7fa-343f40af9319","Type":"ContainerStarted","Data":"58d0a3f754797e4e2f888f37ba850754afe13f2549af1e7e01a9be3c1d7ad72f"}
Jul 06 13:50:36.644627 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:36.644584    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pqhrv" podStartSLOduration=4.4242610110000005 podStartE2EDuration="23.644566867s" totalImagesPullingTime="19.220305856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:36.643806187 +0000 UTC m=+23.687417220" watchObservedRunningTime="2026-07-06 13:50:36.644566867 +0000 UTC m=+23.688177901"
Jul 06 13:50:36.663953 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:36.663907    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f5jwm" podStartSLOduration=4.388496804 podStartE2EDuration="23.663892894s" totalImagesPullingTime="19.27539609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:36.663575421 +0000 UTC m=+23.707186455" watchObservedRunningTime="2026-07-06 13:50:36.663892894 +0000 UTC m=+23.707503928"
Jul 06 13:50:36.703235 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:36.703189    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rgwl6" podStartSLOduration=4.3749229 podStartE2EDuration="23.703166269s" totalImagesPullingTime="19.328243369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:36.703049681 +0000 UTC m=+23.746660714" watchObservedRunningTime="2026-07-06 13:50:36.703166269 +0000 UTC m=+23.746777303"
Jul 06 13:50:37.114907 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:37.114887    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 13:50:37.195623 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:37.195602    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pqhrv"
Jul 06 13:50:37.196118 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:37.196103    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pqhrv"
Jul 06 13:50:37.465379 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:37.465278    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T13:50:37.114903579Z","UUID":"b8f6bc12-dfae-4ee3-8b8e-acc327e4158a","Handler":null,"Name":"","Endpoint":""}
Jul 06 13:50:37.466532 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:37.466510    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 13:50:37.466608 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:37.466558    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 13:50:37.471380 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:37.471359    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:37.471474 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:37.471459    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:37.625387 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:37.625358    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 13:50:37.625755 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:37.625739    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z" event={"ID":"c2b3489c-dd27-4729-99cf-caf01ddf702f","Type":"ContainerStarted","Data":"8f0b5fe6eeda862c725ad4a8a9dc82fa7d2959d6b46935c3edde57befaa1be2e"}
Jul 06 13:50:37.627374 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:37.627351    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r" event={"ID":"aad7c129-baa9-49de-a7fa-343f40af9319","Type":"ContainerStarted","Data":"3a4b84c71dc97ad0e33ed426ec59905015b9860a1016172d6918478bbe1f002c"}
Jul 06 13:50:37.628909 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:37.628888    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal" event={"ID":"27e27d054810d078240eb360988177e7","Type":"ContainerStarted","Data":"64bcc01d00586281475ab8ff55034faefc51f22395102b1f235834aa4dcac02d"}
Jul 06 13:50:37.648400 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:37.646592    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-29.ec2.internal" podStartSLOduration=23.646576906 podStartE2EDuration="23.646576906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:50:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:37.646175484 +0000 UTC m=+24.689786729" watchObservedRunningTime="2026-07-06 13:50:37.646576906 +0000 UTC m=+24.690187952"
Jul 06 13:50:38.471976 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:38.471952    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:38.472085 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:38.472060    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4x77l" podUID="ef2654ab-e7e6-41c8-9631-cc4e714354ff"
Jul 06 13:50:38.472154 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:38.472118    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:38.472222 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:38.472203    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phwdx" podUID="3a9a4e3f-18cb-454f-ac12-66bf74123320"
Jul 06 13:50:38.633164 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:38.633096    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r" event={"ID":"aad7c129-baa9-49de-a7fa-343f40af9319","Type":"ContainerStarted","Data":"b9978202694c632a722f257fbd97d1fe9b90e0ea1f65796606fd85103f0c0e67"}
Jul 06 13:50:38.633535 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:38.633475    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 13:50:39.472057 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:39.472030    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:39.472198 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:39.472154    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:39.638007 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:39.637983    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 13:50:39.638517 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:39.638395    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z" event={"ID":"c2b3489c-dd27-4729-99cf-caf01ddf702f","Type":"ContainerStarted","Data":"4faaab7b7940139bacf2a61fecaa3a140e86fa49881f4114bf85a3b2ab51990e"}
Jul 06 13:50:39.806664 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:39.806586    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pqhrv"
Jul 06 13:50:39.806773 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:39.806718    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 13:50:39.807342 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:39.807324    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pqhrv"
Jul 06 13:50:39.823721 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:39.823674    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm2r" podStartSLOduration=4.912034148 podStartE2EDuration="26.823660554s" totalImagesPullingTime="21.911626406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:50:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:38.653145597 +0000 UTC m=+25.696756630" watchObservedRunningTime="2026-07-06 13:50:39.823660554 +0000 UTC m=+26.867271586"
Jul 06 13:50:40.471789 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:40.471764    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:40.471920 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:40.471853    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4x77l" podUID="ef2654ab-e7e6-41c8-9631-cc4e714354ff"
Jul 06 13:50:40.471920 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:40.471911    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:40.472014 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:40.471997    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phwdx" podUID="3a9a4e3f-18cb-454f-ac12-66bf74123320"
Jul 06 13:50:40.640402 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:40.640374    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:40.640841 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:40.640455    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:40.640841 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:40.640536    2562 scope.go:117] "RemoveContainer" containerID="121fbb444660e8bd2bf200459a92fde966ff9f63ea597b77598d0b61533b4fdd"
Jul 06 13:50:40.655958 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:40.655938    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:41.471450 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:41.471201    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:41.471590 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:41.471567    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:41.515236 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:41.515196    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-phwdx"]
Jul 06 13:50:41.515370 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:41.515315    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:41.515437 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:41.515410    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phwdx" podUID="3a9a4e3f-18cb-454f-ac12-66bf74123320"
Jul 06 13:50:41.517731 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:41.517707    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cxr4t"]
Jul 06 13:50:41.520750 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:41.520725    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4x77l"]
Jul 06 13:50:41.520841 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:41.520822    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:41.520933 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:41.520909    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4x77l" podUID="ef2654ab-e7e6-41c8-9631-cc4e714354ff"
Jul 06 13:50:41.646320 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:41.646295    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 13:50:41.646744 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:41.646683    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z" event={"ID":"c2b3489c-dd27-4729-99cf-caf01ddf702f","Type":"ContainerStarted","Data":"519543fa85fa9432206352f8b1539a0ad3696666b0874bb11dfee6f6952a8fba"}
Jul 06 13:50:41.646744 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:41.646698    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:41.646822 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:41.646797    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:41.646988 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:41.646964    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:41.663054 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:41.663034    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:50:41.685233 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:41.685195    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z" podStartSLOduration=8.898526766 podStartE2EDuration="28.685177793s" totalImagesPullingTime="19.786651027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:41.684343318 +0000 UTC m=+28.727954375" watchObservedRunningTime="2026-07-06 13:50:41.685177793 +0000 UTC m=+28.728788829"
Jul 06 13:50:43.471779 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:43.471751    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:43.472087 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:43.471824    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phwdx" podUID="3a9a4e3f-18cb-454f-ac12-66bf74123320"
Jul 06 13:50:43.472087 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:43.471930    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:43.472087 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:43.472068    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:43.472243 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:43.472103    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:43.472243 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:43.472198    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4x77l" podUID="ef2654ab-e7e6-41c8-9631-cc4e714354ff"
Jul 06 13:50:43.653892 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:43.653864    2562 generic.go:356] "Generic (PLEG): container finished" podID="5c87f08a-3127-4a61-996f-bc6587e6aac0" containerID="532be5a19ea041fd1f3ca519280ce7c5af1afaadb0c06af0d2a67d12dc23ed9f" exitCode=0
Jul 06 13:50:43.654004 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:43.653961    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkvfk" event={"ID":"5c87f08a-3127-4a61-996f-bc6587e6aac0","Type":"ContainerDied","Data":"532be5a19ea041fd1f3ca519280ce7c5af1afaadb0c06af0d2a67d12dc23ed9f"}
Jul 06 13:50:45.471597 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:45.471462    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:45.471937 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:45.471485    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:45.471937 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:45.471683    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phwdx" podUID="3a9a4e3f-18cb-454f-ac12-66bf74123320"
Jul 06 13:50:45.471937 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:45.471485    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:45.471937 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:45.471750    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:50:45.471937 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:45.471856    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4x77l" podUID="ef2654ab-e7e6-41c8-9631-cc4e714354ff"
Jul 06 13:50:45.659638 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:45.659620    2562 generic.go:356] "Generic (PLEG): container finished" podID="5c87f08a-3127-4a61-996f-bc6587e6aac0" containerID="32624363daf242a5922fbce3916008eec0f08024765cf7238510609cb1cc1940" exitCode=0
Jul 06 13:50:45.659718 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:45.659654    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkvfk" event={"ID":"5c87f08a-3127-4a61-996f-bc6587e6aac0","Type":"ContainerDied","Data":"32624363daf242a5922fbce3916008eec0f08024765cf7238510609cb1cc1940"}
Jul 06 13:50:46.283568 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:46.283542    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret\") pod \"global-pull-secret-syncer-phwdx\" (UID: \"3a9a4e3f-18cb-454f-ac12-66bf74123320\") " pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:46.283708 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:46.283570    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs\") pod \"network-metrics-daemon-cxr4t\" (UID: \"aab6a8f0-2336-4d20-996a-2ac646db3fa9\") " pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:46.283708 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:46.283661    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:50:46.283708 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:46.283661    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:50:46.283708 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:46.283702    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs podName:aab6a8f0-2336-4d20-996a-2ac646db3fa9 nodeName:}" failed. No retries permitted until 2026-07-06 13:51:18.283690219 +0000 UTC m=+65.327301231 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs") pod "network-metrics-daemon-cxr4t" (UID: "aab6a8f0-2336-4d20-996a-2ac646db3fa9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:50:46.283827 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:46.283714    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret podName:3a9a4e3f-18cb-454f-ac12-66bf74123320 nodeName:}" failed. No retries permitted until 2026-07-06 13:51:18.283708591 +0000 UTC m=+65.327319603 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret") pod "global-pull-secret-syncer-phwdx" (UID: "3a9a4e3f-18cb-454f-ac12-66bf74123320") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:50:46.384673 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:46.384650    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4mcg\" (UniqueName: \"kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg\") pod \"network-check-target-4x77l\" (UID: \"ef2654ab-e7e6-41c8-9631-cc4e714354ff\") " pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:46.384765 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:46.384733    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:50:46.384765 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:46.384745    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:50:46.384765 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:46.384753    2562 projected.go:196] Error preparing data for projected volume kube-api-access-x4mcg for pod openshift-network-diagnostics/network-check-target-4x77l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:50:46.384847 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:46.384791    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg podName:ef2654ab-e7e6-41c8-9631-cc4e714354ff nodeName:}" failed. No retries permitted until 2026-07-06 13:51:18.384778143 +0000 UTC m=+65.428389154 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x4mcg" (UniqueName: "kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg") pod "network-check-target-4x77l" (UID: "ef2654ab-e7e6-41c8-9631-cc4e714354ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:50:47.266922 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.266872    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-29.ec2.internal" event="NodeReady"
Jul 06 13:50:47.267193 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.266953    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 13:50:47.315650 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.315625    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"]
Jul 06 13:50:47.317900 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.317880    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79d4d9b948-gkz8g"]
Jul 06 13:50:47.318021 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.318006    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"
Jul 06 13:50:47.320595 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.320565    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 13:50:47.320698 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.320616    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 13:50:47.320698 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.320670    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 13:50:47.321101 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.321063    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5565d5b648-6glw5"]
Jul 06 13:50:47.321527 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.321398    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 13:50:47.322978 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.321697    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.323581 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.323565    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 13:50:47.323918 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.323904    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 13:50:47.323970 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.323917    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m9r9h\""
Jul 06 13:50:47.324143 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.324125    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"]
Jul 06 13:50:47.324302 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.324178    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 13:50:47.324302 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.324192    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5565d5b648-6glw5"
Jul 06 13:50:47.326949 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.326930    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4ts6n\""
Jul 06 13:50:47.327025 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.326952    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 13:50:47.327105 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.327089    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.330635 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.330612    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 06 13:50:47.330893 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.330873    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 06 13:50:47.330977 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.330936    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 06 13:50:47.331187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.331172    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 06 13:50:47.331276 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.331238    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 13:50:47.331477 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.331461    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"]
Jul 06 13:50:47.334013 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.333995    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5565d5b648-6glw5"]
Jul 06 13:50:47.337526 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.337322    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79d4d9b948-gkz8g"]
Jul 06 13:50:47.338230 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.338212    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"]
Jul 06 13:50:47.358820 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.358797    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:50:47.392498 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392474    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26skm\" (UniqueName: \"kubernetes.io/projected/d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed-kube-api-access-26skm\") pod \"klusterlet-addon-workmgr-6b48d89687-l4g4z\" (UID: \"d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"
Jul 06 13:50:47.392583 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392521    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-hub\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.392583 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392569    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.392663 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392595    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-certificates\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.392663 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392616    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-ca\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.392663 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392636    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fca930f-1404-40b1-b33b-e5325c8a6259-image-registry-private-configuration\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.392663 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392656    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-bound-sa-token\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.392781 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392709    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj7w8\" (UniqueName: \"kubernetes.io/projected/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-kube-api-access-dj7w8\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.392781 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392726    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.392781 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392741    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fca930f-1404-40b1-b33b-e5325c8a6259-ca-trust-extracted\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.392781 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392757    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fca930f-1404-40b1-b33b-e5325c8a6259-installation-pull-secrets\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.392781 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fca930f-1404-40b1-b33b-e5325c8a6259-trusted-ca\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.392934 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392787    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed-tmp\") pod \"klusterlet-addon-workmgr-6b48d89687-l4g4z\" (UID: \"d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"
Jul 06 13:50:47.392934 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392801    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.392934 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392836    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b48d89687-l4g4z\" (UID: \"d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"
Jul 06 13:50:47.392934 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.392934 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392896    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e164594-9e2f-4c13-89a9-855440364518-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5565d5b648-6glw5\" (UID: \"4e164594-9e2f-4c13-89a9-855440364518\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5565d5b648-6glw5"
Jul 06 13:50:47.392934 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392920    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rpn6\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-kube-api-access-5rpn6\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.392934 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.392934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bskqs\" (UniqueName: \"kubernetes.io/projected/4e164594-9e2f-4c13-89a9-855440364518-kube-api-access-bskqs\") pod \"managed-serviceaccount-addon-agent-5565d5b648-6glw5\" (UID: \"4e164594-9e2f-4c13-89a9-855440364518\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5565d5b648-6glw5"
Jul 06 13:50:47.414727 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.414706    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qthdk"]
Jul 06 13:50:47.417452 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.417439    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qthdk"
Jul 06 13:50:47.419633 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.419615    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-szq2s\""
Jul 06 13:50:47.419714 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.419664    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 13:50:47.419946 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.419927    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 13:50:47.420634 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.420618    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w8j6d"]
Jul 06 13:50:47.423046 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.423034    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w8j6d"
Jul 06 13:50:47.424998 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.424982    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 13:50:47.425072 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.425053    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 13:50:47.425404 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.425389    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 13:50:47.425477 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.425440    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fsr9j\""
Jul 06 13:50:47.435992 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.435972    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w8j6d"]
Jul 06 13:50:47.463001 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.462976    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qthdk"]
Jul 06 13:50:47.471254 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.471236    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:50:47.471343 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.471265    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:50:47.471343 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.471237    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:50:47.473516 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.473493    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 13:50:47.473516 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.473515    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 13:50:47.473643 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.473503    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 13:50:47.473643 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.473604    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hr9ft\""
Jul 06 13:50:47.473742 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.473666    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-469kc\""
Jul 06 13:50:47.473836 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.473824    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 13:50:47.494071 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494054    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-ca\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.494157 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494079    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fca930f-1404-40b1-b33b-e5325c8a6259-image-registry-private-configuration\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.494157 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494096    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-bound-sa-token\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.494157 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494148    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj7w8\" (UniqueName: \"kubernetes.io/projected/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-kube-api-access-dj7w8\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.494273 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.494273 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494197    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fca930f-1404-40b1-b33b-e5325c8a6259-ca-trust-extracted\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.494273 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494219    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fca930f-1404-40b1-b33b-e5325c8a6259-installation-pull-secrets\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.494273 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494244    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fca930f-1404-40b1-b33b-e5325c8a6259-trusted-ca\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.494273 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494269    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:50:47.494498 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494306    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b8a09c7-319d-465b-82a2-d98f690fdb98-cert\") pod \"ingress-canary-w8j6d\" (UID: \"9b8a09c7-319d-465b-82a2-d98f690fdb98\") " pod="openshift-ingress-canary/ingress-canary-w8j6d"
Jul 06 13:50:47.494498 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494333    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed-tmp\") pod \"klusterlet-addon-workmgr-6b48d89687-l4g4z\" (UID: \"d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"
Jul 06 13:50:47.494498 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494357    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.494498 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/291d0af7-2df1-4fce-87ea-3891408c3616-tmp-dir\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:50:47.494498 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494437    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b48d89687-l4g4z\" (UID: \"d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"
Jul 06 13:50:47.494498 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494458    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.494498 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494478    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e164594-9e2f-4c13-89a9-855440364518-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5565d5b648-6glw5\" (UID: \"4e164594-9e2f-4c13-89a9-855440364518\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5565d5b648-6glw5"
Jul 06 13:50:47.494790 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494509    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rpn6\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-kube-api-access-5rpn6\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.494790 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bskqs\" (UniqueName: \"kubernetes.io/projected/4e164594-9e2f-4c13-89a9-855440364518-kube-api-access-bskqs\") pod \"managed-serviceaccount-addon-agent-5565d5b648-6glw5\" (UID: \"4e164594-9e2f-4c13-89a9-855440364518\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5565d5b648-6glw5"
Jul 06 13:50:47.494790 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/291d0af7-2df1-4fce-87ea-3891408c3616-config-volume\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:50:47.494790 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494579    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hwhw\" (UniqueName: \"kubernetes.io/projected/291d0af7-2df1-4fce-87ea-3891408c3616-kube-api-access-9hwhw\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:50:47.494790 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494604    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fca930f-1404-40b1-b33b-e5325c8a6259-ca-trust-extracted\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.494790 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494617    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26skm\" (UniqueName: \"kubernetes.io/projected/d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed-kube-api-access-26skm\") pod \"klusterlet-addon-workmgr-6b48d89687-l4g4z\" (UID: \"d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"
Jul 06 13:50:47.494790 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhhc6\" (UniqueName: \"kubernetes.io/projected/9b8a09c7-319d-465b-82a2-d98f690fdb98-kube-api-access-mhhc6\") pod \"ingress-canary-w8j6d\" (UID: \"9b8a09c7-319d-465b-82a2-d98f690fdb98\") " pod="openshift-ingress-canary/ingress-canary-w8j6d"
Jul 06 13:50:47.494790 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494712    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-hub\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.494790 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494738    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.494790 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-certificates\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.495213 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.494903    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.495213 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.495096    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed-tmp\") pod \"klusterlet-addon-workmgr-6b48d89687-l4g4z\" (UID: \"d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"
Jul 06 13:50:47.495321 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.495231    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-certificates\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.495502 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.495393    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fca930f-1404-40b1-b33b-e5325c8a6259-trusted-ca\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.498573 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.498543    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fca930f-1404-40b1-b33b-e5325c8a6259-image-registry-private-configuration\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.498573 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.498555    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-ca\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.498725 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.498628    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fca930f-1404-40b1-b33b-e5325c8a6259-installation-pull-secrets\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.498725 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.498631    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-hub\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.498725 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:47.498656    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 13:50:47.498725 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:47.498669    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d4d9b948-gkz8g: secret "image-registry-tls" not found
Jul 06 13:50:47.498725 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.498676    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.498725 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:47.498717    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls podName:7fca930f-1404-40b1-b33b-e5325c8a6259 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:47.998701623 +0000 UTC m=+35.042312645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls") pod "image-registry-79d4d9b948-gkz8g" (UID: "7fca930f-1404-40b1-b33b-e5325c8a6259") : secret "image-registry-tls" not found
Jul 06 13:50:47.498899 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.498807    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.499269 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.499248    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e164594-9e2f-4c13-89a9-855440364518-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5565d5b648-6glw5\" (UID: \"4e164594-9e2f-4c13-89a9-855440364518\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5565d5b648-6glw5"
Jul 06 13:50:47.500779 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.500760    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b48d89687-l4g4z\" (UID: \"d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"
Jul 06 13:50:47.501472 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.501456    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj7w8\" (UniqueName: \"kubernetes.io/projected/9a5bfd76-cd91-4ca6-8704-272ee102c8a1-kube-api-access-dj7w8\") pod \"cluster-proxy-proxy-agent-7596bc6c89-f72kw\" (UID: \"9a5bfd76-cd91-4ca6-8704-272ee102c8a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.501966 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.501951    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26skm\" (UniqueName: \"kubernetes.io/projected/d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed-kube-api-access-26skm\") pod \"klusterlet-addon-workmgr-6b48d89687-l4g4z\" (UID: \"d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"
Jul 06 13:50:47.502208 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.502190    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-bound-sa-token\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.508326 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.508307    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bskqs\" (UniqueName: \"kubernetes.io/projected/4e164594-9e2f-4c13-89a9-855440364518-kube-api-access-bskqs\") pod \"managed-serviceaccount-addon-agent-5565d5b648-6glw5\" (UID: \"4e164594-9e2f-4c13-89a9-855440364518\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5565d5b648-6glw5"
Jul 06 13:50:47.508934 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.508916    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rpn6\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-kube-api-access-5rpn6\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:47.519298 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.519240    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:50:47.595492 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.595470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:50:47.595580 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.595498    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b8a09c7-319d-465b-82a2-d98f690fdb98-cert\") pod \"ingress-canary-w8j6d\" (UID: \"9b8a09c7-319d-465b-82a2-d98f690fdb98\") " pod="openshift-ingress-canary/ingress-canary-w8j6d"
Jul 06 13:50:47.595580 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.595523    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/291d0af7-2df1-4fce-87ea-3891408c3616-tmp-dir\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:50:47.595580 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.595567    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/291d0af7-2df1-4fce-87ea-3891408c3616-config-volume\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:50:47.595715 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:47.595589    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:50:47.595715 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.595595    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hwhw\" (UniqueName: \"kubernetes.io/projected/291d0af7-2df1-4fce-87ea-3891408c3616-kube-api-access-9hwhw\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:50:47.595715 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:47.595630    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls podName:291d0af7-2df1-4fce-87ea-3891408c3616 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:48.095615718 +0000 UTC m=+35.139226730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls") pod "dns-default-qthdk" (UID: "291d0af7-2df1-4fce-87ea-3891408c3616") : secret "dns-default-metrics-tls" not found
Jul 06 13:50:47.595715 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.595676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhhc6\" (UniqueName: \"kubernetes.io/projected/9b8a09c7-319d-465b-82a2-d98f690fdb98-kube-api-access-mhhc6\") pod \"ingress-canary-w8j6d\" (UID: \"9b8a09c7-319d-465b-82a2-d98f690fdb98\") " pod="openshift-ingress-canary/ingress-canary-w8j6d"
Jul 06 13:50:47.596014 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.595995    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/291d0af7-2df1-4fce-87ea-3891408c3616-tmp-dir\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:50:47.596119 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.596103    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/291d0af7-2df1-4fce-87ea-3891408c3616-config-volume\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:50:47.597353 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.597337    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b8a09c7-319d-465b-82a2-d98f690fdb98-cert\") pod \"ingress-canary-w8j6d\" (UID: \"9b8a09c7-319d-465b-82a2-d98f690fdb98\") " pod="openshift-ingress-canary/ingress-canary-w8j6d"
Jul 06 13:50:47.603093 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.603067    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hwhw\" (UniqueName: \"kubernetes.io/projected/291d0af7-2df1-4fce-87ea-3891408c3616-kube-api-access-9hwhw\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:50:47.603370 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.603356    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhhc6\" (UniqueName: \"kubernetes.io/projected/9b8a09c7-319d-465b-82a2-d98f690fdb98-kube-api-access-mhhc6\") pod \"ingress-canary-w8j6d\" (UID: \"9b8a09c7-319d-465b-82a2-d98f690fdb98\") " pod="openshift-ingress-canary/ingress-canary-w8j6d"
Jul 06 13:50:47.630219 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.630200    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"
Jul 06 13:50:47.655735 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.655716    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5565d5b648-6glw5"
Jul 06 13:50:47.660881 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.660863    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:50:47.665597 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.665570    2562 generic.go:356] "Generic (PLEG): container finished" podID="5c87f08a-3127-4a61-996f-bc6587e6aac0" containerID="b5b106c2daded68d7368366dc50e9905e5a79032ce2ae9ed9f098073ad3a4b15" exitCode=0
Jul 06 13:50:47.665693 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.665617    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkvfk" event={"ID":"5c87f08a-3127-4a61-996f-bc6587e6aac0","Type":"ContainerDied","Data":"b5b106c2daded68d7368366dc50e9905e5a79032ce2ae9ed9f098073ad3a4b15"}
Jul 06 13:50:47.742295 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.741737    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w8j6d"
Jul 06 13:50:47.804124 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.803826    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"]
Jul 06 13:50:47.811332 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:47.810118    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f477a3_4e6a_4acf_9e90_a189aa4dd4ed.slice/crio-f31a92571f07c1a972280b8849ec98c4b9e396aa45a4078e1b2088f309dc5546 WatchSource:0}: Error finding container f31a92571f07c1a972280b8849ec98c4b9e396aa45a4078e1b2088f309dc5546: Status 404 returned error can't find the container with id f31a92571f07c1a972280b8849ec98c4b9e396aa45a4078e1b2088f309dc5546
Jul 06 13:50:47.833267 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.833246    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5565d5b648-6glw5"]
Jul 06 13:50:47.835825 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.835799    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"]
Jul 06 13:50:47.836919 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:47.836895    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e164594_9e2f_4c13_89a9_855440364518.slice/crio-5826df43cb42341be564a2c532111b0b2c057e67912ca8aaed325eeeb738e349 WatchSource:0}: Error finding container 5826df43cb42341be564a2c532111b0b2c057e67912ca8aaed325eeeb738e349: Status 404 returned error can't find the container with id 5826df43cb42341be564a2c532111b0b2c057e67912ca8aaed325eeeb738e349
Jul 06 13:50:47.839887 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:47.839848    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a5bfd76_cd91_4ca6_8704_272ee102c8a1.slice/crio-3c67487b4db11553a6a172c48b0e57df65d1697c5db4c27e06e4783ddb78f158 WatchSource:0}: Error finding container 3c67487b4db11553a6a172c48b0e57df65d1697c5db4c27e06e4783ddb78f158: Status 404 returned error can't find the container with id 3c67487b4db11553a6a172c48b0e57df65d1697c5db4c27e06e4783ddb78f158
Jul 06 13:50:47.878051 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:47.878029    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w8j6d"]
Jul 06 13:50:47.880930 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:50:47.880909    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b8a09c7_319d_465b_82a2_d98f690fdb98.slice/crio-0bed85508800c573703c1fe2b93b039bcf2b016e64c0229bfcacc4fc57369f82 WatchSource:0}: Error finding container 0bed85508800c573703c1fe2b93b039bcf2b016e64c0229bfcacc4fc57369f82: Status 404 returned error can't find the container with id 0bed85508800c573703c1fe2b93b039bcf2b016e64c0229bfcacc4fc57369f82
Jul 06 13:50:48.099366 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:48.099277    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:48.099525 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:48.099389    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 13:50:48.099525 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:48.099405    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d4d9b948-gkz8g: secret "image-registry-tls" not found
Jul 06 13:50:48.099525 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:48.099446    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:50:48.099525 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:48.099454    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls podName:7fca930f-1404-40b1-b33b-e5325c8a6259 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:49.099439752 +0000 UTC m=+36.143050764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls") pod "image-registry-79d4d9b948-gkz8g" (UID: "7fca930f-1404-40b1-b33b-e5325c8a6259") : secret "image-registry-tls" not found
Jul 06 13:50:48.099525 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:48.099381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:50:48.099525 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:48.099516    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls podName:291d0af7-2df1-4fce-87ea-3891408c3616 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:49.099503191 +0000 UTC m=+36.143114202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls") pod "dns-default-qthdk" (UID: "291d0af7-2df1-4fce-87ea-3891408c3616") : secret "dns-default-metrics-tls" not found
Jul 06 13:50:48.177712 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:48.177688    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:50:48.277715 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:48.277694    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:50:48.674593 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:48.670643    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w8j6d" event={"ID":"9b8a09c7-319d-465b-82a2-d98f690fdb98","Type":"ContainerStarted","Data":"0bed85508800c573703c1fe2b93b039bcf2b016e64c0229bfcacc4fc57369f82"}
Jul 06 13:50:48.674593 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:48.672558    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw" event={"ID":"9a5bfd76-cd91-4ca6-8704-272ee102c8a1","Type":"ContainerStarted","Data":"3c67487b4db11553a6a172c48b0e57df65d1697c5db4c27e06e4783ddb78f158"}
Jul 06 13:50:48.675745 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:48.675677    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:50:48.676600 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:48.676542    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5565d5b648-6glw5" event={"ID":"4e164594-9e2f-4c13-89a9-855440364518","Type":"ContainerStarted","Data":"5826df43cb42341be564a2c532111b0b2c057e67912ca8aaed325eeeb738e349"}
Jul 06 13:50:48.678449 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:48.678429    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z" event={"ID":"d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed","Type":"ContainerStarted","Data":"f31a92571f07c1a972280b8849ec98c4b9e396aa45a4078e1b2088f309dc5546"}
Jul 06 13:50:49.109185 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:49.109146    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:50:49.109401 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:49.109207    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:49.109401 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:49.109341    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:50:49.109401 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:49.109369    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 13:50:49.109401 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:49.109384    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d4d9b948-gkz8g: secret "image-registry-tls" not found
Jul 06 13:50:49.109606 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:49.109413    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls podName:291d0af7-2df1-4fce-87ea-3891408c3616 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:51.109393163 +0000 UTC m=+38.153004178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls") pod "dns-default-qthdk" (UID: "291d0af7-2df1-4fce-87ea-3891408c3616") : secret "dns-default-metrics-tls" not found
Jul 06 13:50:49.109606 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:49.109437    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls podName:7fca930f-1404-40b1-b33b-e5325c8a6259 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:51.109420849 +0000 UTC m=+38.153031877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls") pod "image-registry-79d4d9b948-gkz8g" (UID: "7fca930f-1404-40b1-b33b-e5325c8a6259") : secret "image-registry-tls" not found
Jul 06 13:50:49.125766 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:49.125698    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:50:49.913196 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:49.913034    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:50:49.986740 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:49.986639    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:50:51.126261 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:51.126228    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:50:51.127025 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:51.126304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:51.127025 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:51.126462    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 13:50:51.127025 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:51.126476    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d4d9b948-gkz8g: secret "image-registry-tls" not found
Jul 06 13:50:51.127025 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:51.126482    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:50:51.127025 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:51.126535    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls podName:7fca930f-1404-40b1-b33b-e5325c8a6259 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:55.12651625 +0000 UTC m=+42.170127281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls") pod "image-registry-79d4d9b948-gkz8g" (UID: "7fca930f-1404-40b1-b33b-e5325c8a6259") : secret "image-registry-tls" not found
Jul 06 13:50:51.127025 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:51.126551    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls podName:291d0af7-2df1-4fce-87ea-3891408c3616 nodeName:}" failed. No retries permitted until 2026-07-06 13:50:55.126543459 +0000 UTC m=+42.170154476 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls") pod "dns-default-qthdk" (UID: "291d0af7-2df1-4fce-87ea-3891408c3616") : secret "dns-default-metrics-tls" not found
Jul 06 13:50:52.537171 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:52.537048    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:50:55.156596 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:55.156554    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:50:55.156596 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:55.156599    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:50:55.157013 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:55.156711    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 13:50:55.157013 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:55.156726    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d4d9b948-gkz8g: secret "image-registry-tls" not found
Jul 06 13:50:55.157013 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:55.156769    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls podName:7fca930f-1404-40b1-b33b-e5325c8a6259 nodeName:}" failed. No retries permitted until 2026-07-06 13:51:03.156756302 +0000 UTC m=+50.200367313 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls") pod "image-registry-79d4d9b948-gkz8g" (UID: "7fca930f-1404-40b1-b33b-e5325c8a6259") : secret "image-registry-tls" not found
Jul 06 13:50:55.157013 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:55.156713    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:50:55.157013 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:50:55.156869    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls podName:291d0af7-2df1-4fce-87ea-3891408c3616 nodeName:}" failed. No retries permitted until 2026-07-06 13:51:03.156848481 +0000 UTC m=+50.200459508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls") pod "dns-default-qthdk" (UID: "291d0af7-2df1-4fce-87ea-3891408c3616") : secret "dns-default-metrics-tls" not found
Jul 06 13:50:58.710350 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:58.710320    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w8j6d" event={"ID":"9b8a09c7-319d-465b-82a2-d98f690fdb98","Type":"ContainerStarted","Data":"7adc4054632a4e1f5b81db756f7609531aac7634ac87b9207446cf839bc27f81"}
Jul 06 13:50:58.712885 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:58.712864    2562 generic.go:356] "Generic (PLEG): container finished" podID="5c87f08a-3127-4a61-996f-bc6587e6aac0" containerID="fb4516d1d10e423ea1dc2dae46c28452f6163f0d9f5306b7af4089f151d0b2e7" exitCode=0
Jul 06 13:50:58.712956 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:58.712930    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkvfk" event={"ID":"5c87f08a-3127-4a61-996f-bc6587e6aac0","Type":"ContainerDied","Data":"fb4516d1d10e423ea1dc2dae46c28452f6163f0d9f5306b7af4089f151d0b2e7"}
Jul 06 13:50:58.714959 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:58.714935    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw" event={"ID":"9a5bfd76-cd91-4ca6-8704-272ee102c8a1","Type":"ContainerStarted","Data":"0b43ea31cfa8874dddddd2272fc58258292271f71b0c36b2f94041c67202ee29"}
Jul 06 13:50:58.715063 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:58.714975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw" event={"ID":"9a5bfd76-cd91-4ca6-8704-272ee102c8a1","Type":"ContainerStarted","Data":"3e40e7296eee27fdf3984476c3013b3854bffd100e4826005eecd2d28e61ed07"}
Jul 06 13:50:58.715063 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:58.714995    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw" event={"ID":"9a5bfd76-cd91-4ca6-8704-272ee102c8a1","Type":"ContainerStarted","Data":"99a841ba4a56602595b1ab0d64a5c16478fced540766b5546100b596988ad63b"}
Jul 06 13:50:58.716310 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:58.716272    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5565d5b648-6glw5" event={"ID":"4e164594-9e2f-4c13-89a9-855440364518","Type":"ContainerStarted","Data":"cd954c8bf49bee0de89f2c67ab01d4033412d91bfa48d831e869b115e69a77cf"}
Jul 06 13:50:58.717632 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:58.717614    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z" event={"ID":"d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed","Type":"ContainerStarted","Data":"dc3da7aed4560aaa3f026e6b087538f94ca7e0872fd58dec8bcaeb11f5b0d84d"}
Jul 06 13:50:58.717826 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:58.717808    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"
Jul 06 13:50:58.719367 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:58.719351    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"
Jul 06 13:50:58.726081 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:58.726045    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w8j6d" podStartSLOduration=1.775989489 podStartE2EDuration="11.726033125s" totalImagesPullingTime="9.950043636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:58.725142282 +0000 UTC m=+45.768753329" watchObservedRunningTime="2026-07-06 13:50:58.726033125 +0000 UTC m=+45.769644136"
Jul 06 13:50:58.743736 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:58.743702    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw" podStartSLOduration=15.751634729 podStartE2EDuration="25.743690166s" totalImagesPullingTime="9.992055437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:58.743322945 +0000 UTC m=+45.786933979" watchObservedRunningTime="2026-07-06 13:50:58.743690166 +0000 UTC m=+45.787301198"
Jul 06 13:50:58.788043 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:58.787989    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z" podStartSLOduration=15.753498973 podStartE2EDuration="25.787972095s" totalImagesPullingTime="10.034473122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:58.787616137 +0000 UTC m=+45.831227189" watchObservedRunningTime="2026-07-06 13:50:58.787972095 +0000 UTC m=+45.831583129"
Jul 06 13:50:58.803035 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:58.802999    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5565d5b648-6glw5" podStartSLOduration=15.809874513 podStartE2EDuration="25.802987143s" totalImagesPullingTime="9.99311263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:58.802177348 +0000 UTC m=+45.845788404" watchObservedRunningTime="2026-07-06 13:50:58.802987143 +0000 UTC m=+45.846598223"
Jul 06 13:50:59.726392 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:59.726358    2562 generic.go:356] "Generic (PLEG): container finished" podID="5c87f08a-3127-4a61-996f-bc6587e6aac0" containerID="b53a7251dc555e5e35aac8a5c682b5ff57864a960264085cdb124f41c8075ebe" exitCode=0
Jul 06 13:50:59.726872 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:50:59.726392    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkvfk" event={"ID":"5c87f08a-3127-4a61-996f-bc6587e6aac0","Type":"ContainerDied","Data":"b53a7251dc555e5e35aac8a5c682b5ff57864a960264085cdb124f41c8075ebe"}
Jul 06 13:51:00.733084 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:00.733053    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkvfk" event={"ID":"5c87f08a-3127-4a61-996f-bc6587e6aac0","Type":"ContainerStarted","Data":"f3a81f81cf9ab8a1ac538450dcc94fdaf007e8483035187049d7085db13e8d9a"}
Jul 06 13:51:00.760296 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:00.760229    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hkvfk" podStartSLOduration=9.915379799 podStartE2EDuration="47.76021458s" totalImagesPullingTime="37.844834781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:50:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:51:00.758959191 +0000 UTC m=+47.802570241" watchObservedRunningTime="2026-07-06 13:51:00.76021458 +0000 UTC m=+47.803825619"
Jul 06 13:51:00.915057 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:00.915029    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:01.013610 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:01.013555    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:01.532699 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:01.532676    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:01.605584 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:01.605555    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:03.215868 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:03.215836    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:51:03.216245 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:03.215873    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:51:03.216245 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:51:03.215976    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 13:51:03.216245 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:51:03.215986    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d4d9b948-gkz8g: secret "image-registry-tls" not found
Jul 06 13:51:03.216245 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:51:03.216002    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:51:03.216245 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:51:03.216028    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls podName:7fca930f-1404-40b1-b33b-e5325c8a6259 nodeName:}" failed. No retries permitted until 2026-07-06 13:51:19.216016782 +0000 UTC m=+66.259627793 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls") pod "image-registry-79d4d9b948-gkz8g" (UID: "7fca930f-1404-40b1-b33b-e5325c8a6259") : secret "image-registry-tls" not found
Jul 06 13:51:03.216245 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:51:03.216070    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls podName:291d0af7-2df1-4fce-87ea-3891408c3616 nodeName:}" failed. No retries permitted until 2026-07-06 13:51:19.216052538 +0000 UTC m=+66.259663563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls") pod "dns-default-qthdk" (UID: "291d0af7-2df1-4fce-87ea-3891408c3616") : secret "dns-default-metrics-tls" not found
Jul 06 13:51:03.271114 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:03.271087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:03.343812 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:03.343788    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:03.821915 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:03.821891    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:03.923189 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:03.923170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:03.993432 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:03.993412    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:13.663411 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:13.663389    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nd55z"
Jul 06 13:51:13.856627 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:13.856598    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:13.957691 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:13.957668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:14.057570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:14.057545    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:18.316159 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:18.316122    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret\") pod \"global-pull-secret-syncer-phwdx\" (UID: \"3a9a4e3f-18cb-454f-ac12-66bf74123320\") " pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:51:18.316159 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:18.316162    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs\") pod \"network-metrics-daemon-cxr4t\" (UID: \"aab6a8f0-2336-4d20-996a-2ac646db3fa9\") " pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:51:18.318791 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:18.318770    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 13:51:18.318857 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:18.318842    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 13:51:18.326543 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:51:18.326519    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 13:51:18.326656 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:51:18.326566    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs podName:aab6a8f0-2336-4d20-996a-2ac646db3fa9 nodeName:}" failed. No retries permitted until 2026-07-06 13:52:22.32655251 +0000 UTC m=+129.370163524 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs") pod "network-metrics-daemon-cxr4t" (UID: "aab6a8f0-2336-4d20-996a-2ac646db3fa9") : secret "metrics-daemon-secret" not found
Jul 06 13:51:18.329554 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:18.329534    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a9a4e3f-18cb-454f-ac12-66bf74123320-original-pull-secret\") pod \"global-pull-secret-syncer-phwdx\" (UID: \"3a9a4e3f-18cb-454f-ac12-66bf74123320\") " pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:51:18.380770 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:18.380750    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phwdx"
Jul 06 13:51:18.417834 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:18.417809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4mcg\" (UniqueName: \"kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg\") pod \"network-check-target-4x77l\" (UID: \"ef2654ab-e7e6-41c8-9631-cc4e714354ff\") " pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:51:18.420446 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:18.420428    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 13:51:18.430196 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:18.430168    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 13:51:18.441304 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:18.441238    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4mcg\" (UniqueName: \"kubernetes.io/projected/ef2654ab-e7e6-41c8-9631-cc4e714354ff-kube-api-access-x4mcg\") pod \"network-check-target-4x77l\" (UID: \"ef2654ab-e7e6-41c8-9631-cc4e714354ff\") " pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:51:18.495875 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:18.495847    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-phwdx"]
Jul 06 13:51:18.499425 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:51:18.499403    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a9a4e3f_18cb_454f_ac12_66bf74123320.slice/crio-b1e757608b966dc084d860115cfea70573d92fbf3889c23a4d11ac66c0aae937 WatchSource:0}: Error finding container b1e757608b966dc084d860115cfea70573d92fbf3889c23a4d11ac66c0aae937: Status 404 returned error can't find the container with id b1e757608b966dc084d860115cfea70573d92fbf3889c23a4d11ac66c0aae937
Jul 06 13:51:18.691605 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:18.691552    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hr9ft\""
Jul 06 13:51:18.700008 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:18.699992    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:51:18.786315 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:18.786269    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-phwdx" event={"ID":"3a9a4e3f-18cb-454f-ac12-66bf74123320","Type":"ContainerStarted","Data":"b1e757608b966dc084d860115cfea70573d92fbf3889c23a4d11ac66c0aae937"}
Jul 06 13:51:18.817645 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:18.817620    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4x77l"]
Jul 06 13:51:18.820749 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:51:18.820727    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2654ab_e7e6_41c8_9631_cc4e714354ff.slice/crio-4106dc725de253fdbb6fdda991a662034be4d52d3d59ccf5b00335acaf9188d8 WatchSource:0}: Error finding container 4106dc725de253fdbb6fdda991a662034be4d52d3d59ccf5b00335acaf9188d8: Status 404 returned error can't find the container with id 4106dc725de253fdbb6fdda991a662034be4d52d3d59ccf5b00335acaf9188d8
Jul 06 13:51:19.223011 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:19.222981    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:51:19.223165 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:19.223044    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:51:19.223165 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:51:19.223126    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:51:19.223165 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:51:19.223129    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 13:51:19.223165 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:51:19.223146    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d4d9b948-gkz8g: secret "image-registry-tls" not found
Jul 06 13:51:19.223303 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:51:19.223177    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls podName:291d0af7-2df1-4fce-87ea-3891408c3616 nodeName:}" failed. No retries permitted until 2026-07-06 13:51:51.223164194 +0000 UTC m=+98.266775206 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls") pod "dns-default-qthdk" (UID: "291d0af7-2df1-4fce-87ea-3891408c3616") : secret "dns-default-metrics-tls" not found
Jul 06 13:51:19.223303 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:51:19.223190    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls podName:7fca930f-1404-40b1-b33b-e5325c8a6259 nodeName:}" failed. No retries permitted until 2026-07-06 13:51:51.223184402 +0000 UTC m=+98.266795413 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls") pod "image-registry-79d4d9b948-gkz8g" (UID: "7fca930f-1404-40b1-b33b-e5325c8a6259") : secret "image-registry-tls" not found
Jul 06 13:51:19.791653 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:19.791616    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4x77l" event={"ID":"ef2654ab-e7e6-41c8-9631-cc4e714354ff","Type":"ContainerStarted","Data":"4106dc725de253fdbb6fdda991a662034be4d52d3d59ccf5b00335acaf9188d8"}
Jul 06 13:51:23.785771 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:23.785751    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:23.806349 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:23.806327    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-phwdx" event={"ID":"3a9a4e3f-18cb-454f-ac12-66bf74123320","Type":"ContainerStarted","Data":"96d98197c07954e29579c13f0e8c27bc65c9a4b379e5c3186a5b8179f60ed081"}
Jul 06 13:51:23.807997 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:23.807975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4x77l" event={"ID":"ef2654ab-e7e6-41c8-9631-cc4e714354ff","Type":"ContainerStarted","Data":"18b6d824ce31549e3d90923b0c73f6c2a99dea31014f57eef8dbec3bc7f50675"}
Jul 06 13:51:23.808105 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:23.808090    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:51:23.823729 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:23.823682    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4x77l" podStartSLOduration=65.926446554 podStartE2EDuration="1m10.823666665s" totalImagesPullingTime="4.897220111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:51:23.823211652 +0000 UTC m=+70.866822707" watchObservedRunningTime="2026-07-06 13:51:23.823666665 +0000 UTC m=+70.867277699"
Jul 06 13:51:23.885908 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:23.885884    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:24.211606 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:24.211577    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:24.303953 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:24.303930    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:24.375176 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:24.375156    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:24.825009 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:24.824884    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-phwdx" podStartSLOduration=66.606242649 podStartE2EDuration="1m11.824868562s" totalImagesPullingTime="5.218625913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:51:24.824627727 +0000 UTC m=+71.868238754" watchObservedRunningTime="2026-07-06 13:51:24.824868562 +0000 UTC m=+71.868479591"
Jul 06 13:51:33.207279 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:33.207244    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:34.640996 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:34.640943    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:51:51.237675 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:51.237643    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:51:51.238043 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:51.237686    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:51:51.238043 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:51:51.237788    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:51:51.238043 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:51:51.237851    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls podName:291d0af7-2df1-4fce-87ea-3891408c3616 nodeName:}" failed. No retries permitted until 2026-07-06 13:52:55.237837062 +0000 UTC m=+162.281448074 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls") pod "dns-default-qthdk" (UID: "291d0af7-2df1-4fce-87ea-3891408c3616") : secret "dns-default-metrics-tls" not found
Jul 06 13:51:51.238043 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:51:51.237796    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 13:51:51.238043 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:51:51.237896    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d4d9b948-gkz8g: secret "image-registry-tls" not found
Jul 06 13:51:51.238043 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:51:51.237968    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls podName:7fca930f-1404-40b1-b33b-e5325c8a6259 nodeName:}" failed. No retries permitted until 2026-07-06 13:52:55.237954724 +0000 UTC m=+162.281565742 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls") pod "image-registry-79d4d9b948-gkz8g" (UID: "7fca930f-1404-40b1-b33b-e5325c8a6259") : secret "image-registry-tls" not found
Jul 06 13:51:54.812554 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:51:54.812519    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4x77l"
Jul 06 13:52:08.823010 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:08.822976    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:08.923898 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:08.923849    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:10.944978 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:10.944940    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:11.045684 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:11.045653    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:13.173348 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.173322    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gmc4m"]
Jul 06 13:52:13.176228 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.176214    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:13.178271 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.178250    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 13:52:13.178271 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.178265    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 13:52:13.178443 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.178270    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 13:52:13.178969 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.178953    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cwmvs\""
Jul 06 13:52:13.179019 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.178952    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 13:52:13.193730 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.193711    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gmc4m"]
Jul 06 13:52:13.230602 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.230576    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:13.297932 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.297906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s9gc\" (UniqueName: \"kubernetes.io/projected/9b086829-b4d0-496f-ac10-87b31f68c230-kube-api-access-9s9gc\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:13.298036 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.297955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:13.298104 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.298066    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:13.298160 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.298102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b086829-b4d0-496f-ac10-87b31f68c230-data-volume\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:13.298160 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.298133    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b086829-b4d0-496f-ac10-87b31f68c230-crio-socket\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:13.304625 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.304601    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:13.398486 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.398461    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:13.398486 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.398487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b086829-b4d0-496f-ac10-87b31f68c230-data-volume\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:13.398644 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.398505    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b086829-b4d0-496f-ac10-87b31f68c230-crio-socket\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:13.398644 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.398550    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b086829-b4d0-496f-ac10-87b31f68c230-crio-socket\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:13.398644 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.398586    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s9gc\" (UniqueName: \"kubernetes.io/projected/9b086829-b4d0-496f-ac10-87b31f68c230-kube-api-access-9s9gc\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:13.398644 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.398619    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:13.398859 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.398800    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b086829-b4d0-496f-ac10-87b31f68c230-data-volume\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:13.400493 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.400475    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 13:52:13.400580 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.400477    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 13:52:13.406235 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.406220    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 13:52:13.408761 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:13.408748    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 13:52:13.408849 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:13.408766    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 13:52:13.408849 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:13.408821    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm podName:9b086829-b4d0-496f-ac10-87b31f68c230 nodeName:}" failed. No retries permitted until 2026-07-06 13:52:13.908801767 +0000 UTC m=+120.952412798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gmc4m" (UID: "9b086829-b4d0-496f-ac10-87b31f68c230") : configmap "kube-rbac-proxy" not found
Jul 06 13:52:13.408849 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:13.408841    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls podName:9b086829-b4d0-496f-ac10-87b31f68c230 nodeName:}" failed. No retries permitted until 2026-07-06 13:52:13.908831406 +0000 UTC m=+120.952442420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gmc4m" (UID: "9b086829-b4d0-496f-ac10-87b31f68c230") : secret "insights-runtime-extractor-tls" not found
Jul 06 13:52:13.417028 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.417012    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 13:52:13.428181 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:13.428130    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s9gc\" (UniqueName: \"kubernetes.io/projected/9b086829-b4d0-496f-ac10-87b31f68c230-kube-api-access-9s9gc\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:14.001374 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:14.001339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:14.001648 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:14.001411    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:14.001648 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:14.001481    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 13:52:14.001648 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:14.001510    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 13:52:14.001648 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:14.001538    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls podName:9b086829-b4d0-496f-ac10-87b31f68c230 nodeName:}" failed. No retries permitted until 2026-07-06 13:52:15.00152282 +0000 UTC m=+122.045133833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gmc4m" (UID: "9b086829-b4d0-496f-ac10-87b31f68c230") : secret "insights-runtime-extractor-tls" not found
Jul 06 13:52:14.001648 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:14.001570    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm podName:9b086829-b4d0-496f-ac10-87b31f68c230 nodeName:}" failed. No retries permitted until 2026-07-06 13:52:15.001553212 +0000 UTC m=+122.045164241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gmc4m" (UID: "9b086829-b4d0-496f-ac10-87b31f68c230") : configmap "kube-rbac-proxy" not found
Jul 06 13:52:14.209258 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:14.209225    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:14.311986 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:14.311922    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:15.009974 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:15.009943    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:15.010157 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:15.010003    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:15.010157 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:15.010056    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 13:52:15.010157 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:15.010106    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 13:52:15.010157 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:15.010113    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm podName:9b086829-b4d0-496f-ac10-87b31f68c230 nodeName:}" failed. No retries permitted until 2026-07-06 13:52:17.010098741 +0000 UTC m=+124.053709753 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gmc4m" (UID: "9b086829-b4d0-496f-ac10-87b31f68c230") : configmap "kube-rbac-proxy" not found
Jul 06 13:52:15.010157 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:15.010145    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls podName:9b086829-b4d0-496f-ac10-87b31f68c230 nodeName:}" failed. No retries permitted until 2026-07-06 13:52:17.010134551 +0000 UTC m=+124.053745563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gmc4m" (UID: "9b086829-b4d0-496f-ac10-87b31f68c230") : secret "insights-runtime-extractor-tls" not found
Jul 06 13:52:15.159712 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:15.159685    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f5jwm_a94e9db3-8b8e-462e-be17-8c0581a5063a/dns-node-resolver/0.log"
Jul 06 13:52:15.280831 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:15.280767    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:15.380048 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:15.380024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:15.767657 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:15.767578    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:15.902364 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:15.902339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:15.956852 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:15.956834    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rgwl6_38acd46b-6d99-4d86-afc7-88f95742a5ae/node-ca/0.log"
Jul 06 13:52:16.221919 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:16.221888    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:16.330216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:16.330189    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:16.460870 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:16.460849    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:16.561718 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:16.561665    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:16.957659 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:16.957599    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w8j6d_9b8a09c7-319d-465b-82a2-d98f690fdb98/serve-healthcheck-canary/0.log"
Jul 06 13:52:17.023887 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:17.023861    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:17.023997 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:17.023942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:17.023997 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:17.023971    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 13:52:17.024106 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:17.024036    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm podName:9b086829-b4d0-496f-ac10-87b31f68c230 nodeName:}" failed. No retries permitted until 2026-07-06 13:52:21.024022016 +0000 UTC m=+128.067633028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gmc4m" (UID: "9b086829-b4d0-496f-ac10-87b31f68c230") : configmap "kube-rbac-proxy" not found
Jul 06 13:52:17.024106 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:17.024060    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 13:52:17.024191 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:17.024117    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls podName:9b086829-b4d0-496f-ac10-87b31f68c230 nodeName:}" failed. No retries permitted until 2026-07-06 13:52:21.024101805 +0000 UTC m=+128.067712834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gmc4m" (UID: "9b086829-b4d0-496f-ac10-87b31f68c230") : secret "insights-runtime-extractor-tls" not found
Jul 06 13:52:18.020443 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:18.020406    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:18.170277 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:18.170250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:19.065208 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:19.065173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:19.672484 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:19.672442    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:19.914202 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:19.914149    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:20.021316 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:20.021274    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:20.246057 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:20.246032    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:20.310278 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:20.310205    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:20.407330 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:20.407305    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:20.481441 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:20.481417    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:20.764184 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:20.764139    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:21.051206 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:21.051134    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:21.051358 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:21.051254    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 13:52:21.051358 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:21.051335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:21.051480 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:21.051391    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 13:52:21.051480 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:21.051414    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm podName:9b086829-b4d0-496f-ac10-87b31f68c230 nodeName:}" failed. No retries permitted until 2026-07-06 13:52:29.051386825 +0000 UTC m=+136.094997845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gmc4m" (UID: "9b086829-b4d0-496f-ac10-87b31f68c230") : configmap "kube-rbac-proxy" not found
Jul 06 13:52:21.051480 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:21.051441    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls podName:9b086829-b4d0-496f-ac10-87b31f68c230 nodeName:}" failed. No retries permitted until 2026-07-06 13:52:29.051434272 +0000 UTC m=+136.095045283 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gmc4m" (UID: "9b086829-b4d0-496f-ac10-87b31f68c230") : secret "insights-runtime-extractor-tls" not found
Jul 06 13:52:22.006768 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:22.006738    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:22.170016 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:22.169971    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:22.360551 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:22.360469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs\") pod \"network-metrics-daemon-cxr4t\" (UID: \"aab6a8f0-2336-4d20-996a-2ac646db3fa9\") " pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:52:22.360682 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:22.360623    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 13:52:22.360732 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:22.360682    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs podName:aab6a8f0-2336-4d20-996a-2ac646db3fa9 nodeName:}" failed. No retries permitted until 2026-07-06 13:54:24.36066779 +0000 UTC m=+251.404278803 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs") pod "network-metrics-daemon-cxr4t" (UID: "aab6a8f0-2336-4d20-996a-2ac646db3fa9") : secret "metrics-daemon-secret" not found
Jul 06 13:52:22.365516 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:22.365496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:22.574829 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:22.574790    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:22.764908 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:22.764884    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:23.567656 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:23.567631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:23.801682 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:23.801656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:24.177790 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:24.177766    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:24.291744 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:24.291720    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:24.394039 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:24.393993    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:24.494984 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:24.494960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:24.593678 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:24.593657    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:24.784642 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:24.784589    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:25.965183 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:25.965154    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:26.162119 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:26.162076    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:26.266711 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:26.266648    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:26.367687 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:26.367662    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:26.468114 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:26.468084    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:26.583628 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:26.583535    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:26.800757 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:26.800727    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:27.662847 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:27.662784    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw" podUID="9a5bfd76-cd91-4ca6-8704-272ee102c8a1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 06 13:52:27.769243 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:27.769217    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:27.961990 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:27.961958    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:28.413747 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:28.413661    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:28.575482 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:28.575449    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:28.775128 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:28.775094    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:29.107182 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:29.107102    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:29.107368 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:29.107189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:29.107368 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:29.107333    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 13:52:29.107495 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:29.107401    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls podName:9b086829-b4d0-496f-ac10-87b31f68c230 nodeName:}" failed. No retries permitted until 2026-07-06 13:52:45.107381253 +0000 UTC m=+152.150992282 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gmc4m" (UID: "9b086829-b4d0-496f-ac10-87b31f68c230") : secret "insights-runtime-extractor-tls" not found
Jul 06 13:52:29.107635 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:29.107610    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b086829-b4d0-496f-ac10-87b31f68c230-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:29.767218 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:29.767186    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:29.965459 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:29.965425    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:30.204002 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:30.203971    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:30.373335 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:30.373305    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:32.179859 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:32.179823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:32.705740 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:32.705714    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:32.772123 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:32.772098    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:37.662420 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:37.662380    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw" podUID="9a5bfd76-cd91-4ca6-8704-272ee102c8a1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 06 13:52:42.796934 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:42.796894    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:42.896532 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:42.896503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:43.050274 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:43.050213    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:43.185083 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:43.185060    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:43.267252 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:43.267228    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:43.395075 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:43.395019    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:43.693426 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:43.693351    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:45.125819 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:45.125790    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:45.127942 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:45.127915    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b086829-b4d0-496f-ac10-87b31f68c230-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gmc4m\" (UID: \"9b086829-b4d0-496f-ac10-87b31f68c230\") " pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:45.287712 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:45.287690    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cwmvs\""
Jul 06 13:52:45.296404 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:45.296389    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gmc4m"
Jul 06 13:52:45.421555 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:45.421490    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gmc4m"]
Jul 06 13:52:45.424948 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:52:45.424922    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b086829_b4d0_496f_ac10_87b31f68c230.slice/crio-ba127397c72daaa1fed6d7479beb1c398a28a2ce37af09fd8bbc1ed272d8f37a WatchSource:0}: Error finding container ba127397c72daaa1fed6d7479beb1c398a28a2ce37af09fd8bbc1ed272d8f37a: Status 404 returned error can't find the container with id ba127397c72daaa1fed6d7479beb1c398a28a2ce37af09fd8bbc1ed272d8f37a
Jul 06 13:52:45.602823 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:45.602790    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:45.680672 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:45.680599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:46.041106 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:46.041045    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gmc4m" event={"ID":"9b086829-b4d0-496f-ac10-87b31f68c230","Type":"ContainerStarted","Data":"ba127397c72daaa1fed6d7479beb1c398a28a2ce37af09fd8bbc1ed272d8f37a"}
Jul 06 13:52:46.460692 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:46.460634    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:46.552184 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:46.552153    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:47.662207 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:47.662168    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw" podUID="9a5bfd76-cd91-4ca6-8704-272ee102c8a1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 06 13:52:47.662584 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:47.662238    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw"
Jul 06 13:52:47.662811 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:47.662776    2562 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"0b43ea31cfa8874dddddd2272fc58258292271f71b0c36b2f94041c67202ee29"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 06 13:52:47.662868 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:47.662836    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw" podUID="9a5bfd76-cd91-4ca6-8704-272ee102c8a1" containerName="service-proxy" containerID="cri-o://0b43ea31cfa8874dddddd2272fc58258292271f71b0c36b2f94041c67202ee29" gracePeriod=30
Jul 06 13:52:49.052388 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:49.052364    2562 generic.go:356] "Generic (PLEG): container finished" podID="9a5bfd76-cd91-4ca6-8704-272ee102c8a1" containerID="0b43ea31cfa8874dddddd2272fc58258292271f71b0c36b2f94041c67202ee29" exitCode=2
Jul 06 13:52:49.052731 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:49.052422    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw" event={"ID":"9a5bfd76-cd91-4ca6-8704-272ee102c8a1","Type":"ContainerDied","Data":"0b43ea31cfa8874dddddd2272fc58258292271f71b0c36b2f94041c67202ee29"}
Jul 06 13:52:49.052731 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:49.052466    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7596bc6c89-f72kw" event={"ID":"9a5bfd76-cd91-4ca6-8704-272ee102c8a1","Type":"ContainerStarted","Data":"d05590927088b1a7c83951799856368af7d873087679610c5749522e86ac4248"}
Jul 06 13:52:49.970224 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:49.970197    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:50.057839 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:50.057814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gmc4m" event={"ID":"9b086829-b4d0-496f-ac10-87b31f68c230","Type":"ContainerStarted","Data":"e0f4a2b6f714f0df9c997c8bbda1b3713d7ef6ba144a5ab905ca5aa180762209"}
Jul 06 13:52:50.058123 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:50.057860    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gmc4m" event={"ID":"9b086829-b4d0-496f-ac10-87b31f68c230","Type":"ContainerStarted","Data":"70b29431d8cf2827eb4d909e5f3fec8f48670587c32ee2eaf8b1cc571a507517"}
Jul 06 13:52:50.338568 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:50.338476    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g" podUID="7fca930f-1404-40b1-b33b-e5325c8a6259"
Jul 06 13:52:50.436724 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:50.436686    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qthdk" podUID="291d0af7-2df1-4fce-87ea-3891408c3616"
Jul 06 13:52:50.485717 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:52:50.485684    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cxr4t" podUID="aab6a8f0-2336-4d20-996a-2ac646db3fa9"
Jul 06 13:52:51.061229 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:51.061200    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:52:51.061792 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:51.061200    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qthdk"
Jul 06 13:52:51.712117 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:51.712067    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:51.891187 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:51.891154    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:52.009306 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.009225    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:52.103755 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.103732    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j9mm5"]
Jul 06 13:52:52.106649 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.106634    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.111629 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.111611    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qhstm\""
Jul 06 13:52:52.112054 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.112038    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 13:52:52.112232 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.112208    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 13:52:52.112839 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.112818    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 13:52:52.112929 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.112818    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 13:52:52.112929 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.112897    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 13:52:52.114518 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.114482    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 13:52:52.147750 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.147724    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:52.281242 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.281182    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/99dca4be-3df5-49b5-af7d-7a95bfdac877-node-exporter-wtmp\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.281242 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.281215    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99dca4be-3df5-49b5-af7d-7a95bfdac877-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.281242 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.281240    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99dca4be-3df5-49b5-af7d-7a95bfdac877-sys\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.281478 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.281256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/99dca4be-3df5-49b5-af7d-7a95bfdac877-node-exporter-tls\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.281478 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.281318    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fw8l\" (UniqueName: \"kubernetes.io/projected/99dca4be-3df5-49b5-af7d-7a95bfdac877-kube-api-access-7fw8l\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.281478 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.281335    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99dca4be-3df5-49b5-af7d-7a95bfdac877-metrics-client-ca\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.281478 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.281354    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/99dca4be-3df5-49b5-af7d-7a95bfdac877-node-exporter-accelerators-collector-config\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.281478 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.281421    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/99dca4be-3df5-49b5-af7d-7a95bfdac877-root\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.281656 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.281478    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/99dca4be-3df5-49b5-af7d-7a95bfdac877-node-exporter-textfile\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.296628 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.296567    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:52.382416 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.382391    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99dca4be-3df5-49b5-af7d-7a95bfdac877-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.382515 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.382419    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99dca4be-3df5-49b5-af7d-7a95bfdac877-sys\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.382515 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.382436    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/99dca4be-3df5-49b5-af7d-7a95bfdac877-node-exporter-tls\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.382515 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.382470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fw8l\" (UniqueName: \"kubernetes.io/projected/99dca4be-3df5-49b5-af7d-7a95bfdac877-kube-api-access-7fw8l\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.382515 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.382490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99dca4be-3df5-49b5-af7d-7a95bfdac877-metrics-client-ca\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.382713 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.382512    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99dca4be-3df5-49b5-af7d-7a95bfdac877-sys\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.382713 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.382521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/99dca4be-3df5-49b5-af7d-7a95bfdac877-node-exporter-accelerators-collector-config\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.382713 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.382587    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/99dca4be-3df5-49b5-af7d-7a95bfdac877-root\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.382713 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.382642    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/99dca4be-3df5-49b5-af7d-7a95bfdac877-node-exporter-textfile\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.382713 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.382694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/99dca4be-3df5-49b5-af7d-7a95bfdac877-node-exporter-wtmp\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.382940 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.382793    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/99dca4be-3df5-49b5-af7d-7a95bfdac877-root\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.382940 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.382862    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/99dca4be-3df5-49b5-af7d-7a95bfdac877-node-exporter-wtmp\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.383039 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.383019    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/99dca4be-3df5-49b5-af7d-7a95bfdac877-node-exporter-textfile\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.383149 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.383125    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/99dca4be-3df5-49b5-af7d-7a95bfdac877-node-exporter-accelerators-collector-config\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.383206 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.383151    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99dca4be-3df5-49b5-af7d-7a95bfdac877-metrics-client-ca\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.384660 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.384640    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/99dca4be-3df5-49b5-af7d-7a95bfdac877-node-exporter-tls\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.384794 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.384776    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99dca4be-3df5-49b5-af7d-7a95bfdac877-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.391750 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.391729    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fw8l\" (UniqueName: \"kubernetes.io/projected/99dca4be-3df5-49b5-af7d-7a95bfdac877-kube-api-access-7fw8l\") pod \"node-exporter-j9mm5\" (UID: \"99dca4be-3df5-49b5-af7d-7a95bfdac877\") " pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.415324 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.415302    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j9mm5"
Jul 06 13:52:52.427406 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:52:52.427383    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99dca4be_3df5_49b5_af7d_7a95bfdac877.slice/crio-8ac5d7e7544e9879bc36210767d0bf8258ecca986256307386461cb8bb25d59b WatchSource:0}: Error finding container 8ac5d7e7544e9879bc36210767d0bf8258ecca986256307386461cb8bb25d59b: Status 404 returned error can't find the container with id 8ac5d7e7544e9879bc36210767d0bf8258ecca986256307386461cb8bb25d59b
Jul 06 13:52:52.458700 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.458675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:52.603041 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.602973    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:52.968806 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:52.968778    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:53.068167 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:53.068124    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j9mm5" event={"ID":"99dca4be-3df5-49b5-af7d-7a95bfdac877","Type":"ContainerStarted","Data":"8ac5d7e7544e9879bc36210767d0bf8258ecca986256307386461cb8bb25d59b"}
Jul 06 13:52:53.071471 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:53.071440    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gmc4m" event={"ID":"9b086829-b4d0-496f-ac10-87b31f68c230","Type":"ContainerStarted","Data":"14f10da70f047a33411b3930c23adebf5468264330402793a0211bbdfea1b607"}
Jul 06 13:52:53.073829 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:53.073792    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:53.098957 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:53.098887    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gmc4m" podStartSLOduration=33.587087343 podStartE2EDuration="40.098868954s" totalImagesPullingTime="6.511781611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:52:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:52:53.098139774 +0000 UTC m=+160.141750832" watchObservedRunningTime="2026-07-06 13:52:53.098868954 +0000 UTC m=+160.142479990"
Jul 06 13:52:53.975737 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:53.975707    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:54.076452 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:54.076415    2562 generic.go:356] "Generic (PLEG): container finished" podID="99dca4be-3df5-49b5-af7d-7a95bfdac877" containerID="a90540fe55d3515f860003ce355a9fbd4aef92585b127644f2b5212f58dc29cb" exitCode=0
Jul 06 13:52:54.076623 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:54.076508    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j9mm5" event={"ID":"99dca4be-3df5-49b5-af7d-7a95bfdac877","Type":"ContainerDied","Data":"a90540fe55d3515f860003ce355a9fbd4aef92585b127644f2b5212f58dc29cb"}
Jul 06 13:52:54.826968 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:54.826931    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:54.927260 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:54.927224    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:55.015472 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.015425    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:55.083344 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.083258    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j9mm5" event={"ID":"99dca4be-3df5-49b5-af7d-7a95bfdac877","Type":"ContainerStarted","Data":"cd12376b5216632a477c6545a0ae28ec9c7db5978dee228866807ec53b9b71ad"}
Jul 06 13:52:55.083344 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.083327    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j9mm5" event={"ID":"99dca4be-3df5-49b5-af7d-7a95bfdac877","Type":"ContainerStarted","Data":"7bd7ec9ab80e0e7053faa78e483c05ed4dcc56325b9243c641e200c2fde38032"}
Jul 06 13:52:55.106163 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.106112    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j9mm5" podStartSLOduration=1.961172648 podStartE2EDuration="3.106098114s" totalImagesPullingTime="1.08278476s" totalInitContainerRuntime="62.140706ms" isStatefulPod=true podCreationTimestamp="2026-07-06 13:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:52:55.105163574 +0000 UTC m=+162.148774607" watchObservedRunningTime="2026-07-06 13:52:55.106098114 +0000 UTC m=+162.149709139"
Jul 06 13:52:55.114203 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.114177    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:55.238727 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.238699    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:55.302052 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.302023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:52:55.302260 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.302087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:52:55.304276 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.304247    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/291d0af7-2df1-4fce-87ea-3891408c3616-metrics-tls\") pod \"dns-default-qthdk\" (UID: \"291d0af7-2df1-4fce-87ea-3891408c3616\") " pod="openshift-dns/dns-default-qthdk"
Jul 06 13:52:55.304408 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.304310    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls\") pod \"image-registry-79d4d9b948-gkz8g\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") " pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:52:55.498493 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.498451    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:55.564551 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.564515    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m9r9h\""
Jul 06 13:52:55.564708 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.564618    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-szq2s\""
Jul 06 13:52:55.572525 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.572504    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:52:55.572613 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.572597    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qthdk"
Jul 06 13:52:55.637708 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.637674    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:55.708597 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.708569    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79d4d9b948-gkz8g"]
Jul 06 13:52:55.711977 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:52:55.711944    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fca930f_1404_40b1_b33b_e5325c8a6259.slice/crio-65736a0b4822eacb29fa9132c3e92f4e17dc692e02ba36b2cfd23d654c5f3b33 WatchSource:0}: Error finding container 65736a0b4822eacb29fa9132c3e92f4e17dc692e02ba36b2cfd23d654c5f3b33: Status 404 returned error can't find the container with id 65736a0b4822eacb29fa9132c3e92f4e17dc692e02ba36b2cfd23d654c5f3b33
Jul 06 13:52:55.722249 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:55.722229    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qthdk"]
Jul 06 13:52:55.724924 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:52:55.724903    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod291d0af7_2df1_4fce_87ea_3891408c3616.slice/crio-23d3887acf3dc219fc36091880304a4c461cde92e9d0b17f60147efea5ae5479 WatchSource:0}: Error finding container 23d3887acf3dc219fc36091880304a4c461cde92e9d0b17f60147efea5ae5479: Status 404 returned error can't find the container with id 23d3887acf3dc219fc36091880304a4c461cde92e9d0b17f60147efea5ae5479
Jul 06 13:52:56.088453 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:56.088366    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qthdk" event={"ID":"291d0af7-2df1-4fce-87ea-3891408c3616","Type":"ContainerStarted","Data":"23d3887acf3dc219fc36091880304a4c461cde92e9d0b17f60147efea5ae5479"}
Jul 06 13:52:56.090031 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:56.089999    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g" event={"ID":"7fca930f-1404-40b1-b33b-e5325c8a6259","Type":"ContainerStarted","Data":"0afadc6e0df2626b60c2522b3992c64d669703a90ef3b0d225d5a0fac1834bd1"}
Jul 06 13:52:56.090163 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:56.090052    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g" event={"ID":"7fca930f-1404-40b1-b33b-e5325c8a6259","Type":"ContainerStarted","Data":"65736a0b4822eacb29fa9132c3e92f4e17dc692e02ba36b2cfd23d654c5f3b33"}
Jul 06 13:52:56.090269 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:56.090252    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:52:56.109153 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:56.108822    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g" podStartSLOduration=163.108798607 podStartE2EDuration="2m43.108798607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:52:56.108513504 +0000 UTC m=+163.152124539" watchObservedRunningTime="2026-07-06 13:52:56.108798607 +0000 UTC m=+163.152409712"
Jul 06 13:52:56.311805 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:56.311776    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:56.484651 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:56.484615    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:56.728203 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:56.728172    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:56.829359 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:56.829264    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:56.977151 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:56.977104    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:57.177096 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:57.177013    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:57.248071 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:57.247985    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:58.099245 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:58.099220    2562 generic.go:356] "Generic (PLEG): container finished" podID="4e164594-9e2f-4c13-89a9-855440364518" containerID="cd954c8bf49bee0de89f2c67ab01d4033412d91bfa48d831e869b115e69a77cf" exitCode=255
Jul 06 13:52:58.099401 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:58.099308    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5565d5b648-6glw5" event={"ID":"4e164594-9e2f-4c13-89a9-855440364518","Type":"ContainerDied","Data":"cd954c8bf49bee0de89f2c67ab01d4033412d91bfa48d831e869b115e69a77cf"}
Jul 06 13:52:58.099638 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:58.099620    2562 scope.go:117] "RemoveContainer" containerID="cd954c8bf49bee0de89f2c67ab01d4033412d91bfa48d831e869b115e69a77cf"
Jul 06 13:52:58.101138 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:58.101119    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qthdk" event={"ID":"291d0af7-2df1-4fce-87ea-3891408c3616","Type":"ContainerStarted","Data":"e5c01513c3ff1d3c56d0464d9f4ad924454a68c67a4f56227aff061c38a47078"}
Jul 06 13:52:58.101204 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:58.101168    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qthdk" event={"ID":"291d0af7-2df1-4fce-87ea-3891408c3616","Type":"ContainerStarted","Data":"4bfd8d88248e213be93f18b4baf562c27c0cd8f4366a5dda7ba1385a84a4dcb6"}
Jul 06 13:52:58.101270 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:58.101248    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qthdk"
Jul 06 13:52:58.142166 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:58.142111    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qthdk" podStartSLOduration=129.165874282 podStartE2EDuration="2m11.142089337s" totalImagesPullingTime="1.976215055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:52:58.140885135 +0000 UTC m=+165.184496169" watchObservedRunningTime="2026-07-06 13:52:58.142089337 +0000 UTC m=+165.185700372"
Jul 06 13:52:58.276075 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:58.275984    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:52:58.718205 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:58.718171    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z" podUID="d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.6:8000/readyz\": dial tcp 10.132.0.6:8000: connect: connection refused"
Jul 06 13:52:59.107069 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:59.106974    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5565d5b648-6glw5" event={"ID":"4e164594-9e2f-4c13-89a9-855440364518","Type":"ContainerStarted","Data":"0af1d6bd86ce7c0aeddb8c5e540c437349969cec42368ce73b585d20a80fe970"}
Jul 06 13:52:59.108318 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:59.108295    2562 generic.go:356] "Generic (PLEG): container finished" podID="d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed" containerID="dc3da7aed4560aaa3f026e6b087538f94ca7e0872fd58dec8bcaeb11f5b0d84d" exitCode=1
Jul 06 13:52:59.108424 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:59.108354    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z" event={"ID":"d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed","Type":"ContainerDied","Data":"dc3da7aed4560aaa3f026e6b087538f94ca7e0872fd58dec8bcaeb11f5b0d84d"}
Jul 06 13:52:59.108719 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:52:59.108706    2562 scope.go:117] "RemoveContainer" containerID="dc3da7aed4560aaa3f026e6b087538f94ca7e0872fd58dec8bcaeb11f5b0d84d"
Jul 06 13:53:00.113546 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:00.113510    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z" event={"ID":"d2f477a3-4e6a-4acf-9e90-a189aa4dd4ed","Type":"ContainerStarted","Data":"0cbbcd04d304a5a731601fda83ee80ae6397921fb4a011e29259c90c59107917"}
Jul 06 13:53:00.113900 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:00.113786    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"
Jul 06 13:53:00.114305 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:00.114267    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b48d89687-l4g4z"
Jul 06 13:53:02.471217 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:02.471177    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:53:07.774578 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:07.774510    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:07.860681 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:07.860653    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:08.110532 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:08.110442    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qthdk"
Jul 06 13:53:08.933439 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:08.933407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:09.004590 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:09.004554    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:12.214500 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:12.214470    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:12.310764 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:12.310733    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:12.547778 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:12.547703    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:12.649587 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:12.649537    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:14.516477 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:14.516441    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79d4d9b948-gkz8g"]
Jul 06 13:53:14.521049 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:14.521009    2562 patch_prober.go:28] interesting pod/image-registry-79d4d9b948-gkz8g container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 13:53:14.521171 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:14.521068    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g" podUID="7fca930f-1404-40b1-b33b-e5325c8a6259" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 13:53:14.709177 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:14.709138    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:14.831992 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:14.831906    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:14.957095 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:14.957051    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:15.045870 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:15.045841    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:17.408413 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:17.408364    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:17.790007 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:17.789971    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:17.894098 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:17.894066    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:22.182851 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:22.182792    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:24.520974 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:24.520943    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:53:26.680304 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:26.680254    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:26.778965 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:26.778927    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:26.850201 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:26.850169    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:28.304711 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:28.304670    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:30.110251 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:30.110216    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:30.178258 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:30.178234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:34.915080 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:34.915019    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:35.039503 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:35.039444    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:37.938080 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:37.938046    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:38.034312 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:38.034226    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:39.181444 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:39.181409    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:39.281940 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:39.281910    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:39.536644 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:39.536611    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g" podUID="7fca930f-1404-40b1-b33b-e5325c8a6259" containerName="registry" containerID="cri-o://0afadc6e0df2626b60c2522b3992c64d669703a90ef3b0d225d5a0fac1834bd1" gracePeriod=30
Jul 06 13:53:40.772978 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:40.772953    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:53:40.925367 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:40.925303    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-certificates\") pod \"7fca930f-1404-40b1-b33b-e5325c8a6259\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") "
Jul 06 13:53:40.925367 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:40.925344    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fca930f-1404-40b1-b33b-e5325c8a6259-image-registry-private-configuration\") pod \"7fca930f-1404-40b1-b33b-e5325c8a6259\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") "
Jul 06 13:53:40.925367 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:40.925361    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fca930f-1404-40b1-b33b-e5325c8a6259-trusted-ca\") pod \"7fca930f-1404-40b1-b33b-e5325c8a6259\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") "
Jul 06 13:53:40.925593 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:40.925377    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls\") pod \"7fca930f-1404-40b1-b33b-e5325c8a6259\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") "
Jul 06 13:53:40.925593 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:40.925394    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rpn6\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-kube-api-access-5rpn6\") pod \"7fca930f-1404-40b1-b33b-e5325c8a6259\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") "
Jul 06 13:53:40.925593 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:40.925488    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fca930f-1404-40b1-b33b-e5325c8a6259-installation-pull-secrets\") pod \"7fca930f-1404-40b1-b33b-e5325c8a6259\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") "
Jul 06 13:53:40.925593 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:40.925540    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fca930f-1404-40b1-b33b-e5325c8a6259-ca-trust-extracted\") pod \"7fca930f-1404-40b1-b33b-e5325c8a6259\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") "
Jul 06 13:53:40.925593 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:40.925569    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-bound-sa-token\") pod \"7fca930f-1404-40b1-b33b-e5325c8a6259\" (UID: \"7fca930f-1404-40b1-b33b-e5325c8a6259\") "
Jul 06 13:53:40.925841 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:40.925803    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7fca930f-1404-40b1-b33b-e5325c8a6259" (UID: "7fca930f-1404-40b1-b33b-e5325c8a6259"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:53:40.925902 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:40.925826    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fca930f-1404-40b1-b33b-e5325c8a6259-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7fca930f-1404-40b1-b33b-e5325c8a6259" (UID: "7fca930f-1404-40b1-b33b-e5325c8a6259"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:53:40.927833 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:40.927799    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-kube-api-access-5rpn6" (OuterVolumeSpecName: "kube-api-access-5rpn6") pod "7fca930f-1404-40b1-b33b-e5325c8a6259" (UID: "7fca930f-1404-40b1-b33b-e5325c8a6259"). InnerVolumeSpecName "kube-api-access-5rpn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:53:40.927974 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:40.927902    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fca930f-1404-40b1-b33b-e5325c8a6259-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7fca930f-1404-40b1-b33b-e5325c8a6259" (UID: "7fca930f-1404-40b1-b33b-e5325c8a6259"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:53:40.928039 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:40.928013    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7fca930f-1404-40b1-b33b-e5325c8a6259" (UID: "7fca930f-1404-40b1-b33b-e5325c8a6259"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:53:40.928151 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:40.928128    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fca930f-1404-40b1-b33b-e5325c8a6259-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7fca930f-1404-40b1-b33b-e5325c8a6259" (UID: "7fca930f-1404-40b1-b33b-e5325c8a6259"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:53:40.928223 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:40.928185    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7fca930f-1404-40b1-b33b-e5325c8a6259" (UID: "7fca930f-1404-40b1-b33b-e5325c8a6259"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:53:40.934517 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:40.934492    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fca930f-1404-40b1-b33b-e5325c8a6259-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7fca930f-1404-40b1-b33b-e5325c8a6259" (UID: "7fca930f-1404-40b1-b33b-e5325c8a6259"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:53:41.026114 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.026090    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-certificates\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:53:41.026114 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.026114    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fca930f-1404-40b1-b33b-e5325c8a6259-image-registry-private-configuration\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:53:41.026232 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.026125    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fca930f-1404-40b1-b33b-e5325c8a6259-trusted-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:53:41.026232 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.026134    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-registry-tls\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:53:41.026232 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.026142    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rpn6\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-kube-api-access-5rpn6\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:53:41.026232 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.026150    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fca930f-1404-40b1-b33b-e5325c8a6259-installation-pull-secrets\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:53:41.026232 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.026158    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fca930f-1404-40b1-b33b-e5325c8a6259-ca-trust-extracted\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:53:41.026232 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.026166    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fca930f-1404-40b1-b33b-e5325c8a6259-bound-sa-token\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:53:41.251677 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.251647    2562 generic.go:356] "Generic (PLEG): container finished" podID="7fca930f-1404-40b1-b33b-e5325c8a6259" containerID="0afadc6e0df2626b60c2522b3992c64d669703a90ef3b0d225d5a0fac1834bd1" exitCode=0
Jul 06 13:53:41.251801 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.251697    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g"
Jul 06 13:53:41.251801 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.251716    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g" event={"ID":"7fca930f-1404-40b1-b33b-e5325c8a6259","Type":"ContainerDied","Data":"0afadc6e0df2626b60c2522b3992c64d669703a90ef3b0d225d5a0fac1834bd1"}
Jul 06 13:53:41.251801 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.251761    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79d4d9b948-gkz8g" event={"ID":"7fca930f-1404-40b1-b33b-e5325c8a6259","Type":"ContainerDied","Data":"65736a0b4822eacb29fa9132c3e92f4e17dc692e02ba36b2cfd23d654c5f3b33"}
Jul 06 13:53:41.251801 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.251785    2562 scope.go:117] "RemoveContainer" containerID="0afadc6e0df2626b60c2522b3992c64d669703a90ef3b0d225d5a0fac1834bd1"
Jul 06 13:53:41.259980 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.259963    2562 scope.go:117] "RemoveContainer" containerID="0afadc6e0df2626b60c2522b3992c64d669703a90ef3b0d225d5a0fac1834bd1"
Jul 06 13:53:41.260269 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:53:41.260240    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0afadc6e0df2626b60c2522b3992c64d669703a90ef3b0d225d5a0fac1834bd1\": container with ID starting with 0afadc6e0df2626b60c2522b3992c64d669703a90ef3b0d225d5a0fac1834bd1 not found: ID does not exist" containerID="0afadc6e0df2626b60c2522b3992c64d669703a90ef3b0d225d5a0fac1834bd1"
Jul 06 13:53:41.260393 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.260277    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0afadc6e0df2626b60c2522b3992c64d669703a90ef3b0d225d5a0fac1834bd1"} err="failed to get container status \"0afadc6e0df2626b60c2522b3992c64d669703a90ef3b0d225d5a0fac1834bd1\": rpc error: code = NotFound desc = could not find container \"0afadc6e0df2626b60c2522b3992c64d669703a90ef3b0d225d5a0fac1834bd1\": container with ID starting with 0afadc6e0df2626b60c2522b3992c64d669703a90ef3b0d225d5a0fac1834bd1 not found: ID does not exist"
Jul 06 13:53:41.271752 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.271729    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79d4d9b948-gkz8g"]
Jul 06 13:53:41.274781 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.274763    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79d4d9b948-gkz8g"]
Jul 06 13:53:41.475417 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:41.475393    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fca930f-1404-40b1-b33b-e5325c8a6259" path="/var/lib/kubelet/pods/7fca930f-1404-40b1-b33b-e5325c8a6259/volumes"
Jul 06 13:53:49.927723 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:49.927690    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:53:50.123390 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:53:50.123345    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:54:11.275114 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:11.275075    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:54:11.658338 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:11.658237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:54:22.205153 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:22.205118    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:54:22.283668 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:22.283636    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:54:22.352517 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:22.352482    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:54:22.945509 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:22.945481    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:54:23.046171 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:23.046141    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:54:24.414811 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:24.414783    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs\") pod \"network-metrics-daemon-cxr4t\" (UID: \"aab6a8f0-2336-4d20-996a-2ac646db3fa9\") " pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:54:24.416954 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:24.416933    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aab6a8f0-2336-4d20-996a-2ac646db3fa9-metrics-certs\") pod \"network-metrics-daemon-cxr4t\" (UID: \"aab6a8f0-2336-4d20-996a-2ac646db3fa9\") " pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:54:24.674575 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:24.674504    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-469kc\""
Jul 06 13:54:24.683233 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:24.683215    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxr4t"
Jul 06 13:54:24.802621 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:24.802593    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cxr4t"]
Jul 06 13:54:24.805755 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:54:24.805719    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab6a8f0_2336_4d20_996a_2ac646db3fa9.slice/crio-0a5ed25d396b9ae41cf8ca35b2118485a9d92677968ba8c787f4f567e7fba3fc WatchSource:0}: Error finding container 0a5ed25d396b9ae41cf8ca35b2118485a9d92677968ba8c787f4f567e7fba3fc: Status 404 returned error can't find the container with id 0a5ed25d396b9ae41cf8ca35b2118485a9d92677968ba8c787f4f567e7fba3fc
Jul 06 13:54:25.411504 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:25.411467    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cxr4t" event={"ID":"aab6a8f0-2336-4d20-996a-2ac646db3fa9","Type":"ContainerStarted","Data":"0a5ed25d396b9ae41cf8ca35b2118485a9d92677968ba8c787f4f567e7fba3fc"}
Jul 06 13:54:26.416468 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:26.416433    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cxr4t" event={"ID":"aab6a8f0-2336-4d20-996a-2ac646db3fa9","Type":"ContainerStarted","Data":"c73e8bbaa49881fd8f11ab135bf97dcbe164d4d85dd22330461907b5ab67dbb1"}
Jul 06 13:54:26.416846 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:26.416485    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cxr4t" event={"ID":"aab6a8f0-2336-4d20-996a-2ac646db3fa9","Type":"ContainerStarted","Data":"ad00497109e3d8c1cce0c11e51bbb0b6b28ba909fd8ba5fc1fe76536f4a06ddf"}
Jul 06 13:54:26.432082 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:26.432028    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cxr4t" podStartSLOduration=252.387518716 podStartE2EDuration="4m13.432008434s" totalImagesPullingTime="1.044489718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:54:26.431570154 +0000 UTC m=+253.475181189" watchObservedRunningTime="2026-07-06 13:54:26.432008434 +0000 UTC m=+253.475619470"
Jul 06 13:54:26.532033 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:26.531997    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:54:26.633093 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:26.633063    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:54:32.639745 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:32.639710    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:54:32.741872 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:32.741837    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:54:32.841153 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:32.841124    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:54:36.171085 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:54:36.171050    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:55:13.377626 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:13.377601    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 13:55:13.384807 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:13.384784    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 13:55:13.385211 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:13.385188    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 13:55:16.976831 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:16.976798    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:55:26.536826 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:26.536795    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:55:26.637715 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:26.637646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:55:28.540329 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:28.540274    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:55:28.646837 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:28.646800    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:55:28.779868 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:28.779837    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:55:29.260499 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:29.260468    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:55:29.363314 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:29.363266    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:55:38.504645 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:38.504608    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:55:38.580948 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:38.580913    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:55:39.879183 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:39.879153    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:55:39.978171 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:39.978142    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:55:40.046464 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:40.046440    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:55:49.915319 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:49.915263    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:55:50.013800 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:55:50.013753    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:56:33.906615 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:56:33.906536    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:56:34.007077 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:56:34.007045    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:00.949969 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:00.949931    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:03.055831 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:03.055796    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:04.057558 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:04.057492    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:04.158160 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:04.158114    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:04.742332 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:04.742261    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:04.849026 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:04.848989    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:06.468053 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:06.468022    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:06.567083 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:06.567057    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:07.016654 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:07.016615    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:07.119632 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:07.119587    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:09.044783 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:09.044745    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:09.465552 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:09.465518    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:11.544619 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:11.544571    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:11.731342 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:11.731311    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:13.807113 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:13.807072    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:13.909053 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:13.909007    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:17.637022 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:17.636983    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:19.377553 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:19.377513    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:19.476277 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:19.476241    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:20.807887 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:20.807853    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lfpk"]
Jul 06 13:57:20.808270 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:20.808097    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fca930f-1404-40b1-b33b-e5325c8a6259" containerName="registry"
Jul 06 13:57:20.808270 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:20.808116    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fca930f-1404-40b1-b33b-e5325c8a6259" containerName="registry"
Jul 06 13:57:20.808270 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:20.808162    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fca930f-1404-40b1-b33b-e5325c8a6259" containerName="registry"
Jul 06 13:57:20.810885 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:20.810869    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lfpk"
Jul 06 13:57:20.814089 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:20.814067    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 13:57:20.814089 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:20.814071    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 13:57:20.815052 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:20.815034    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2w7tv\""
Jul 06 13:57:20.826123 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:20.826095    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lfpk"]
Jul 06 13:57:20.853229 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:20.853198    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed74b5a8-06bd-4a90-aa95-8f59bf352de7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5lfpk\" (UID: \"ed74b5a8-06bd-4a90-aa95-8f59bf352de7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lfpk"
Jul 06 13:57:20.853402 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:20.853237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvrks\" (UniqueName: \"kubernetes.io/projected/ed74b5a8-06bd-4a90-aa95-8f59bf352de7-kube-api-access-fvrks\") pod \"openshift-lws-operator-fd8ccff4c-5lfpk\" (UID: \"ed74b5a8-06bd-4a90-aa95-8f59bf352de7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lfpk"
Jul 06 13:57:20.954020 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:20.953982    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvrks\" (UniqueName: \"kubernetes.io/projected/ed74b5a8-06bd-4a90-aa95-8f59bf352de7-kube-api-access-fvrks\") pod \"openshift-lws-operator-fd8ccff4c-5lfpk\" (UID: \"ed74b5a8-06bd-4a90-aa95-8f59bf352de7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lfpk"
Jul 06 13:57:20.954153 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:20.954055    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed74b5a8-06bd-4a90-aa95-8f59bf352de7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5lfpk\" (UID: \"ed74b5a8-06bd-4a90-aa95-8f59bf352de7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lfpk"
Jul 06 13:57:20.954495 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:20.954476    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed74b5a8-06bd-4a90-aa95-8f59bf352de7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5lfpk\" (UID: \"ed74b5a8-06bd-4a90-aa95-8f59bf352de7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lfpk"
Jul 06 13:57:20.962568 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:20.962551    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvrks\" (UniqueName: \"kubernetes.io/projected/ed74b5a8-06bd-4a90-aa95-8f59bf352de7-kube-api-access-fvrks\") pod \"openshift-lws-operator-fd8ccff4c-5lfpk\" (UID: \"ed74b5a8-06bd-4a90-aa95-8f59bf352de7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lfpk"
Jul 06 13:57:21.119888 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:21.119782    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lfpk"
Jul 06 13:57:21.244977 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:21.244934    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lfpk"]
Jul 06 13:57:21.248274 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:57:21.248243    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded74b5a8_06bd_4a90_aa95_8f59bf352de7.slice/crio-8aee29daadda2ce50819d969892af70bbb208a1c0a253fa816ee3d0ab7496ca7 WatchSource:0}: Error finding container 8aee29daadda2ce50819d969892af70bbb208a1c0a253fa816ee3d0ab7496ca7: Status 404 returned error can't find the container with id 8aee29daadda2ce50819d969892af70bbb208a1c0a253fa816ee3d0ab7496ca7
Jul 06 13:57:21.249812 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:21.249792    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 13:57:21.997537 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:21.997506    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lfpk" event={"ID":"ed74b5a8-06bd-4a90-aa95-8f59bf352de7","Type":"ContainerStarted","Data":"8aee29daadda2ce50819d969892af70bbb208a1c0a253fa816ee3d0ab7496ca7"}
Jul 06 13:57:25.010430 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:25.010396    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lfpk" event={"ID":"ed74b5a8-06bd-4a90-aa95-8f59bf352de7","Type":"ContainerStarted","Data":"6dbd5c7338ca5f049a5bac37aa12c94b7649a8559567894df81489429d1b6418"}
Jul 06 13:57:25.028716 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:25.028674    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lfpk" podStartSLOduration=1.613097378 podStartE2EDuration="5.028659767s" totalImagesPullingTime="3.415562389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:57:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:57:25.027635069 +0000 UTC m=+432.071246103" watchObservedRunningTime="2026-07-06 13:57:25.028659767 +0000 UTC m=+432.072270800"
Jul 06 13:57:25.832752 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:25.832718    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:26.036519 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:26.036483    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:27.623394 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:27.623364    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:37.772561 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:37.772481    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:37.889808 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:37.889776    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:39.590459 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:39.590433    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:39.692917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:39.692873    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:40.161838 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.161808    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:40.418826 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.418761    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:40.522216 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.522186    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:40.540498 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.540460    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"]
Jul 06 13:57:40.543706 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.543688    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:40.545797 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.545772    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 13:57:40.545896 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.545815    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 13:57:40.545896 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.545842    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 13:57:40.545896 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.545887    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hd8wp\""
Jul 06 13:57:40.546038 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.545960    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 13:57:40.555078 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.555058    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"]
Jul 06 13:57:40.588108 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.588084    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0e53dd21-9406-48bd-ab19-d561825f96e7-manifests\") pod \"opendatahub-operator-controller-manager-5f8f457c8b-wprb5\" (UID: \"0e53dd21-9406-48bd-ab19-d561825f96e7\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:40.588223 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.588121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wht5t\" (UniqueName: \"kubernetes.io/projected/0e53dd21-9406-48bd-ab19-d561825f96e7-kube-api-access-wht5t\") pod \"opendatahub-operator-controller-manager-5f8f457c8b-wprb5\" (UID: \"0e53dd21-9406-48bd-ab19-d561825f96e7\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:40.588223 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.588155    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e53dd21-9406-48bd-ab19-d561825f96e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f8f457c8b-wprb5\" (UID: \"0e53dd21-9406-48bd-ab19-d561825f96e7\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:40.588394 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.588241    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e53dd21-9406-48bd-ab19-d561825f96e7-tmp\") pod \"opendatahub-operator-controller-manager-5f8f457c8b-wprb5\" (UID: \"0e53dd21-9406-48bd-ab19-d561825f96e7\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:40.588394 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.588308    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e53dd21-9406-48bd-ab19-d561825f96e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f8f457c8b-wprb5\" (UID: \"0e53dd21-9406-48bd-ab19-d561825f96e7\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:40.689219 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.689162    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wht5t\" (UniqueName: \"kubernetes.io/projected/0e53dd21-9406-48bd-ab19-d561825f96e7-kube-api-access-wht5t\") pod \"opendatahub-operator-controller-manager-5f8f457c8b-wprb5\" (UID: \"0e53dd21-9406-48bd-ab19-d561825f96e7\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:40.689219 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.689208    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e53dd21-9406-48bd-ab19-d561825f96e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f8f457c8b-wprb5\" (UID: \"0e53dd21-9406-48bd-ab19-d561825f96e7\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:40.689679 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.689235    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e53dd21-9406-48bd-ab19-d561825f96e7-tmp\") pod \"opendatahub-operator-controller-manager-5f8f457c8b-wprb5\" (UID: \"0e53dd21-9406-48bd-ab19-d561825f96e7\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:40.689679 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.689269    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e53dd21-9406-48bd-ab19-d561825f96e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f8f457c8b-wprb5\" (UID: \"0e53dd21-9406-48bd-ab19-d561825f96e7\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:40.689679 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.689327    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0e53dd21-9406-48bd-ab19-d561825f96e7-manifests\") pod \"opendatahub-operator-controller-manager-5f8f457c8b-wprb5\" (UID: \"0e53dd21-9406-48bd-ab19-d561825f96e7\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:40.689837 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.689726    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0e53dd21-9406-48bd-ab19-d561825f96e7-manifests\") pod \"opendatahub-operator-controller-manager-5f8f457c8b-wprb5\" (UID: \"0e53dd21-9406-48bd-ab19-d561825f96e7\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:40.691423 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.691400    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e53dd21-9406-48bd-ab19-d561825f96e7-tmp\") pod \"opendatahub-operator-controller-manager-5f8f457c8b-wprb5\" (UID: \"0e53dd21-9406-48bd-ab19-d561825f96e7\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:40.691523 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.691506    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e53dd21-9406-48bd-ab19-d561825f96e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f8f457c8b-wprb5\" (UID: \"0e53dd21-9406-48bd-ab19-d561825f96e7\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:40.691620 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.691603    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e53dd21-9406-48bd-ab19-d561825f96e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f8f457c8b-wprb5\" (UID: \"0e53dd21-9406-48bd-ab19-d561825f96e7\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:40.698355 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.698333    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wht5t\" (UniqueName: \"kubernetes.io/projected/0e53dd21-9406-48bd-ab19-d561825f96e7-kube-api-access-wht5t\") pod \"opendatahub-operator-controller-manager-5f8f457c8b-wprb5\" (UID: \"0e53dd21-9406-48bd-ab19-d561825f96e7\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:40.726274 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.726249    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:40.831732 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.831713    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:40.854823 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.854802    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:40.927764 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.927727    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:40.984552 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:40.984526    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"]
Jul 06 13:57:41.020295 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:41.020261    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:41.062810 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:41.062781    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5" event={"ID":"0e53dd21-9406-48bd-ab19-d561825f96e7","Type":"ContainerStarted","Data":"c4521e069e39c30f954ff75be2128adb98c046022567d08a70aaf49bdd35db25"}
Jul 06 13:57:41.114491 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:41.114468    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:41.217401 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:41.217371    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:41.315672 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:41.315585    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:44.076095 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:44.076067    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5" event={"ID":"0e53dd21-9406-48bd-ab19-d561825f96e7","Type":"ContainerStarted","Data":"0ea948be0bbcad0ce48ecaacad6f7a9211dfa4e63fb576557f820e62b35c05f1"}
Jul 06 13:57:46.085058 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:46.085020    2562 generic.go:356] "Generic (PLEG): container finished" podID="0e53dd21-9406-48bd-ab19-d561825f96e7" containerID="0ea948be0bbcad0ce48ecaacad6f7a9211dfa4e63fb576557f820e62b35c05f1" exitCode=0
Jul 06 13:57:46.085472 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:46.085099    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5" event={"ID":"0e53dd21-9406-48bd-ab19-d561825f96e7","Type":"ContainerDied","Data":"0ea948be0bbcad0ce48ecaacad6f7a9211dfa4e63fb576557f820e62b35c05f1"}
Jul 06 13:57:47.090710 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:47.090678    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5" event={"ID":"0e53dd21-9406-48bd-ab19-d561825f96e7","Type":"ContainerStarted","Data":"f63df65d9736e8ec64d0bb5f25abae58aeb7ff2128a221a4adbc8dfe8e8c1b24"}
Jul 06 13:57:47.091062 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:47.090884    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:47.115494 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:47.115449    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5" podStartSLOduration=2.489699257 podStartE2EDuration="7.115432669s" totalImagesPullingTime="3.567040774s" totalInitContainerRuntime="1.058692638s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:57:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:57:47.113798097 +0000 UTC m=+454.157409131" watchObservedRunningTime="2026-07-06 13:57:47.115432669 +0000 UTC m=+454.159043699"
Jul 06 13:57:56.020326 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:56.020274    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:56.091612 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:56.091583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:56.450322 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:56.450208    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:56.549142 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:56.549117    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:57:58.097384 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:58.097348    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f8f457c8b-wprb5"
Jul 06 13:57:59.706500 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:57:59.706437    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:00.089017 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:00.088921    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:10.525101 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.525063    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s"]
Jul 06 13:58:10.528200 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.528180    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s"
Jul 06 13:58:10.530632 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.530609    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 13:58:10.530742 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.530656    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 13:58:10.530742 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.530681    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 13:58:10.530742 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.530684    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 13:58:10.536541 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.536519    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s"]
Jul 06 13:58:10.598989 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.598953    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67180de5-a0c7-4f3c-9a00-3a3a87d88369-tls-certs\") pod \"kube-auth-proxy-7c6c964b95-vjh7s\" (UID: \"67180de5-a0c7-4f3c-9a00-3a3a87d88369\") " pod="openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s"
Jul 06 13:58:10.599137 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.599010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67180de5-a0c7-4f3c-9a00-3a3a87d88369-tmp\") pod \"kube-auth-proxy-7c6c964b95-vjh7s\" (UID: \"67180de5-a0c7-4f3c-9a00-3a3a87d88369\") " pod="openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s"
Jul 06 13:58:10.599137 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.599107    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wfld\" (UniqueName: \"kubernetes.io/projected/67180de5-a0c7-4f3c-9a00-3a3a87d88369-kube-api-access-9wfld\") pod \"kube-auth-proxy-7c6c964b95-vjh7s\" (UID: \"67180de5-a0c7-4f3c-9a00-3a3a87d88369\") " pod="openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s"
Jul 06 13:58:10.606395 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.606356    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:10.699762 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.699732    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67180de5-a0c7-4f3c-9a00-3a3a87d88369-tmp\") pod \"kube-auth-proxy-7c6c964b95-vjh7s\" (UID: \"67180de5-a0c7-4f3c-9a00-3a3a87d88369\") " pod="openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s"
Jul 06 13:58:10.699946 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.699776    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wfld\" (UniqueName: \"kubernetes.io/projected/67180de5-a0c7-4f3c-9a00-3a3a87d88369-kube-api-access-9wfld\") pod \"kube-auth-proxy-7c6c964b95-vjh7s\" (UID: \"67180de5-a0c7-4f3c-9a00-3a3a87d88369\") " pod="openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s"
Jul 06 13:58:10.699946 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.699912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67180de5-a0c7-4f3c-9a00-3a3a87d88369-tls-certs\") pod \"kube-auth-proxy-7c6c964b95-vjh7s\" (UID: \"67180de5-a0c7-4f3c-9a00-3a3a87d88369\") " pod="openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s"
Jul 06 13:58:10.700056 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:58:10.700038    2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 06 13:58:10.700125 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:58:10.700114    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67180de5-a0c7-4f3c-9a00-3a3a87d88369-tls-certs podName:67180de5-a0c7-4f3c-9a00-3a3a87d88369 nodeName:}" failed. No retries permitted until 2026-07-06 13:58:11.20009686 +0000 UTC m=+478.243707873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/67180de5-a0c7-4f3c-9a00-3a3a87d88369-tls-certs") pod "kube-auth-proxy-7c6c964b95-vjh7s" (UID: "67180de5-a0c7-4f3c-9a00-3a3a87d88369") : secret "kube-auth-proxy-tls" not found
Jul 06 13:58:10.701981 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.701962    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67180de5-a0c7-4f3c-9a00-3a3a87d88369-tmp\") pod \"kube-auth-proxy-7c6c964b95-vjh7s\" (UID: \"67180de5-a0c7-4f3c-9a00-3a3a87d88369\") " pod="openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s"
Jul 06 13:58:10.709195 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.709174    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bl2ks"]
Jul 06 13:58:10.711407 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.711382    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wfld\" (UniqueName: \"kubernetes.io/projected/67180de5-a0c7-4f3c-9a00-3a3a87d88369-kube-api-access-9wfld\") pod \"kube-auth-proxy-7c6c964b95-vjh7s\" (UID: \"67180de5-a0c7-4f3c-9a00-3a3a87d88369\") " pod="openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s"
Jul 06 13:58:10.712355 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.712342    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bl2ks"
Jul 06 13:58:10.714401 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.714384    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 13:58:10.714480 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.714425    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-f9qtc\""
Jul 06 13:58:10.721806 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.721783    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bl2ks"]
Jul 06 13:58:10.741907 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.741873    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:10.801412 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.801330    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j5k2\" (UniqueName: \"kubernetes.io/projected/43550359-6195-4904-9914-c2be03380e58-kube-api-access-9j5k2\") pod \"odh-model-controller-7998c67dc4-bl2ks\" (UID: \"43550359-6195-4904-9914-c2be03380e58\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl2ks"
Jul 06 13:58:10.801412 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.801375    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43550359-6195-4904-9914-c2be03380e58-cert\") pod \"odh-model-controller-7998c67dc4-bl2ks\" (UID: \"43550359-6195-4904-9914-c2be03380e58\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl2ks"
Jul 06 13:58:10.837962 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.837932    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:10.902316 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.902273    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j5k2\" (UniqueName: \"kubernetes.io/projected/43550359-6195-4904-9914-c2be03380e58-kube-api-access-9j5k2\") pod \"odh-model-controller-7998c67dc4-bl2ks\" (UID: \"43550359-6195-4904-9914-c2be03380e58\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl2ks"
Jul 06 13:58:10.902434 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.902335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43550359-6195-4904-9914-c2be03380e58-cert\") pod \"odh-model-controller-7998c67dc4-bl2ks\" (UID: \"43550359-6195-4904-9914-c2be03380e58\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl2ks"
Jul 06 13:58:10.902434 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:58:10.902432    2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 06 13:58:10.902598 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:58:10.902492    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43550359-6195-4904-9914-c2be03380e58-cert podName:43550359-6195-4904-9914-c2be03380e58 nodeName:}" failed. No retries permitted until 2026-07-06 13:58:11.402476776 +0000 UTC m=+478.446087788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/43550359-6195-4904-9914-c2be03380e58-cert") pod "odh-model-controller-7998c67dc4-bl2ks" (UID: "43550359-6195-4904-9914-c2be03380e58") : secret "odh-model-controller-webhook-cert" not found
Jul 06 13:58:10.915816 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.915783    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j5k2\" (UniqueName: \"kubernetes.io/projected/43550359-6195-4904-9914-c2be03380e58-kube-api-access-9j5k2\") pod \"odh-model-controller-7998c67dc4-bl2ks\" (UID: \"43550359-6195-4904-9914-c2be03380e58\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl2ks"
Jul 06 13:58:10.940945 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:10.940918    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:11.044420 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.044385    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:11.205480 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.205450    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67180de5-a0c7-4f3c-9a00-3a3a87d88369-tls-certs\") pod \"kube-auth-proxy-7c6c964b95-vjh7s\" (UID: \"67180de5-a0c7-4f3c-9a00-3a3a87d88369\") " pod="openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s"
Jul 06 13:58:11.208194 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.208157    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67180de5-a0c7-4f3c-9a00-3a3a87d88369-tls-certs\") pod \"kube-auth-proxy-7c6c964b95-vjh7s\" (UID: \"67180de5-a0c7-4f3c-9a00-3a3a87d88369\") " pod="openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s"
Jul 06 13:58:11.273102 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.273063    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:11.281480 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.281440    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qzt79"]
Jul 06 13:58:11.284629 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.284614    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qzt79"
Jul 06 13:58:11.289695 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.289674    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 13:58:11.302982 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.302957    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qzt79"]
Jul 06 13:58:11.406836 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.406800    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43550359-6195-4904-9914-c2be03380e58-cert\") pod \"odh-model-controller-7998c67dc4-bl2ks\" (UID: \"43550359-6195-4904-9914-c2be03380e58\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl2ks"
Jul 06 13:58:11.407023 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.406868    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/493caa25-6613-49b7-b33d-504f939cd182-tls-certs\") pod \"model-serving-api-54d89bd5fc-qzt79\" (UID: \"493caa25-6613-49b7-b33d-504f939cd182\") " pod="opendatahub/model-serving-api-54d89bd5fc-qzt79"
Jul 06 13:58:11.407023 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.406906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cztd\" (UniqueName: \"kubernetes.io/projected/493caa25-6613-49b7-b33d-504f939cd182-kube-api-access-5cztd\") pod \"model-serving-api-54d89bd5fc-qzt79\" (UID: \"493caa25-6613-49b7-b33d-504f939cd182\") " pod="opendatahub/model-serving-api-54d89bd5fc-qzt79"
Jul 06 13:58:11.409220 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.409201    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43550359-6195-4904-9914-c2be03380e58-cert\") pod \"odh-model-controller-7998c67dc4-bl2ks\" (UID: \"43550359-6195-4904-9914-c2be03380e58\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl2ks"
Jul 06 13:58:11.438444 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.438418    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s"
Jul 06 13:58:11.507606 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.507575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/493caa25-6613-49b7-b33d-504f939cd182-tls-certs\") pod \"model-serving-api-54d89bd5fc-qzt79\" (UID: \"493caa25-6613-49b7-b33d-504f939cd182\") " pod="opendatahub/model-serving-api-54d89bd5fc-qzt79"
Jul 06 13:58:11.507742 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.507617    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cztd\" (UniqueName: \"kubernetes.io/projected/493caa25-6613-49b7-b33d-504f939cd182-kube-api-access-5cztd\") pod \"model-serving-api-54d89bd5fc-qzt79\" (UID: \"493caa25-6613-49b7-b33d-504f939cd182\") " pod="opendatahub/model-serving-api-54d89bd5fc-qzt79"
Jul 06 13:58:11.507742 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:58:11.507729    2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 06 13:58:11.507815 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:58:11.507797    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/493caa25-6613-49b7-b33d-504f939cd182-tls-certs podName:493caa25-6613-49b7-b33d-504f939cd182 nodeName:}" failed. No retries permitted until 2026-07-06 13:58:12.007781048 +0000 UTC m=+479.051392060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/493caa25-6613-49b7-b33d-504f939cd182-tls-certs") pod "model-serving-api-54d89bd5fc-qzt79" (UID: "493caa25-6613-49b7-b33d-504f939cd182") : secret "model-serving-api-tls" not found
Jul 06 13:58:11.519515 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.519489    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cztd\" (UniqueName: \"kubernetes.io/projected/493caa25-6613-49b7-b33d-504f939cd182-kube-api-access-5cztd\") pod \"model-serving-api-54d89bd5fc-qzt79\" (UID: \"493caa25-6613-49b7-b33d-504f939cd182\") " pod="opendatahub/model-serving-api-54d89bd5fc-qzt79"
Jul 06 13:58:11.563056 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.563025    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s"]
Jul 06 13:58:11.565935 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:58:11.565901    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67180de5_a0c7_4f3c_9a00_3a3a87d88369.slice/crio-980adee4addef4be53046de998973a37adc796dcd7a95427130da17c506705cf WatchSource:0}: Error finding container 980adee4addef4be53046de998973a37adc796dcd7a95427130da17c506705cf: Status 404 returned error can't find the container with id 980adee4addef4be53046de998973a37adc796dcd7a95427130da17c506705cf
Jul 06 13:58:11.629079 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.629049    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bl2ks"
Jul 06 13:58:11.739114 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.739024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:11.746121 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.746096    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"]
Jul 06 13:58:11.749334 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.749316    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.751683 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.751655    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 13:58:11.751683 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.751681    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 13:58:11.752063 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.751696    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pc4bj\""
Jul 06 13:58:11.752063 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.751695    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 13:58:11.752063 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.751653    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 13:58:11.762854 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.762829    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bl2ks"]
Jul 06 13:58:11.764294 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.764262    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"]
Jul 06 13:58:11.765719 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:58:11.765694    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43550359_6195_4904_9914_c2be03380e58.slice/crio-1e61d9c65b8d96ef72f12b629ba72208fcf05254a222c89970b9ef89bf098d9b WatchSource:0}: Error finding container 1e61d9c65b8d96ef72f12b629ba72208fcf05254a222c89970b9ef89bf098d9b: Status 404 returned error can't find the container with id 1e61d9c65b8d96ef72f12b629ba72208fcf05254a222c89970b9ef89bf098d9b
Jul 06 13:58:11.809443 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.809401    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-local-certs\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.809443 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.809447    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.809642 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.809504    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.809642 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.809538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-cacerts\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.809642 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.809583    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.809642 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.809627    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnt6t\" (UniqueName: \"kubernetes.io/projected/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-kube-api-access-mnt6t\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.809764 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.809649    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-token\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.836191 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.836157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:11.908009 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.907984    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:11.909944 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.909925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.909997 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.909964    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnt6t\" (UniqueName: \"kubernetes.io/projected/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-kube-api-access-mnt6t\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.909997 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.909985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-token\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.910074 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.910029    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-local-certs\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.910074 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.910045    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.910074 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.910069    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.910218 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.910086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-cacerts\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.910707 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.910679    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.912477 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.912452    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.912580 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.912549    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.912649 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.912632    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-local-certs\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.912810 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.912789    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-cacerts\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.917252 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.917228    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnt6t\" (UniqueName: \"kubernetes.io/projected/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-kube-api-access-mnt6t\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:11.917362 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:11.917250    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-token\") pod \"istiod-openshift-gateway-7574459656-jv7sk\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:12.010530 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:12.010435    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/493caa25-6613-49b7-b33d-504f939cd182-tls-certs\") pod \"model-serving-api-54d89bd5fc-qzt79\" (UID: \"493caa25-6613-49b7-b33d-504f939cd182\") " pod="opendatahub/model-serving-api-54d89bd5fc-qzt79"
Jul 06 13:58:12.012718 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:12.012700    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/493caa25-6613-49b7-b33d-504f939cd182-tls-certs\") pod \"model-serving-api-54d89bd5fc-qzt79\" (UID: \"493caa25-6613-49b7-b33d-504f939cd182\") " pod="opendatahub/model-serving-api-54d89bd5fc-qzt79"
Jul 06 13:58:12.058671 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:12.058644    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:12.175428 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:12.175395    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bl2ks" event={"ID":"43550359-6195-4904-9914-c2be03380e58","Type":"ContainerStarted","Data":"1e61d9c65b8d96ef72f12b629ba72208fcf05254a222c89970b9ef89bf098d9b"}
Jul 06 13:58:12.176466 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:12.176440    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s" event={"ID":"67180de5-a0c7-4f3c-9a00-3a3a87d88369","Type":"ContainerStarted","Data":"980adee4addef4be53046de998973a37adc796dcd7a95427130da17c506705cf"}
Jul 06 13:58:12.184947 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:12.184931    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"]
Jul 06 13:58:12.187321 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:58:12.187277    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ddf0b8e_432a_49c6_a0f5_e738aadaa973.slice/crio-5b01670e837109ded6ab3a72e2843758387e4753cd71cd2dec4a80faf0a294b1 WatchSource:0}: Error finding container 5b01670e837109ded6ab3a72e2843758387e4753cd71cd2dec4a80faf0a294b1: Status 404 returned error can't find the container with id 5b01670e837109ded6ab3a72e2843758387e4753cd71cd2dec4a80faf0a294b1
Jul 06 13:58:12.194596 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:12.194576    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qzt79"
Jul 06 13:58:12.329355 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:12.329322    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qzt79"]
Jul 06 13:58:12.332139 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:58:12.332109    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493caa25_6613_49b7_b33d_504f939cd182.slice/crio-7f29be4bbb8e95d2da6b12fa86fca7ab2b4d60230f137feb3c9d0892d7854768 WatchSource:0}: Error finding container 7f29be4bbb8e95d2da6b12fa86fca7ab2b4d60230f137feb3c9d0892d7854768: Status 404 returned error can't find the container with id 7f29be4bbb8e95d2da6b12fa86fca7ab2b4d60230f137feb3c9d0892d7854768
Jul 06 13:58:12.852957 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:12.852926    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:13.185581 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:13.185497    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk" event={"ID":"2ddf0b8e-432a-49c6-a0f5-e738aadaa973","Type":"ContainerStarted","Data":"5b01670e837109ded6ab3a72e2843758387e4753cd71cd2dec4a80faf0a294b1"}
Jul 06 13:58:13.187255 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:13.187174    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qzt79" event={"ID":"493caa25-6613-49b7-b33d-504f939cd182","Type":"ContainerStarted","Data":"7f29be4bbb8e95d2da6b12fa86fca7ab2b4d60230f137feb3c9d0892d7854768"}
Jul 06 13:58:15.135694 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:15.135654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:15.202230 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:15.202173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:16.950761 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:16.950721    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 13:58:16.951134 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:16.950802    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 13:58:16.958711 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:16.958691    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 13:58:17.206232 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:17.206194    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bl2ks" event={"ID":"43550359-6195-4904-9914-c2be03380e58","Type":"ContainerStarted","Data":"6d256373697b6f880f928221a4ef8dd87d1fe9981a7a473dfc45644c906c1acd"}
Jul 06 13:58:17.206424 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:17.206332    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-bl2ks"
Jul 06 13:58:17.207733 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:17.207699    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s" event={"ID":"67180de5-a0c7-4f3c-9a00-3a3a87d88369","Type":"ContainerStarted","Data":"accd018d843f8f3f7e75d4dcc5d65a47cca36f00da140997d2126df057130660"}
Jul 06 13:58:17.209218 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:17.209192    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qzt79" event={"ID":"493caa25-6613-49b7-b33d-504f939cd182","Type":"ContainerStarted","Data":"3f2aec5725a4e93c2c49fa07ead1f4eb9a0e2be26d6dffbfee3db3491c504430"}
Jul 06 13:58:17.209357 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:17.209252    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-qzt79"
Jul 06 13:58:17.210721 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:17.210700    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk" event={"ID":"2ddf0b8e-432a-49c6-a0f5-e738aadaa973","Type":"ContainerStarted","Data":"8ecd6d2d6d1be7eff56d28d45c9a32abc7bebf1dfaf8b04b011157e65d98128c"}
Jul 06 13:58:17.210817 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:17.210806    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:17.255910 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:17.255864    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-bl2ks" podStartSLOduration=2.073072934 podStartE2EDuration="7.255851444s" totalImagesPullingTime="5.18277851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:58:17.254649371 +0000 UTC m=+484.298260404" watchObservedRunningTime="2026-07-06 13:58:17.255851444 +0000 UTC m=+484.299462456"
Jul 06 13:58:17.294202 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:17.294149    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk" podStartSLOduration=1.5327205400000001 podStartE2EDuration="6.294135001s" totalImagesPullingTime="4.761414461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:58:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:58:17.29346221 +0000 UTC m=+484.337073277" watchObservedRunningTime="2026-07-06 13:58:17.294135001 +0000 UTC m=+484.337746036"
Jul 06 13:58:17.341912 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:17.341859    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c6c964b95-vjh7s" podStartSLOduration=1.952862119 podStartE2EDuration="7.341844899s" totalImagesPullingTime="5.38898278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:58:17.340253124 +0000 UTC m=+484.383864159" watchObservedRunningTime="2026-07-06 13:58:17.341844899 +0000 UTC m=+484.385455933"
Jul 06 13:58:17.387921 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:17.387856    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-qzt79" podStartSLOduration=1.77144624 podStartE2EDuration="6.387834096s" totalImagesPullingTime="4.616387856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:58:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:58:17.38612205 +0000 UTC m=+484.429733075" watchObservedRunningTime="2026-07-06 13:58:17.387834096 +0000 UTC m=+484.431445132"
Jul 06 13:58:18.111658 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.111620    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:18.211605 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.211570    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:18.218666 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.218631    2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-jv7sk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 13:58:18.218800 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.218691    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk" podUID="2ddf0b8e-432a-49c6-a0f5-e738aadaa973" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 13:58:18.366531 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.366463    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"]
Jul 06 13:58:18.369656 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.369634    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.371849 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.371829    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-zgqsl\""
Jul 06 13:58:18.386092 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.386070    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"]
Jul 06 13:58:18.392713 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.392693    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:18.465975 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.465946    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de50a145-08b8-4aa2-a36e-8efd7a536603-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.466126 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.465987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de50a145-08b8-4aa2-a36e-8efd7a536603-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.466126 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.466011    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de50a145-08b8-4aa2-a36e-8efd7a536603-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.466126 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.466034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de50a145-08b8-4aa2-a36e-8efd7a536603-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.466126 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.466081    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de50a145-08b8-4aa2-a36e-8efd7a536603-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.466126 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.466102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de50a145-08b8-4aa2-a36e-8efd7a536603-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.466358 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.466131    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de50a145-08b8-4aa2-a36e-8efd7a536603-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.466358 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.466147    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sftwz\" (UniqueName: \"kubernetes.io/projected/de50a145-08b8-4aa2-a36e-8efd7a536603-kube-api-access-sftwz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.466358 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.466187    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de50a145-08b8-4aa2-a36e-8efd7a536603-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.567233 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.567201    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de50a145-08b8-4aa2-a36e-8efd7a536603-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.567412 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.567243    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de50a145-08b8-4aa2-a36e-8efd7a536603-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.567412 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.567361    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de50a145-08b8-4aa2-a36e-8efd7a536603-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.567412 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.567396    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de50a145-08b8-4aa2-a36e-8efd7a536603-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.567553 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.567424    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de50a145-08b8-4aa2-a36e-8efd7a536603-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.567553 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.567452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de50a145-08b8-4aa2-a36e-8efd7a536603-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.567553 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.567496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de50a145-08b8-4aa2-a36e-8efd7a536603-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.567553 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.567519    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sftwz\" (UniqueName: \"kubernetes.io/projected/de50a145-08b8-4aa2-a36e-8efd7a536603-kube-api-access-sftwz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.567553 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.567547    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de50a145-08b8-4aa2-a36e-8efd7a536603-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.567847 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.567821    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de50a145-08b8-4aa2-a36e-8efd7a536603-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.567944 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.567856    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de50a145-08b8-4aa2-a36e-8efd7a536603-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.567944 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.567930    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de50a145-08b8-4aa2-a36e-8efd7a536603-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.568036 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.568019    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de50a145-08b8-4aa2-a36e-8efd7a536603-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.568076 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.568053    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de50a145-08b8-4aa2-a36e-8efd7a536603-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.569773 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.569741    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de50a145-08b8-4aa2-a36e-8efd7a536603-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.569917 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.569896    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de50a145-08b8-4aa2-a36e-8efd7a536603-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.576332 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.576262    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de50a145-08b8-4aa2-a36e-8efd7a536603-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.576512 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.576495    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sftwz\" (UniqueName: \"kubernetes.io/projected/de50a145-08b8-4aa2-a36e-8efd7a536603-kube-api-access-sftwz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cdnsk\" (UID: \"de50a145-08b8-4aa2-a36e-8efd7a536603\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.586444 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.586422    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:18.679667 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.679589    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:18.684436 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.684380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:18.811043 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:18.811010    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"]
Jul 06 13:58:18.813923 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:58:18.813896    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde50a145_08b8_4aa2_a36e_8efd7a536603.slice/crio-79016e85fabf4a5e7e84d08e815dd41c98a80a223de3141a25b0a2be2e650ce3 WatchSource:0}: Error finding container 79016e85fabf4a5e7e84d08e815dd41c98a80a223de3141a25b0a2be2e650ce3: Status 404 returned error can't find the container with id 79016e85fabf4a5e7e84d08e815dd41c98a80a223de3141a25b0a2be2e650ce3
Jul 06 13:58:19.220425 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:19.220389    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk" event={"ID":"de50a145-08b8-4aa2-a36e-8efd7a536603","Type":"ContainerStarted","Data":"79016e85fabf4a5e7e84d08e815dd41c98a80a223de3141a25b0a2be2e650ce3"}
Jul 06 13:58:20.586947 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.586912    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:20.634504 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.634472    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8rvn9"]
Jul 06 13:58:20.638057 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.638035    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8rvn9"
Jul 06 13:58:20.640410 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.640193    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 13:58:20.640410 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.640200    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-fvqg2\""
Jul 06 13:58:20.652002 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.651929    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8rvn9"]
Jul 06 13:58:20.653466 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.653445    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zdjkc"]
Jul 06 13:58:20.657150 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.657135    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zdjkc"
Jul 06 13:58:20.659524 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.659415    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-6mr78\""
Jul 06 13:58:20.659755 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.659730    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 13:58:20.666131 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.666055    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zdjkc"]
Jul 06 13:58:20.672663 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.672631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:20.786229 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.786192    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtlcv\" (UniqueName: \"kubernetes.io/projected/1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff-kube-api-access-xtlcv\") pod \"kserve-controller-manager-d6f4b65b8-8rvn9\" (UID: \"1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8rvn9"
Jul 06 13:58:20.786425 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.786238    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f18de81-e9cd-40b6-8454-ec576c220cf0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zdjkc\" (UID: \"4f18de81-e9cd-40b6-8454-ec576c220cf0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zdjkc"
Jul 06 13:58:20.786425 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.786329    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff-cert\") pod \"kserve-controller-manager-d6f4b65b8-8rvn9\" (UID: \"1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8rvn9"
Jul 06 13:58:20.786425 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.786354    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhvx8\" (UniqueName: \"kubernetes.io/projected/4f18de81-e9cd-40b6-8454-ec576c220cf0-kube-api-access-xhvx8\") pod \"llmisvc-controller-manager-777c6bd7d5-zdjkc\" (UID: \"4f18de81-e9cd-40b6-8454-ec576c220cf0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zdjkc"
Jul 06 13:58:20.856852 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.856771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:20.886865 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.886835    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtlcv\" (UniqueName: \"kubernetes.io/projected/1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff-kube-api-access-xtlcv\") pod \"kserve-controller-manager-d6f4b65b8-8rvn9\" (UID: \"1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8rvn9"
Jul 06 13:58:20.887046 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.886873    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f18de81-e9cd-40b6-8454-ec576c220cf0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zdjkc\" (UID: \"4f18de81-e9cd-40b6-8454-ec576c220cf0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zdjkc"
Jul 06 13:58:20.887046 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.886899    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff-cert\") pod \"kserve-controller-manager-d6f4b65b8-8rvn9\" (UID: \"1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8rvn9"
Jul 06 13:58:20.887046 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.886915    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhvx8\" (UniqueName: \"kubernetes.io/projected/4f18de81-e9cd-40b6-8454-ec576c220cf0-kube-api-access-xhvx8\") pod \"llmisvc-controller-manager-777c6bd7d5-zdjkc\" (UID: \"4f18de81-e9cd-40b6-8454-ec576c220cf0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zdjkc"
Jul 06 13:58:20.887046 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:58:20.887011    2562 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 06 13:58:20.887249 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:58:20.887082    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff-cert podName:1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff nodeName:}" failed. No retries permitted until 2026-07-06 13:58:21.387061507 +0000 UTC m=+488.430672526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff-cert") pod "kserve-controller-manager-d6f4b65b8-8rvn9" (UID: "1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff") : secret "kserve-webhook-server-cert" not found
Jul 06 13:58:20.889440 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.889404    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f18de81-e9cd-40b6-8454-ec576c220cf0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zdjkc\" (UID: \"4f18de81-e9cd-40b6-8454-ec576c220cf0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zdjkc"
Jul 06 13:58:20.901769 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.901745    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhvx8\" (UniqueName: \"kubernetes.io/projected/4f18de81-e9cd-40b6-8454-ec576c220cf0-kube-api-access-xhvx8\") pod \"llmisvc-controller-manager-777c6bd7d5-zdjkc\" (UID: \"4f18de81-e9cd-40b6-8454-ec576c220cf0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zdjkc"
Jul 06 13:58:20.905617 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.905592    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtlcv\" (UniqueName: \"kubernetes.io/projected/1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff-kube-api-access-xtlcv\") pod \"kserve-controller-manager-d6f4b65b8-8rvn9\" (UID: \"1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8rvn9"
Jul 06 13:58:20.970101 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:20.970066    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zdjkc"
Jul 06 13:58:21.217345 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:21.217319    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:21.281935 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:21.281902    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:21.390854 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:21.390821    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff-cert\") pod \"kserve-controller-manager-d6f4b65b8-8rvn9\" (UID: \"1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8rvn9"
Jul 06 13:58:21.393706 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:21.393671    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff-cert\") pod \"kserve-controller-manager-d6f4b65b8-8rvn9\" (UID: \"1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8rvn9"
Jul 06 13:58:21.552814 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:21.552737    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8rvn9"
Jul 06 13:58:21.814612 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:21.814508    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 13:58:21.814612 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:21.814605    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 13:58:21.815029 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:21.814649    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 13:58:21.854626 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:21.854587    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:21.895449 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:21.895418    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8rvn9"]
Jul 06 13:58:21.895814 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:58:21.895793    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d59f4f3_c041_4c34_b25c_8d32bfa6c5ff.slice/crio-5f9d81946195c0986b9bef58237322ef17ce1a61bd9991514a9db99d7bbc1177 WatchSource:0}: Error finding container 5f9d81946195c0986b9bef58237322ef17ce1a61bd9991514a9db99d7bbc1177: Status 404 returned error can't find the container with id 5f9d81946195c0986b9bef58237322ef17ce1a61bd9991514a9db99d7bbc1177
Jul 06 13:58:21.922446 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:21.922420    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zdjkc"]
Jul 06 13:58:21.924813 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:58:21.924783    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4f18de81_e9cd_40b6_8454_ec576c220cf0.slice/crio-4783c4ecf440e4d4e7e04639137750d31a9066a4f7f1dd940ee71a62e406fe4f WatchSource:0}: Error finding container 4783c4ecf440e4d4e7e04639137750d31a9066a4f7f1dd940ee71a62e406fe4f: Status 404 returned error can't find the container with id 4783c4ecf440e4d4e7e04639137750d31a9066a4f7f1dd940ee71a62e406fe4f
Jul 06 13:58:21.950885 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:21.950844    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:22.054784 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:22.054751    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:22.234754 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:22.234724    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8rvn9" event={"ID":"1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff","Type":"ContainerStarted","Data":"5f9d81946195c0986b9bef58237322ef17ce1a61bd9991514a9db99d7bbc1177"}
Jul 06 13:58:22.235888 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:22.235863    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zdjkc" event={"ID":"4f18de81-e9cd-40b6-8454-ec576c220cf0","Type":"ContainerStarted","Data":"4783c4ecf440e4d4e7e04639137750d31a9066a4f7f1dd940ee71a62e406fe4f"}
Jul 06 13:58:22.237217 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:22.237194    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk" event={"ID":"de50a145-08b8-4aa2-a36e-8efd7a536603","Type":"ContainerStarted","Data":"7ab1028d412a7a185a3ca93f9f03da50e8467d3f2c0c441541fa8f8569605e1d"}
Jul 06 13:58:22.258302 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:22.258233    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk" podStartSLOduration=1.260212889 podStartE2EDuration="4.258219241s" totalImagesPullingTime="2.998006352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:58:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:58:22.257687423 +0000 UTC m=+489.301298456" watchObservedRunningTime="2026-07-06 13:58:22.258219241 +0000 UTC m=+489.301830275"
Jul 06 13:58:22.679948 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:22.679840    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:22.684937 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:22.684914    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:23.245071 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.245036    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:23.246468 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.246378    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cdnsk"
Jul 06 13:58:23.556454 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.556377    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"]
Jul 06 13:58:23.556644 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.556610    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk" podUID="2ddf0b8e-432a-49c6-a0f5-e738aadaa973" containerName="discovery" containerID="cri-o://8ecd6d2d6d1be7eff56d28d45c9a32abc7bebf1dfaf8b04b011157e65d98128c" gracePeriod=30
Jul 06 13:58:23.823467 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.823438    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:23.917140 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.917106    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-kubeconfig\") pod \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") "
Jul 06 13:58:23.917355 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.917196    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-cacerts\") pod \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") "
Jul 06 13:58:23.917355 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.917235    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-token\") pod \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") "
Jul 06 13:58:23.917355 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.917266    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-csr-dns-cert\") pod \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") "
Jul 06 13:58:23.917355 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.917316    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnt6t\" (UniqueName: \"kubernetes.io/projected/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-kube-api-access-mnt6t\") pod \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") "
Jul 06 13:58:23.917355 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.917345    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-local-certs\") pod \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") "
Jul 06 13:58:23.917602 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.917401    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-csr-ca-configmap\") pod \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\" (UID: \"2ddf0b8e-432a-49c6-a0f5-e738aadaa973\") "
Jul 06 13:58:23.918116 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.918054    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "2ddf0b8e-432a-49c6-a0f5-e738aadaa973" (UID: "2ddf0b8e-432a-49c6-a0f5-e738aadaa973"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:58:23.920897 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.920599    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "2ddf0b8e-432a-49c6-a0f5-e738aadaa973" (UID: "2ddf0b8e-432a-49c6-a0f5-e738aadaa973"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:58:23.920897 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.920828    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-cacerts" (OuterVolumeSpecName: "cacerts") pod "2ddf0b8e-432a-49c6-a0f5-e738aadaa973" (UID: "2ddf0b8e-432a-49c6-a0f5-e738aadaa973"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:58:23.921090 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.920919    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-kube-api-access-mnt6t" (OuterVolumeSpecName: "kube-api-access-mnt6t") pod "2ddf0b8e-432a-49c6-a0f5-e738aadaa973" (UID: "2ddf0b8e-432a-49c6-a0f5-e738aadaa973"). InnerVolumeSpecName "kube-api-access-mnt6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:58:23.921450 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.921425    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-token" (OuterVolumeSpecName: "istio-token") pod "2ddf0b8e-432a-49c6-a0f5-e738aadaa973" (UID: "2ddf0b8e-432a-49c6-a0f5-e738aadaa973"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:58:23.921521 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.921469    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "2ddf0b8e-432a-49c6-a0f5-e738aadaa973" (UID: "2ddf0b8e-432a-49c6-a0f5-e738aadaa973"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:58:23.921521 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:23.921473    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-local-certs" (OuterVolumeSpecName: "local-certs") pod "2ddf0b8e-432a-49c6-a0f5-e738aadaa973" (UID: "2ddf0b8e-432a-49c6-a0f5-e738aadaa973"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:58:24.018126 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:24.018096    2562 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-cacerts\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:58:24.018126 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:24.018124    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-token\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:58:24.018380 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:24.018137    2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-csr-dns-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:58:24.018380 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:24.018150    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnt6t\" (UniqueName: \"kubernetes.io/projected/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-kube-api-access-mnt6t\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:58:24.018380 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:24.018164    2562 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-local-certs\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:58:24.018380 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:24.018176    2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-csr-ca-configmap\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:58:24.018380 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:24.018186    2562 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ddf0b8e-432a-49c6-a0f5-e738aadaa973-istio-kubeconfig\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:58:24.250991 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:24.250948    2562 generic.go:356] "Generic (PLEG): container finished" podID="2ddf0b8e-432a-49c6-a0f5-e738aadaa973" containerID="8ecd6d2d6d1be7eff56d28d45c9a32abc7bebf1dfaf8b04b011157e65d98128c" exitCode=0
Jul 06 13:58:24.251480 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:24.251006    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"
Jul 06 13:58:24.251480 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:24.251010    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk" event={"ID":"2ddf0b8e-432a-49c6-a0f5-e738aadaa973","Type":"ContainerDied","Data":"8ecd6d2d6d1be7eff56d28d45c9a32abc7bebf1dfaf8b04b011157e65d98128c"}
Jul 06 13:58:24.251480 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:24.251126    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk" event={"ID":"2ddf0b8e-432a-49c6-a0f5-e738aadaa973","Type":"ContainerDied","Data":"5b01670e837109ded6ab3a72e2843758387e4753cd71cd2dec4a80faf0a294b1"}
Jul 06 13:58:24.251480 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:24.251155    2562 scope.go:117] "RemoveContainer" containerID="8ecd6d2d6d1be7eff56d28d45c9a32abc7bebf1dfaf8b04b011157e65d98128c"
Jul 06 13:58:24.275584 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:24.275556    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"]
Jul 06 13:58:24.278119 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:24.278097    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jv7sk"]
Jul 06 13:58:24.492144 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:24.492117    2562 scope.go:117] "RemoveContainer" containerID="8ecd6d2d6d1be7eff56d28d45c9a32abc7bebf1dfaf8b04b011157e65d98128c"
Jul 06 13:58:24.492508 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:58:24.492487    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ecd6d2d6d1be7eff56d28d45c9a32abc7bebf1dfaf8b04b011157e65d98128c\": container with ID starting with 8ecd6d2d6d1be7eff56d28d45c9a32abc7bebf1dfaf8b04b011157e65d98128c not found: ID does not exist" containerID="8ecd6d2d6d1be7eff56d28d45c9a32abc7bebf1dfaf8b04b011157e65d98128c"
Jul 06 13:58:24.492580 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:24.492520    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ecd6d2d6d1be7eff56d28d45c9a32abc7bebf1dfaf8b04b011157e65d98128c"} err="failed to get container status \"8ecd6d2d6d1be7eff56d28d45c9a32abc7bebf1dfaf8b04b011157e65d98128c\": rpc error: code = NotFound desc = could not find container \"8ecd6d2d6d1be7eff56d28d45c9a32abc7bebf1dfaf8b04b011157e65d98128c\": container with ID starting with 8ecd6d2d6d1be7eff56d28d45c9a32abc7bebf1dfaf8b04b011157e65d98128c not found: ID does not exist"
Jul 06 13:58:25.259246 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:25.259204    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zdjkc" event={"ID":"4f18de81-e9cd-40b6-8454-ec576c220cf0","Type":"ContainerStarted","Data":"7f83236584e446632537af2fa6df7adea2a2395d362949091dfcd27683cccada"}
Jul 06 13:58:25.260331 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:25.260162    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zdjkc"
Jul 06 13:58:25.261801 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:25.261772    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8rvn9" event={"ID":"1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff","Type":"ContainerStarted","Data":"b5fb0cbd32ddea3af5ef2434f4862f906d0796d8f55127d60462f12d17d0d157"}
Jul 06 13:58:25.278379 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:25.278339    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zdjkc" podStartSLOduration=2.131749157 podStartE2EDuration="5.278327438s" totalImagesPullingTime="3.146578281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:58:25.277434704 +0000 UTC m=+492.321045738" watchObservedRunningTime="2026-07-06 13:58:25.278327438 +0000 UTC m=+492.321938471"
Jul 06 13:58:25.296104 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:25.296063    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8rvn9" podStartSLOduration=2.125312516 podStartE2EDuration="5.296050217s" totalImagesPullingTime="3.170737701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:58:25.295355159 +0000 UTC m=+492.338966224" watchObservedRunningTime="2026-07-06 13:58:25.296050217 +0000 UTC m=+492.339661251"
Jul 06 13:58:25.476223 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:25.476189    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ddf0b8e-432a-49c6-a0f5-e738aadaa973" path="/var/lib/kubelet/pods/2ddf0b8e-432a-49c6-a0f5-e738aadaa973/volumes"
Jul 06 13:58:26.265824 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:26.265795    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8rvn9"
Jul 06 13:58:28.219880 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:28.219835    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-bl2ks"
Jul 06 13:58:28.222871 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:28.222820    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-qzt79"
Jul 06 13:58:50.002611 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:50.002574    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:57.271376 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:57.271344    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zdjkc"
Jul 06 13:58:57.274593 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:57.274572    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8rvn9"
Jul 06 13:58:58.980361 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:58.980319    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:58:59.090208 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:58:59.090179    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:01.193766 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.193731    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:01.288943 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.288913    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:01.310964 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.310933    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m4f72"]
Jul 06 13:59:01.311255 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.311239    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ddf0b8e-432a-49c6-a0f5-e738aadaa973" containerName="discovery"
Jul 06 13:59:01.311356 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.311257    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ddf0b8e-432a-49c6-a0f5-e738aadaa973" containerName="discovery"
Jul 06 13:59:01.311413 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.311363    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ddf0b8e-432a-49c6-a0f5-e738aadaa973" containerName="discovery"
Jul 06 13:59:01.325262 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.325236    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m4f72"
Jul 06 13:59:01.328268 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.328103    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-sc5m6\""
Jul 06 13:59:01.328422 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.328407    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 13:59:01.328733 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.328708    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 13:59:01.329796 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.329773    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m4f72"]
Jul 06 13:59:01.369790 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.369761    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:01.394162 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.394138    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vkpp\" (UniqueName: \"kubernetes.io/projected/5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc-kube-api-access-6vkpp\") pod \"kuadrant-operator-catalog-m4f72\" (UID: \"5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc\") " pod="kuadrant-system/kuadrant-operator-catalog-m4f72"
Jul 06 13:59:01.495224 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.495198    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vkpp\" (UniqueName: \"kubernetes.io/projected/5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc-kube-api-access-6vkpp\") pod \"kuadrant-operator-catalog-m4f72\" (UID: \"5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc\") " pod="kuadrant-system/kuadrant-operator-catalog-m4f72"
Jul 06 13:59:01.503916 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.503885    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vkpp\" (UniqueName: \"kubernetes.io/projected/5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc-kube-api-access-6vkpp\") pod \"kuadrant-operator-catalog-m4f72\" (UID: \"5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc\") " pod="kuadrant-system/kuadrant-operator-catalog-m4f72"
Jul 06 13:59:01.638036 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.638008    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m4f72"
Jul 06 13:59:01.675719 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.675688    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m4f72"]
Jul 06 13:59:01.761787 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.761714    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m4f72"]
Jul 06 13:59:01.764644 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:59:01.764616    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac1cf2e_fd24_4d1f_8a8c_e4343bf672fc.slice/crio-0ee01378b8f52201720d4834e2b7189421ec93ca2b87efc4335db838517e3520 WatchSource:0}: Error finding container 0ee01378b8f52201720d4834e2b7189421ec93ca2b87efc4335db838517e3520: Status 404 returned error can't find the container with id 0ee01378b8f52201720d4834e2b7189421ec93ca2b87efc4335db838517e3520
Jul 06 13:59:01.886398 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.886374    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xk76l"]
Jul 06 13:59:01.890852 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.890836    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xk76l"
Jul 06 13:59:01.897782 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.897751    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xk76l"]
Jul 06 13:59:01.998703 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:01.998675    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcbs5\" (UniqueName: \"kubernetes.io/projected/465e1166-e467-4fe1-84af-5c879ce2d745-kube-api-access-vcbs5\") pod \"kuadrant-operator-catalog-xk76l\" (UID: \"465e1166-e467-4fe1-84af-5c879ce2d745\") " pod="kuadrant-system/kuadrant-operator-catalog-xk76l"
Jul 06 13:59:02.099374 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:02.099304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcbs5\" (UniqueName: \"kubernetes.io/projected/465e1166-e467-4fe1-84af-5c879ce2d745-kube-api-access-vcbs5\") pod \"kuadrant-operator-catalog-xk76l\" (UID: \"465e1166-e467-4fe1-84af-5c879ce2d745\") " pod="kuadrant-system/kuadrant-operator-catalog-xk76l"
Jul 06 13:59:02.107154 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:02.107135    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcbs5\" (UniqueName: \"kubernetes.io/projected/465e1166-e467-4fe1-84af-5c879ce2d745-kube-api-access-vcbs5\") pod \"kuadrant-operator-catalog-xk76l\" (UID: \"465e1166-e467-4fe1-84af-5c879ce2d745\") " pod="kuadrant-system/kuadrant-operator-catalog-xk76l"
Jul 06 13:59:02.200247 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:02.200220    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xk76l"
Jul 06 13:59:02.328754 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:02.328729    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xk76l"]
Jul 06 13:59:02.350145 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:59:02.350085    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465e1166_e467_4fe1_84af_5c879ce2d745.slice/crio-cae3710f55ca7a5346c5a97a87c692102d8e7ed44ae86139f10f6b211d40eff3 WatchSource:0}: Error finding container cae3710f55ca7a5346c5a97a87c692102d8e7ed44ae86139f10f6b211d40eff3: Status 404 returned error can't find the container with id cae3710f55ca7a5346c5a97a87c692102d8e7ed44ae86139f10f6b211d40eff3
Jul 06 13:59:02.405748 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:02.405717    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xk76l" event={"ID":"465e1166-e467-4fe1-84af-5c879ce2d745","Type":"ContainerStarted","Data":"cae3710f55ca7a5346c5a97a87c692102d8e7ed44ae86139f10f6b211d40eff3"}
Jul 06 13:59:02.406794 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:02.406770    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m4f72" event={"ID":"5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc","Type":"ContainerStarted","Data":"0ee01378b8f52201720d4834e2b7189421ec93ca2b87efc4335db838517e3520"}
Jul 06 13:59:04.421053 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:04.421019    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m4f72" event={"ID":"5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc","Type":"ContainerStarted","Data":"5e690c286ac6af721212a7dace1cfab1e413f75162b6661560136ad2ec033ce6"}
Jul 06 13:59:04.421532 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:04.421052    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-m4f72" podUID="5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc" containerName="registry-server" containerID="cri-o://5e690c286ac6af721212a7dace1cfab1e413f75162b6661560136ad2ec033ce6" gracePeriod=2
Jul 06 13:59:04.422571 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:04.422549    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xk76l" event={"ID":"465e1166-e467-4fe1-84af-5c879ce2d745","Type":"ContainerStarted","Data":"605b83fdad1b6a0a20ad6ee8b7e755e0a665668934bbf3e994a45f9b15370098"}
Jul 06 13:59:04.439231 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:04.439184    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-m4f72" podStartSLOduration=1.353809193 podStartE2EDuration="3.439168449s" totalImagesPullingTime="2.085359256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:59:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:59:04.43869039 +0000 UTC m=+531.482301424" watchObservedRunningTime="2026-07-06 13:59:04.439168449 +0000 UTC m=+531.482779488"
Jul 06 13:59:04.455690 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:04.455654    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xk76l" podStartSLOduration=1.95331076 podStartE2EDuration="3.455641877s" totalImagesPullingTime="1.502331117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:59:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:59:04.454922182 +0000 UTC m=+531.498533243" watchObservedRunningTime="2026-07-06 13:59:04.455641877 +0000 UTC m=+531.499252910"
Jul 06 13:59:04.659768 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:04.659745    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m4f72"
Jul 06 13:59:04.718422 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:04.718400    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vkpp\" (UniqueName: \"kubernetes.io/projected/5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc-kube-api-access-6vkpp\") pod \"5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc\" (UID: \"5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc\") "
Jul 06 13:59:04.720409 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:04.720382    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc-kube-api-access-6vkpp" (OuterVolumeSpecName: "kube-api-access-6vkpp") pod "5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc" (UID: "5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc"). InnerVolumeSpecName "kube-api-access-6vkpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:59:04.819609 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:04.819588    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vkpp\" (UniqueName: \"kubernetes.io/projected/5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc-kube-api-access-6vkpp\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:59:05.427358 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:05.427322    2562 generic.go:356] "Generic (PLEG): container finished" podID="5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc" containerID="5e690c286ac6af721212a7dace1cfab1e413f75162b6661560136ad2ec033ce6" exitCode=0
Jul 06 13:59:05.427814 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:05.427369    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m4f72"
Jul 06 13:59:05.427814 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:05.427415    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m4f72" event={"ID":"5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc","Type":"ContainerDied","Data":"5e690c286ac6af721212a7dace1cfab1e413f75162b6661560136ad2ec033ce6"}
Jul 06 13:59:05.427814 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:05.427474    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m4f72" event={"ID":"5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc","Type":"ContainerDied","Data":"0ee01378b8f52201720d4834e2b7189421ec93ca2b87efc4335db838517e3520"}
Jul 06 13:59:05.427814 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:05.427507    2562 scope.go:117] "RemoveContainer" containerID="5e690c286ac6af721212a7dace1cfab1e413f75162b6661560136ad2ec033ce6"
Jul 06 13:59:05.435653 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:05.435636    2562 scope.go:117] "RemoveContainer" containerID="5e690c286ac6af721212a7dace1cfab1e413f75162b6661560136ad2ec033ce6"
Jul 06 13:59:05.435889 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:59:05.435871    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e690c286ac6af721212a7dace1cfab1e413f75162b6661560136ad2ec033ce6\": container with ID starting with 5e690c286ac6af721212a7dace1cfab1e413f75162b6661560136ad2ec033ce6 not found: ID does not exist" containerID="5e690c286ac6af721212a7dace1cfab1e413f75162b6661560136ad2ec033ce6"
Jul 06 13:59:05.435952 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:05.435897    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e690c286ac6af721212a7dace1cfab1e413f75162b6661560136ad2ec033ce6"} err="failed to get container status \"5e690c286ac6af721212a7dace1cfab1e413f75162b6661560136ad2ec033ce6\": rpc error: code = NotFound desc = could not find container \"5e690c286ac6af721212a7dace1cfab1e413f75162b6661560136ad2ec033ce6\": container with ID starting with 5e690c286ac6af721212a7dace1cfab1e413f75162b6661560136ad2ec033ce6 not found: ID does not exist"
Jul 06 13:59:05.446827 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:05.446807    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m4f72"]
Jul 06 13:59:05.450577 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:05.450559    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m4f72"]
Jul 06 13:59:05.477553 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:05.477535    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc" path="/var/lib/kubelet/pods/5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc/volumes"
Jul 06 13:59:12.200826 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:12.200791    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xk76l"
Jul 06 13:59:12.201236 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:12.200872    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xk76l"
Jul 06 13:59:12.222980 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:12.222955    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xk76l"
Jul 06 13:59:12.482256 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:12.482232    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xk76l"
Jul 06 13:59:24.848014 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:24.847963    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:26.671008 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:26.670976    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:26.807734 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:26.807705    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:26.906973 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:26.906946    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:30.003630 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:30.003600    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:30.612689 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:30.612656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:31.634718 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:31.634682    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:31.737776 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:31.737740    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:34.117052 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:34.117013    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h2n4g"]
Jul 06 13:59:34.117525 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:34.117336    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc" containerName="registry-server"
Jul 06 13:59:34.117525 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:34.117350    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc" containerName="registry-server"
Jul 06 13:59:34.117525 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:34.117428    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac1cf2e-fd24-4d1f-8a8c-e4343bf672fc" containerName="registry-server"
Jul 06 13:59:34.124244 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:34.124220    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h2n4g"
Jul 06 13:59:34.126315 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:34.126294    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-t8tmc\""
Jul 06 13:59:34.130435 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:34.130393    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h2n4g"]
Jul 06 13:59:34.231029 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:34.231001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj7m4\" (UniqueName: \"kubernetes.io/projected/1e0e614a-13c5-481d-b5e7-66a46073d161-kube-api-access-kj7m4\") pod \"authorino-operator-75cc8d5cb7-h2n4g\" (UID: \"1e0e614a-13c5-481d-b5e7-66a46073d161\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h2n4g"
Jul 06 13:59:34.331574 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:34.331545    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj7m4\" (UniqueName: \"kubernetes.io/projected/1e0e614a-13c5-481d-b5e7-66a46073d161-kube-api-access-kj7m4\") pod \"authorino-operator-75cc8d5cb7-h2n4g\" (UID: \"1e0e614a-13c5-481d-b5e7-66a46073d161\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h2n4g"
Jul 06 13:59:34.339561 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:34.339536    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj7m4\" (UniqueName: \"kubernetes.io/projected/1e0e614a-13c5-481d-b5e7-66a46073d161-kube-api-access-kj7m4\") pod \"authorino-operator-75cc8d5cb7-h2n4g\" (UID: \"1e0e614a-13c5-481d-b5e7-66a46073d161\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h2n4g"
Jul 06 13:59:34.436244 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:34.436188    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h2n4g"
Jul 06 13:59:34.610157 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:34.610129    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h2n4g"]
Jul 06 13:59:34.613090 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:59:34.613063    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0e614a_13c5_481d_b5e7_66a46073d161.slice/crio-3faf5f8c1cdf12cee66e579e086ab37d569643c50048250de26a42f75cc405ac WatchSource:0}: Error finding container 3faf5f8c1cdf12cee66e579e086ab37d569643c50048250de26a42f75cc405ac: Status 404 returned error can't find the container with id 3faf5f8c1cdf12cee66e579e086ab37d569643c50048250de26a42f75cc405ac
Jul 06 13:59:35.210883 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:35.210848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:35.557594 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:35.557519    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h2n4g" event={"ID":"1e0e614a-13c5-481d-b5e7-66a46073d161","Type":"ContainerStarted","Data":"3faf5f8c1cdf12cee66e579e086ab37d569643c50048250de26a42f75cc405ac"}
Jul 06 13:59:37.108680 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:37.108645    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"]
Jul 06 13:59:37.111854 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:37.111835    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 13:59:37.113945 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:37.113925    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-h2dg6\""
Jul 06 13:59:37.121355 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:37.121334    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"]
Jul 06 13:59:37.252807 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:37.252786    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77dt7\" (UniqueName: \"kubernetes.io/projected/b50634c3-d212-47c7-b9a1-705b62f08879-kube-api-access-77dt7\") pod \"limitador-operator-controller-manager-859d7b78bd-9r5wn\" (UID: \"b50634c3-d212-47c7-b9a1-705b62f08879\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 13:59:37.358328 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:37.353796    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77dt7\" (UniqueName: \"kubernetes.io/projected/b50634c3-d212-47c7-b9a1-705b62f08879-kube-api-access-77dt7\") pod \"limitador-operator-controller-manager-859d7b78bd-9r5wn\" (UID: \"b50634c3-d212-47c7-b9a1-705b62f08879\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 13:59:37.362031 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:37.361983    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77dt7\" (UniqueName: \"kubernetes.io/projected/b50634c3-d212-47c7-b9a1-705b62f08879-kube-api-access-77dt7\") pod \"limitador-operator-controller-manager-859d7b78bd-9r5wn\" (UID: \"b50634c3-d212-47c7-b9a1-705b62f08879\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 13:59:37.421974 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:37.421949    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 13:59:37.553646 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:37.553614    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"]
Jul 06 13:59:37.557791 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:59:37.557761    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb50634c3_d212_47c7_b9a1_705b62f08879.slice/crio-20752e627c73236cc38fb43298e85cc754f60aeae96e4df08eb4531b4a0147a6 WatchSource:0}: Error finding container 20752e627c73236cc38fb43298e85cc754f60aeae96e4df08eb4531b4a0147a6: Status 404 returned error can't find the container with id 20752e627c73236cc38fb43298e85cc754f60aeae96e4df08eb4531b4a0147a6
Jul 06 13:59:37.568821 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:37.568790    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn" event={"ID":"b50634c3-d212-47c7-b9a1-705b62f08879","Type":"ContainerStarted","Data":"20752e627c73236cc38fb43298e85cc754f60aeae96e4df08eb4531b4a0147a6"}
Jul 06 13:59:37.570168 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:37.570147    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h2n4g" event={"ID":"1e0e614a-13c5-481d-b5e7-66a46073d161","Type":"ContainerStarted","Data":"d9cebc155cfdde90ff89c5d62df50345e0f89e5588e1af3190e8179c4c976202"}
Jul 06 13:59:37.570264 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:37.570248    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h2n4g"
Jul 06 13:59:37.589504 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:37.589464    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h2n4g" podStartSLOduration=1.294564937 podStartE2EDuration="3.589451909s" totalImagesPullingTime="2.294886972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:59:37.587897417 +0000 UTC m=+564.631508451" watchObservedRunningTime="2026-07-06 13:59:37.589451909 +0000 UTC m=+564.633062943"
Jul 06 13:59:37.816443 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:37.816374    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:38.356332 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:38.356277    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:39.579184 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:39.579154    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn" event={"ID":"b50634c3-d212-47c7-b9a1-705b62f08879","Type":"ContainerStarted","Data":"49c524a0d51ca2101aa95945dd23ca071833ac136c3a0d0b3c91a9c258648c3a"}
Jul 06 13:59:39.579645 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:39.579276    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 13:59:39.598251 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:39.598178    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn" podStartSLOduration=1.044407568 podStartE2EDuration="2.598159854s" totalImagesPullingTime="1.553752286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:59:39.597674334 +0000 UTC m=+566.641285368" watchObservedRunningTime="2026-07-06 13:59:39.598159854 +0000 UTC m=+566.641770888"
Jul 06 13:59:39.655587 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:39.655560    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:41.109172 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:41.109144    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"]
Jul 06 13:59:41.112485 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:41.112465    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"
Jul 06 13:59:41.114506 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:41.114488    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-htt89\""
Jul 06 13:59:41.127026 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:41.127006    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"]
Jul 06 13:59:41.180311 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:41.180273    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv7nk\" (UniqueName: \"kubernetes.io/projected/2b90bd4c-6dfa-489e-8dff-a00062b95168-kube-api-access-xv7nk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jsrvx\" (UID: \"2b90bd4c-6dfa-489e-8dff-a00062b95168\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"
Jul 06 13:59:41.180419 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:41.180326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b90bd4c-6dfa-489e-8dff-a00062b95168-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jsrvx\" (UID: \"2b90bd4c-6dfa-489e-8dff-a00062b95168\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"
Jul 06 13:59:41.281169 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:41.281140    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv7nk\" (UniqueName: \"kubernetes.io/projected/2b90bd4c-6dfa-489e-8dff-a00062b95168-kube-api-access-xv7nk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jsrvx\" (UID: \"2b90bd4c-6dfa-489e-8dff-a00062b95168\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"
Jul 06 13:59:41.281265 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:41.281175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b90bd4c-6dfa-489e-8dff-a00062b95168-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jsrvx\" (UID: \"2b90bd4c-6dfa-489e-8dff-a00062b95168\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"
Jul 06 13:59:41.281506 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:41.281491    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b90bd4c-6dfa-489e-8dff-a00062b95168-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jsrvx\" (UID: \"2b90bd4c-6dfa-489e-8dff-a00062b95168\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"
Jul 06 13:59:41.288753 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:41.288731    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv7nk\" (UniqueName: \"kubernetes.io/projected/2b90bd4c-6dfa-489e-8dff-a00062b95168-kube-api-access-xv7nk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jsrvx\" (UID: \"2b90bd4c-6dfa-489e-8dff-a00062b95168\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"
Jul 06 13:59:41.422027 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:41.421976    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"
Jul 06 13:59:41.571991 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:41.571958    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"]
Jul 06 13:59:41.577119 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:59:41.577097    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b90bd4c_6dfa_489e_8dff_a00062b95168.slice/crio-3120a8d63b32f6fba4d2265800031e970dd0139f66d66f466787509773ecaf03 WatchSource:0}: Error finding container 3120a8d63b32f6fba4d2265800031e970dd0139f66d66f466787509773ecaf03: Status 404 returned error can't find the container with id 3120a8d63b32f6fba4d2265800031e970dd0139f66d66f466787509773ecaf03
Jul 06 13:59:41.589616 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:41.589586    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx" event={"ID":"2b90bd4c-6dfa-489e-8dff-a00062b95168","Type":"ContainerStarted","Data":"3120a8d63b32f6fba4d2265800031e970dd0139f66d66f466787509773ecaf03"}
Jul 06 13:59:41.646469 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:41.646443    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:41.843161 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:41.843133    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:44.633037 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:44.633004    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:44.734019 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:44.733983    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:45.010791 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:45.010756    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:45.072601 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:45.072565    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:46.611433 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:46.611406    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx" event={"ID":"2b90bd4c-6dfa-489e-8dff-a00062b95168","Type":"ContainerStarted","Data":"6ed4392b78eb9be6622c0e8191289de23038154561f717d2505272fd28f6f3b8"}
Jul 06 13:59:46.611734 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:46.611538    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"
Jul 06 13:59:46.631798 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:46.631756    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx" podStartSLOduration=0.763194252 podStartE2EDuration="5.631743867s" totalImagesPullingTime="4.868549615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:59:46.630654296 +0000 UTC m=+573.674265327" watchObservedRunningTime="2026-07-06 13:59:46.631743867 +0000 UTC m=+573.675354901"
Jul 06 13:59:48.575844 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:48.575816    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h2n4g"
Jul 06 13:59:48.838888 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:48.838799    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:48.940705 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:48.940673    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:49.340872 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:49.340843    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:49.531941 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:49.531905    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:50.585335 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:50.585307    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 13:59:52.434001 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:52.433963    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:52.533837 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:52.533803    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:54.805803 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:54.805768    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:54.906511 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:54.906476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:57.617576 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:57.617539    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"
Jul 06 13:59:58.681945 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:58.681861    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:58.759904 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:58.759870    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"]
Jul 06 13:59:58.763200 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:58.763182    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"
Jul 06 13:59:58.778326 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:58.778296    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"]
Jul 06 13:59:58.780213 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:58.780190    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 13:59:58.920347 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:58.920312    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbkg2\" (UniqueName: \"kubernetes.io/projected/b3150618-0739-4ee9-8512-94a88513030a-kube-api-access-zbkg2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vjst2\" (UID: \"b3150618-0739-4ee9-8512-94a88513030a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"
Jul 06 13:59:58.920528 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:58.920368    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3150618-0739-4ee9-8512-94a88513030a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vjst2\" (UID: \"b3150618-0739-4ee9-8512-94a88513030a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"
Jul 06 13:59:59.021162 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.021124    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbkg2\" (UniqueName: \"kubernetes.io/projected/b3150618-0739-4ee9-8512-94a88513030a-kube-api-access-zbkg2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vjst2\" (UID: \"b3150618-0739-4ee9-8512-94a88513030a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"
Jul 06 13:59:59.021348 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.021183    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3150618-0739-4ee9-8512-94a88513030a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vjst2\" (UID: \"b3150618-0739-4ee9-8512-94a88513030a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"
Jul 06 13:59:59.021591 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.021571    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3150618-0739-4ee9-8512-94a88513030a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vjst2\" (UID: \"b3150618-0739-4ee9-8512-94a88513030a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"
Jul 06 13:59:59.029492 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.029471    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbkg2\" (UniqueName: \"kubernetes.io/projected/b3150618-0739-4ee9-8512-94a88513030a-kube-api-access-zbkg2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vjst2\" (UID: \"b3150618-0739-4ee9-8512-94a88513030a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"
Jul 06 13:59:59.078477 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.078438    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"
Jul 06 13:59:59.215308 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.215269    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"]
Jul 06 13:59:59.218258 ip-10-0-134-29 kubenswrapper[2562]: W0706 13:59:59.218231    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3150618_0739_4ee9_8512_94a88513030a.slice/crio-e8dea01598d0fdefadded15cdaeb1a6cf53178dd20b13831c9ec9a2c3d3e4c18 WatchSource:0}: Error finding container e8dea01598d0fdefadded15cdaeb1a6cf53178dd20b13831c9ec9a2c3d3e4c18: Status 404 returned error can't find the container with id e8dea01598d0fdefadded15cdaeb1a6cf53178dd20b13831c9ec9a2c3d3e4c18
Jul 06 13:59:59.426144 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.426107    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"]
Jul 06 13:59:59.451468 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.451442    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"]
Jul 06 13:59:59.458495 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.458471    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"]
Jul 06 13:59:59.458677 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.458652    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx" podUID="2b90bd4c-6dfa-489e-8dff-a00062b95168" containerName="manager" containerID="cri-o://6ed4392b78eb9be6622c0e8191289de23038154561f717d2505272fd28f6f3b8" gracePeriod=2
Jul 06 13:59:59.462474 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.462447    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"]
Jul 06 13:59:59.469699 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.469676    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"]
Jul 06 13:59:59.470095 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.470081    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b90bd4c-6dfa-489e-8dff-a00062b95168" containerName="manager"
Jul 06 13:59:59.470132 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.470100    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b90bd4c-6dfa-489e-8dff-a00062b95168" containerName="manager"
Jul 06 13:59:59.470132 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.470113    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3150618-0739-4ee9-8512-94a88513030a" containerName="manager"
Jul 06 13:59:59.470132 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.470123    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3150618-0739-4ee9-8512-94a88513030a" containerName="manager"
Jul 06 13:59:59.470229 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.470214    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3150618-0739-4ee9-8512-94a88513030a" containerName="manager"
Jul 06 13:59:59.470259 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.470228    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b90bd4c-6dfa-489e-8dff-a00062b95168" containerName="manager"
Jul 06 13:59:59.473484 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.473463    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"
Jul 06 13:59:59.475630 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:59:59.475497    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jsrvx\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="2b90bd4c-6dfa-489e-8dff-a00062b95168" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"
Jul 06 13:59:59.480831 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.480810    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"]
Jul 06 13:59:59.481078 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.481017    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn" podUID="b50634c3-d212-47c7-b9a1-705b62f08879" containerName="manager" containerID="cri-o://49c524a0d51ca2101aa95945dd23ca071833ac136c3a0d0b3c91a9c258648c3a" gracePeriod=2
Jul 06 13:59:59.485385 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.485335    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"]
Jul 06 13:59:59.488890 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.488832    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"]
Jul 06 13:59:59.490368 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.490348    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"]
Jul 06 13:59:59.490698 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.490683    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b50634c3-d212-47c7-b9a1-705b62f08879" containerName="manager"
Jul 06 13:59:59.490769 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.490701    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b50634c3-d212-47c7-b9a1-705b62f08879" containerName="manager"
Jul 06 13:59:59.490816 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.490782    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b50634c3-d212-47c7-b9a1-705b62f08879" containerName="manager"
Jul 06 13:59:59.493570 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.493552    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"
Jul 06 13:59:59.510846 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.510821    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"]
Jul 06 13:59:59.529932 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:59:59.529854    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9r5wn\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="b50634c3-d212-47c7-b9a1-705b62f08879" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 13:59:59.627156 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.627115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8thm\" (UniqueName: \"kubernetes.io/projected/07b43f68-04f1-4d72-993b-241128a231db-kube-api-access-x8thm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sn97v\" (UID: \"07b43f68-04f1-4d72-993b-241128a231db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"
Jul 06 13:59:59.627156 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.627163    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/febc1787-35f8-4cad-bce4-c95c8729bd9a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wttch\" (UID: \"febc1787-35f8-4cad-bce4-c95c8729bd9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"
Jul 06 13:59:59.627399 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.627190    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07b43f68-04f1-4d72-993b-241128a231db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sn97v\" (UID: \"07b43f68-04f1-4d72-993b-241128a231db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"
Jul 06 13:59:59.627399 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.627241    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpf6b\" (UniqueName: \"kubernetes.io/projected/febc1787-35f8-4cad-bce4-c95c8729bd9a-kube-api-access-xpf6b\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wttch\" (UID: \"febc1787-35f8-4cad-bce4-c95c8729bd9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"
Jul 06 13:59:59.668088 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.668060    2562 generic.go:356] "Generic (PLEG): container finished" podID="2b90bd4c-6dfa-489e-8dff-a00062b95168" containerID="6ed4392b78eb9be6622c0e8191289de23038154561f717d2505272fd28f6f3b8" exitCode=0
Jul 06 13:59:59.670446 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:59:59.670424    2562 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2" container="manager"
Jul 06 13:59:59.672048 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:59:59.672012    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9r5wn\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="b50634c3-d212-47c7-b9a1-705b62f08879" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 13:59:59.672167 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.672081    2562 generic.go:356] "Generic (PLEG): container finished" podID="b50634c3-d212-47c7-b9a1-705b62f08879" containerID="49c524a0d51ca2101aa95945dd23ca071833ac136c3a0d0b3c91a9c258648c3a" exitCode=0
Jul 06 13:59:59.708466 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.708445    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"
Jul 06 13:59:59.710171 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:59:59.710146    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9r5wn\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="b50634c3-d212-47c7-b9a1-705b62f08879" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 13:59:59.713829 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.713813    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 13:59:59.715535 ip-10-0-134-29 kubenswrapper[2562]: E0706 13:59:59.715514    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9r5wn\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="b50634c3-d212-47c7-b9a1-705b62f08879" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 13:59:59.727916 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.727885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8thm\" (UniqueName: \"kubernetes.io/projected/07b43f68-04f1-4d72-993b-241128a231db-kube-api-access-x8thm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sn97v\" (UID: \"07b43f68-04f1-4d72-993b-241128a231db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"
Jul 06 13:59:59.728031 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.727923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/febc1787-35f8-4cad-bce4-c95c8729bd9a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wttch\" (UID: \"febc1787-35f8-4cad-bce4-c95c8729bd9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"
Jul 06 13:59:59.728031 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.727946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07b43f68-04f1-4d72-993b-241128a231db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sn97v\" (UID: \"07b43f68-04f1-4d72-993b-241128a231db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"
Jul 06 13:59:59.728031 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.727980    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpf6b\" (UniqueName: \"kubernetes.io/projected/febc1787-35f8-4cad-bce4-c95c8729bd9a-kube-api-access-xpf6b\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wttch\" (UID: \"febc1787-35f8-4cad-bce4-c95c8729bd9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"
Jul 06 13:59:59.728418 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.728399    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07b43f68-04f1-4d72-993b-241128a231db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sn97v\" (UID: \"07b43f68-04f1-4d72-993b-241128a231db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"
Jul 06 13:59:59.728505 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.728403    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/febc1787-35f8-4cad-bce4-c95c8729bd9a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wttch\" (UID: \"febc1787-35f8-4cad-bce4-c95c8729bd9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"
Jul 06 13:59:59.735523 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.735500    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpf6b\" (UniqueName: \"kubernetes.io/projected/febc1787-35f8-4cad-bce4-c95c8729bd9a-kube-api-access-xpf6b\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wttch\" (UID: \"febc1787-35f8-4cad-bce4-c95c8729bd9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"
Jul 06 13:59:59.735592 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.735563    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8thm\" (UniqueName: \"kubernetes.io/projected/07b43f68-04f1-4d72-993b-241128a231db-kube-api-access-x8thm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sn97v\" (UID: \"07b43f68-04f1-4d72-993b-241128a231db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"
Jul 06 13:59:59.829123 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.829036    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xv7nk\" (UniqueName: \"kubernetes.io/projected/2b90bd4c-6dfa-489e-8dff-a00062b95168-kube-api-access-xv7nk\") pod \"2b90bd4c-6dfa-489e-8dff-a00062b95168\" (UID: \"2b90bd4c-6dfa-489e-8dff-a00062b95168\") "
Jul 06 13:59:59.829123 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.829088    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b90bd4c-6dfa-489e-8dff-a00062b95168-extensions-socket-volume\") pod \"2b90bd4c-6dfa-489e-8dff-a00062b95168\" (UID: \"2b90bd4c-6dfa-489e-8dff-a00062b95168\") "
Jul 06 13:59:59.829343 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.829139    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77dt7\" (UniqueName: \"kubernetes.io/projected/b50634c3-d212-47c7-b9a1-705b62f08879-kube-api-access-77dt7\") pod \"b50634c3-d212-47c7-b9a1-705b62f08879\" (UID: \"b50634c3-d212-47c7-b9a1-705b62f08879\") "
Jul 06 13:59:59.829611 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.829583    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b90bd4c-6dfa-489e-8dff-a00062b95168-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2b90bd4c-6dfa-489e-8dff-a00062b95168" (UID: "2b90bd4c-6dfa-489e-8dff-a00062b95168"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:59:59.831139 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.831115    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b50634c3-d212-47c7-b9a1-705b62f08879-kube-api-access-77dt7" (OuterVolumeSpecName: "kube-api-access-77dt7") pod "b50634c3-d212-47c7-b9a1-705b62f08879" (UID: "b50634c3-d212-47c7-b9a1-705b62f08879"). InnerVolumeSpecName "kube-api-access-77dt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:59:59.831212 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.831124    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b90bd4c-6dfa-489e-8dff-a00062b95168-kube-api-access-xv7nk" (OuterVolumeSpecName: "kube-api-access-xv7nk") pod "2b90bd4c-6dfa-489e-8dff-a00062b95168" (UID: "2b90bd4c-6dfa-489e-8dff-a00062b95168"). InnerVolumeSpecName "kube-api-access-xv7nk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:59:59.857267 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.857234    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"
Jul 06 13:59:59.862227 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.862209    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"
Jul 06 13:59:59.930462 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.930428    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xv7nk\" (UniqueName: \"kubernetes.io/projected/2b90bd4c-6dfa-489e-8dff-a00062b95168-kube-api-access-xv7nk\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:59:59.930462 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.930463    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b90bd4c-6dfa-489e-8dff-a00062b95168-extensions-socket-volume\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 13:59:59.930656 ip-10-0-134-29 kubenswrapper[2562]: I0706 13:59:59.930479    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77dt7\" (UniqueName: \"kubernetes.io/projected/b50634c3-d212-47c7-b9a1-705b62f08879-kube-api-access-77dt7\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:00:00.014853 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:00.014828    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"]
Jul 06 14:00:00.019517 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:00:00.019488    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b43f68_04f1_4d72_993b_241128a231db.slice/crio-62577c17ebd4cec02035e8453e4ab07b638c88d481f1efba2437bde0df4ca864 WatchSource:0}: Error finding container 62577c17ebd4cec02035e8453e4ab07b638c88d481f1efba2437bde0df4ca864: Status 404 returned error can't find the container with id 62577c17ebd4cec02035e8453e4ab07b638c88d481f1efba2437bde0df4ca864
Jul 06 14:00:00.022508 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:00.022489    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"]
Jul 06 14:00:00.025437 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:00:00.025397    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfebc1787_35f8_4cad_bce4_c95c8729bd9a.slice/crio-363d0e8e1a72bdac5784cd66e0d65b46b2483a8e5c5be2c18de48285bd02b327 WatchSource:0}: Error finding container 363d0e8e1a72bdac5784cd66e0d65b46b2483a8e5c5be2c18de48285bd02b327: Status 404 returned error can't find the container with id 363d0e8e1a72bdac5784cd66e0d65b46b2483a8e5c5be2c18de48285bd02b327
Jul 06 14:00:00.683712 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:00.683262    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2" podUID="b3150618-0739-4ee9-8512-94a88513030a" containerName="manager" containerID="cri-o://677ff23d57dc65c17a82180f52e3f4728b0cfc2aa1dc4ef7013088c675b9ca21" gracePeriod=2
Jul 06 14:00:00.686231 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:00.685507    2562 scope.go:117] "RemoveContainer" containerID="49c524a0d51ca2101aa95945dd23ca071833ac136c3a0d0b3c91a9c258648c3a"
Jul 06 14:00:00.686231 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:00.685676    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 14:00:00.687019 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:00:00.686954    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vjst2\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="b3150618-0739-4ee9-8512-94a88513030a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"
Jul 06 14:00:00.688802 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:00:00.688706    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9r5wn\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="b50634c3-d212-47c7-b9a1-705b62f08879" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 14:00:00.689784 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:00.689459    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v" event={"ID":"07b43f68-04f1-4d72-993b-241128a231db","Type":"ContainerStarted","Data":"da3279feccee8dcbcc4993f6da5e1c1c3a5db2e76319766769cd1d38f377d9c5"}
Jul 06 14:00:00.689784 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:00.689541    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v" event={"ID":"07b43f68-04f1-4d72-993b-241128a231db","Type":"ContainerStarted","Data":"62577c17ebd4cec02035e8453e4ab07b638c88d481f1efba2437bde0df4ca864"}
Jul 06 14:00:00.689784 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:00.689573    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"
Jul 06 14:00:00.690907 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:00:00.690806    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9r5wn\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="b50634c3-d212-47c7-b9a1-705b62f08879" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 14:00:00.691462 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:00.691430    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch" event={"ID":"febc1787-35f8-4cad-bce4-c95c8729bd9a","Type":"ContainerStarted","Data":"70ce325409f5b1aad029efa0553e58bddb65ed49baba2eb2c82daa0bfe6cf703"}
Jul 06 14:00:00.691571 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:00.691479    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"
Jul 06 14:00:00.691571 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:00.691503    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch" event={"ID":"febc1787-35f8-4cad-bce4-c95c8729bd9a","Type":"ContainerStarted","Data":"363d0e8e1a72bdac5784cd66e0d65b46b2483a8e5c5be2c18de48285bd02b327"}
Jul 06 14:00:00.692591 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:00:00.692569    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vjst2\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="b3150618-0739-4ee9-8512-94a88513030a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"
Jul 06 14:00:00.693465 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:00.693444    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsrvx"
Jul 06 14:00:00.694360 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:00:00.694337    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vjst2\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="b3150618-0739-4ee9-8512-94a88513030a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"
Jul 06 14:00:00.695969 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:00:00.695943    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9r5wn\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="b50634c3-d212-47c7-b9a1-705b62f08879" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 14:00:00.698465 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:00.698448    2562 scope.go:117] "RemoveContainer" containerID="6ed4392b78eb9be6622c0e8191289de23038154561f717d2505272fd28f6f3b8"
Jul 06 14:00:00.734703 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:00.734664    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v" podStartSLOduration=1.73465156 podStartE2EDuration="1.73465156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:59:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:00:00.732578998 +0000 UTC m=+587.776190054" watchObservedRunningTime="2026-07-06 14:00:00.73465156 +0000 UTC m=+587.778262593"
Jul 06 14:00:00.765770 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:00:00.765740    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9r5wn\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="b50634c3-d212-47c7-b9a1-705b62f08879" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 14:00:00.766575 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:00.766535    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch" podStartSLOduration=1.766518868 podStartE2EDuration="1.766518868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:59:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:00:00.763672768 +0000 UTC m=+587.807283801" watchObservedRunningTime="2026-07-06 14:00:00.766518868 +0000 UTC m=+587.810129906"
Jul 06 14:00:00.767804 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:00:00.767779    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vjst2\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="b3150618-0739-4ee9-8512-94a88513030a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"
Jul 06 14:00:00.925222 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:00.925192    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"
Jul 06 14:00:00.926982 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:00:00.926956    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9r5wn\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="b50634c3-d212-47c7-b9a1-705b62f08879" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r5wn"
Jul 06 14:00:00.928405 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:00:00.928378    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vjst2\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="b3150618-0739-4ee9-8512-94a88513030a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"
Jul 06 14:00:01.038688 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:01.038660    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3150618-0739-4ee9-8512-94a88513030a-extensions-socket-volume\") pod \"b3150618-0739-4ee9-8512-94a88513030a\" (UID: \"b3150618-0739-4ee9-8512-94a88513030a\") "
Jul 06 14:00:01.038819 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:01.038713    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbkg2\" (UniqueName: \"kubernetes.io/projected/b3150618-0739-4ee9-8512-94a88513030a-kube-api-access-zbkg2\") pod \"b3150618-0739-4ee9-8512-94a88513030a\" (UID: \"b3150618-0739-4ee9-8512-94a88513030a\") "
Jul 06 14:00:01.038894 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:01.038872    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3150618-0739-4ee9-8512-94a88513030a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b3150618-0739-4ee9-8512-94a88513030a" (UID: "b3150618-0739-4ee9-8512-94a88513030a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:00:01.040775 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:01.040755    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3150618-0739-4ee9-8512-94a88513030a-kube-api-access-zbkg2" (OuterVolumeSpecName: "kube-api-access-zbkg2") pod "b3150618-0739-4ee9-8512-94a88513030a" (UID: "b3150618-0739-4ee9-8512-94a88513030a"). InnerVolumeSpecName "kube-api-access-zbkg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:00:01.139474 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:01.139448    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3150618-0739-4ee9-8512-94a88513030a-extensions-socket-volume\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:00:01.139474 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:01.139469    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbkg2\" (UniqueName: \"kubernetes.io/projected/b3150618-0739-4ee9-8512-94a88513030a-kube-api-access-zbkg2\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:00:01.477325 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:01.477270    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b90bd4c-6dfa-489e-8dff-a00062b95168" path="/var/lib/kubelet/pods/2b90bd4c-6dfa-489e-8dff-a00062b95168/volumes"
Jul 06 14:00:01.477764 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:01.477742    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3150618-0739-4ee9-8512-94a88513030a" path="/var/lib/kubelet/pods/b3150618-0739-4ee9-8512-94a88513030a/volumes"
Jul 06 14:00:01.478098 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:01.478080    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b50634c3-d212-47c7-b9a1-705b62f08879" path="/var/lib/kubelet/pods/b50634c3-d212-47c7-b9a1-705b62f08879/volumes"
Jul 06 14:00:01.698563 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:01.698540    2562 generic.go:356] "Generic (PLEG): container finished" podID="b3150618-0739-4ee9-8512-94a88513030a" containerID="677ff23d57dc65c17a82180f52e3f4728b0cfc2aa1dc4ef7013088c675b9ca21" exitCode=2
Jul 06 14:00:01.698674 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:01.698581    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"
Jul 06 14:00:01.698674 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:01.698627    2562 scope.go:117] "RemoveContainer" containerID="677ff23d57dc65c17a82180f52e3f4728b0cfc2aa1dc4ef7013088c675b9ca21"
Jul 06 14:00:01.702690 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:00:01.702668    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vjst2\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="b3150618-0739-4ee9-8512-94a88513030a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"
Jul 06 14:00:01.706354 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:01.706336    2562 scope.go:117] "RemoveContainer" containerID="677ff23d57dc65c17a82180f52e3f4728b0cfc2aa1dc4ef7013088c675b9ca21"
Jul 06 14:00:01.706588 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:00:01.706571    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"677ff23d57dc65c17a82180f52e3f4728b0cfc2aa1dc4ef7013088c675b9ca21\": container with ID starting with 677ff23d57dc65c17a82180f52e3f4728b0cfc2aa1dc4ef7013088c675b9ca21 not found: ID does not exist" containerID="677ff23d57dc65c17a82180f52e3f4728b0cfc2aa1dc4ef7013088c675b9ca21"
Jul 06 14:00:01.706653 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:01.706595    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"677ff23d57dc65c17a82180f52e3f4728b0cfc2aa1dc4ef7013088c675b9ca21"} err="failed to get container status \"677ff23d57dc65c17a82180f52e3f4728b0cfc2aa1dc4ef7013088c675b9ca21\": rpc error: code = NotFound desc = could not find container \"677ff23d57dc65c17a82180f52e3f4728b0cfc2aa1dc4ef7013088c675b9ca21\": container with ID starting with 677ff23d57dc65c17a82180f52e3f4728b0cfc2aa1dc4ef7013088c675b9ca21 not found: ID does not exist"
Jul 06 14:00:03.474630 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:00:03.474581    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vjst2\" is forbidden: User \"system:node:ip-10-0-134-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-29.ec2.internal' and this object" podUID="b3150618-0739-4ee9-8512-94a88513030a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vjst2"
Jul 06 14:00:04.290894 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:04.290859    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:04.513419 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:04.513376    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:04.891576 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:04.891540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:04.987149 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:04.987114    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:05.470901 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:05.470862    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:05.710722 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:05.710691    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:08.300040 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:08.300009    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:08.407057 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:08.407028    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:11.694251 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:11.694221    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:11.702583 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:11.702558    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"
Jul 06 14:00:11.702704 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:11.702622    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"
Jul 06 14:00:11.782524 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:11.782498    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"]
Jul 06 14:00:11.782715 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:11.782693    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v" podUID="07b43f68-04f1-4d72-993b-241128a231db" containerName="manager" containerID="cri-o://da3279feccee8dcbcc4993f6da5e1c1c3a5db2e76319766769cd1d38f377d9c5" gracePeriod=10
Jul 06 14:00:12.023466 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.023443    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"
Jul 06 14:00:12.037699 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.037673    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:12.076256 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.076235    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"]
Jul 06 14:00:12.076603 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.076589    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07b43f68-04f1-4d72-993b-241128a231db" containerName="manager"
Jul 06 14:00:12.076644 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.076605    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="07b43f68-04f1-4d72-993b-241128a231db" containerName="manager"
Jul 06 14:00:12.076677 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.076661    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="07b43f68-04f1-4d72-993b-241128a231db" containerName="manager"
Jul 06 14:00:12.079136 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.079122    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"
Jul 06 14:00:12.091458 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.091438    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"]
Jul 06 14:00:12.121827 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.121801    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lfwnx\" (UID: \"ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"
Jul 06 14:00:12.121919 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.121839    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjnlw\" (UniqueName: \"kubernetes.io/projected/ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c-kube-api-access-fjnlw\") pod \"kuadrant-operator-controller-manager-86878c769f-lfwnx\" (UID: \"ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"
Jul 06 14:00:12.222181 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.222156    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8thm\" (UniqueName: \"kubernetes.io/projected/07b43f68-04f1-4d72-993b-241128a231db-kube-api-access-x8thm\") pod \"07b43f68-04f1-4d72-993b-241128a231db\" (UID: \"07b43f68-04f1-4d72-993b-241128a231db\") "
Jul 06 14:00:12.222317 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.222183    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07b43f68-04f1-4d72-993b-241128a231db-extensions-socket-volume\") pod \"07b43f68-04f1-4d72-993b-241128a231db\" (UID: \"07b43f68-04f1-4d72-993b-241128a231db\") "
Jul 06 14:00:12.222317 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.222301    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lfwnx\" (UID: \"ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"
Jul 06 14:00:12.222441 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.222393    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjnlw\" (UniqueName: \"kubernetes.io/projected/ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c-kube-api-access-fjnlw\") pod \"kuadrant-operator-controller-manager-86878c769f-lfwnx\" (UID: \"ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"
Jul 06 14:00:12.222617 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.222593    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07b43f68-04f1-4d72-993b-241128a231db-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "07b43f68-04f1-4d72-993b-241128a231db" (UID: "07b43f68-04f1-4d72-993b-241128a231db"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:00:12.222667 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.222629    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lfwnx\" (UID: \"ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"
Jul 06 14:00:12.224016 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.223996    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07b43f68-04f1-4d72-993b-241128a231db-kube-api-access-x8thm" (OuterVolumeSpecName: "kube-api-access-x8thm") pod "07b43f68-04f1-4d72-993b-241128a231db" (UID: "07b43f68-04f1-4d72-993b-241128a231db"). InnerVolumeSpecName "kube-api-access-x8thm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:00:12.235173 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.235154    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjnlw\" (UniqueName: \"kubernetes.io/projected/ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c-kube-api-access-fjnlw\") pod \"kuadrant-operator-controller-manager-86878c769f-lfwnx\" (UID: \"ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"
Jul 06 14:00:12.323451 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.323429    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8thm\" (UniqueName: \"kubernetes.io/projected/07b43f68-04f1-4d72-993b-241128a231db-kube-api-access-x8thm\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:00:12.323451 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.323448    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07b43f68-04f1-4d72-993b-241128a231db-extensions-socket-volume\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:00:12.388567 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.388544    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"
Jul 06 14:00:12.516664 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.516643    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"]
Jul 06 14:00:12.519090 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:00:12.519060    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6d9a7c_ea1d_484e_a672_ca2a281b9f3c.slice/crio-909ed4099f7fd93a73e0112980900919e27bd4753f9e1ab136aaeebcf25428f9 WatchSource:0}: Error finding container 909ed4099f7fd93a73e0112980900919e27bd4753f9e1ab136aaeebcf25428f9: Status 404 returned error can't find the container with id 909ed4099f7fd93a73e0112980900919e27bd4753f9e1ab136aaeebcf25428f9
Jul 06 14:00:12.751126 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.751095    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx" event={"ID":"ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c","Type":"ContainerStarted","Data":"fdc04d07360fae9484a0f2688335cde496cac94965590116c1d2a5090f0378b3"}
Jul 06 14:00:12.751543 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.751254    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"
Jul 06 14:00:12.751543 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.751304    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx" event={"ID":"ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c","Type":"ContainerStarted","Data":"909ed4099f7fd93a73e0112980900919e27bd4753f9e1ab136aaeebcf25428f9"}
Jul 06 14:00:12.752395 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.752371    2562 generic.go:356] "Generic (PLEG): container finished" podID="07b43f68-04f1-4d72-993b-241128a231db" containerID="da3279feccee8dcbcc4993f6da5e1c1c3a5db2e76319766769cd1d38f377d9c5" exitCode=0
Jul 06 14:00:12.752487 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.752415    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"
Jul 06 14:00:12.752487 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.752442    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v" event={"ID":"07b43f68-04f1-4d72-993b-241128a231db","Type":"ContainerDied","Data":"da3279feccee8dcbcc4993f6da5e1c1c3a5db2e76319766769cd1d38f377d9c5"}
Jul 06 14:00:12.752487 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.752484    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v" event={"ID":"07b43f68-04f1-4d72-993b-241128a231db","Type":"ContainerDied","Data":"62577c17ebd4cec02035e8453e4ab07b638c88d481f1efba2437bde0df4ca864"}
Jul 06 14:00:12.752585 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.752513    2562 scope.go:117] "RemoveContainer" containerID="da3279feccee8dcbcc4993f6da5e1c1c3a5db2e76319766769cd1d38f377d9c5"
Jul 06 14:00:12.761175 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.761155    2562 scope.go:117] "RemoveContainer" containerID="da3279feccee8dcbcc4993f6da5e1c1c3a5db2e76319766769cd1d38f377d9c5"
Jul 06 14:00:12.761436 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:00:12.761417    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da3279feccee8dcbcc4993f6da5e1c1c3a5db2e76319766769cd1d38f377d9c5\": container with ID starting with da3279feccee8dcbcc4993f6da5e1c1c3a5db2e76319766769cd1d38f377d9c5 not found: ID does not exist" containerID="da3279feccee8dcbcc4993f6da5e1c1c3a5db2e76319766769cd1d38f377d9c5"
Jul 06 14:00:12.761502 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.761445    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da3279feccee8dcbcc4993f6da5e1c1c3a5db2e76319766769cd1d38f377d9c5"} err="failed to get container status \"da3279feccee8dcbcc4993f6da5e1c1c3a5db2e76319766769cd1d38f377d9c5\": rpc error: code = NotFound desc = could not find container \"da3279feccee8dcbcc4993f6da5e1c1c3a5db2e76319766769cd1d38f377d9c5\": container with ID starting with da3279feccee8dcbcc4993f6da5e1c1c3a5db2e76319766769cd1d38f377d9c5 not found: ID does not exist"
Jul 06 14:00:12.770797 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.770726    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx" podStartSLOduration=0.770714899 podStartE2EDuration="770.714899ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:00:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:00:12.768573156 +0000 UTC m=+599.812184190" watchObservedRunningTime="2026-07-06 14:00:12.770714899 +0000 UTC m=+599.814325934"
Jul 06 14:00:12.785884 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.785861    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"]
Jul 06 14:00:12.794591 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:12.794573    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sn97v"]
Jul 06 14:00:13.404212 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:13.404184    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 14:00:13.409939 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:13.409912    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 14:00:13.480123 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:13.480101    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07b43f68-04f1-4d72-993b-241128a231db" path="/var/lib/kubelet/pods/07b43f68-04f1-4d72-993b-241128a231db/volumes"
Jul 06 14:00:15.621756 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:15.621710    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:19.890610 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:19.890570    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:19.990935 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:19.990903    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:23.759518 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:23.759491    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"
Jul 06 14:00:23.810890 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:23.810860    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"]
Jul 06 14:00:23.811094 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:23.811071    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch" podUID="febc1787-35f8-4cad-bce4-c95c8729bd9a" containerName="manager" containerID="cri-o://70ce325409f5b1aad029efa0553e58bddb65ed49baba2eb2c82daa0bfe6cf703" gracePeriod=10
Jul 06 14:00:24.055859 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:24.055831    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"
Jul 06 14:00:24.104972 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:24.104934    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpf6b\" (UniqueName: \"kubernetes.io/projected/febc1787-35f8-4cad-bce4-c95c8729bd9a-kube-api-access-xpf6b\") pod \"febc1787-35f8-4cad-bce4-c95c8729bd9a\" (UID: \"febc1787-35f8-4cad-bce4-c95c8729bd9a\") "
Jul 06 14:00:24.105097 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:24.105000    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/febc1787-35f8-4cad-bce4-c95c8729bd9a-extensions-socket-volume\") pod \"febc1787-35f8-4cad-bce4-c95c8729bd9a\" (UID: \"febc1787-35f8-4cad-bce4-c95c8729bd9a\") "
Jul 06 14:00:24.105397 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:24.105374    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/febc1787-35f8-4cad-bce4-c95c8729bd9a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "febc1787-35f8-4cad-bce4-c95c8729bd9a" (UID: "febc1787-35f8-4cad-bce4-c95c8729bd9a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:00:24.106908 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:24.106888    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/febc1787-35f8-4cad-bce4-c95c8729bd9a-kube-api-access-xpf6b" (OuterVolumeSpecName: "kube-api-access-xpf6b") pod "febc1787-35f8-4cad-bce4-c95c8729bd9a" (UID: "febc1787-35f8-4cad-bce4-c95c8729bd9a"). InnerVolumeSpecName "kube-api-access-xpf6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:00:24.206444 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:24.206410    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/febc1787-35f8-4cad-bce4-c95c8729bd9a-extensions-socket-volume\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:00:24.206444 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:24.206442    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpf6b\" (UniqueName: \"kubernetes.io/projected/febc1787-35f8-4cad-bce4-c95c8729bd9a-kube-api-access-xpf6b\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:00:24.800941 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:24.800895    2562 generic.go:356] "Generic (PLEG): container finished" podID="febc1787-35f8-4cad-bce4-c95c8729bd9a" containerID="70ce325409f5b1aad029efa0553e58bddb65ed49baba2eb2c82daa0bfe6cf703" exitCode=0
Jul 06 14:00:24.800941 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:24.800941    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"
Jul 06 14:00:24.801407 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:24.800973    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch" event={"ID":"febc1787-35f8-4cad-bce4-c95c8729bd9a","Type":"ContainerDied","Data":"70ce325409f5b1aad029efa0553e58bddb65ed49baba2eb2c82daa0bfe6cf703"}
Jul 06 14:00:24.801407 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:24.801306    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch" event={"ID":"febc1787-35f8-4cad-bce4-c95c8729bd9a","Type":"ContainerDied","Data":"363d0e8e1a72bdac5784cd66e0d65b46b2483a8e5c5be2c18de48285bd02b327"}
Jul 06 14:00:24.801407 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:24.801391    2562 scope.go:117] "RemoveContainer" containerID="70ce325409f5b1aad029efa0553e58bddb65ed49baba2eb2c82daa0bfe6cf703"
Jul 06 14:00:24.815176 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:24.815015    2562 scope.go:117] "RemoveContainer" containerID="70ce325409f5b1aad029efa0553e58bddb65ed49baba2eb2c82daa0bfe6cf703"
Jul 06 14:00:24.815330 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:00:24.815312    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70ce325409f5b1aad029efa0553e58bddb65ed49baba2eb2c82daa0bfe6cf703\": container with ID starting with 70ce325409f5b1aad029efa0553e58bddb65ed49baba2eb2c82daa0bfe6cf703 not found: ID does not exist" containerID="70ce325409f5b1aad029efa0553e58bddb65ed49baba2eb2c82daa0bfe6cf703"
Jul 06 14:00:24.815384 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:24.815339    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ce325409f5b1aad029efa0553e58bddb65ed49baba2eb2c82daa0bfe6cf703"} err="failed to get container status \"70ce325409f5b1aad029efa0553e58bddb65ed49baba2eb2c82daa0bfe6cf703\": rpc error: code = NotFound desc = could not find container \"70ce325409f5b1aad029efa0553e58bddb65ed49baba2eb2c82daa0bfe6cf703\": container with ID starting with 70ce325409f5b1aad029efa0553e58bddb65ed49baba2eb2c82daa0bfe6cf703 not found: ID does not exist"
Jul 06 14:00:24.824847 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:24.824826    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"]
Jul 06 14:00:24.831295 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:24.831264    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wttch"]
Jul 06 14:00:25.476253 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:25.476218    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="febc1787-35f8-4cad-bce4-c95c8729bd9a" path="/var/lib/kubelet/pods/febc1787-35f8-4cad-bce4-c95c8729bd9a/volumes"
Jul 06 14:00:28.058215 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.058180    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"]
Jul 06 14:00:28.058659 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.058611    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="febc1787-35f8-4cad-bce4-c95c8729bd9a" containerName="manager"
Jul 06 14:00:28.058659 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.058628    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="febc1787-35f8-4cad-bce4-c95c8729bd9a" containerName="manager"
Jul 06 14:00:28.058782 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.058721    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="febc1787-35f8-4cad-bce4-c95c8729bd9a" containerName="manager"
Jul 06 14:00:28.062251 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.062229    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.064443 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.064427    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-njhn6\""
Jul 06 14:00:28.072717 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.072698    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"]
Jul 06 14:00:28.112406 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.112377    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:28.134591 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.134566    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae951262-860c-4a42-a6fb-fb80b36dcf06-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.134702 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.134596    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae951262-860c-4a42-a6fb-fb80b36dcf06-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.134702 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.134617    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae951262-860c-4a42-a6fb-fb80b36dcf06-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.134702 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.134644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjzxw\" (UniqueName: \"kubernetes.io/projected/ae951262-860c-4a42-a6fb-fb80b36dcf06-kube-api-access-wjzxw\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.134802 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.134698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae951262-860c-4a42-a6fb-fb80b36dcf06-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.134802 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.134750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae951262-860c-4a42-a6fb-fb80b36dcf06-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.134802 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.134780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae951262-860c-4a42-a6fb-fb80b36dcf06-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.134935 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.134804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae951262-860c-4a42-a6fb-fb80b36dcf06-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.134935 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.134847    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae951262-860c-4a42-a6fb-fb80b36dcf06-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.236063 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.236032    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae951262-860c-4a42-a6fb-fb80b36dcf06-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.236206 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.236075    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae951262-860c-4a42-a6fb-fb80b36dcf06-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.236206 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.236192    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae951262-860c-4a42-a6fb-fb80b36dcf06-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.236369 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.236232    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae951262-860c-4a42-a6fb-fb80b36dcf06-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.236369 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.236257    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae951262-860c-4a42-a6fb-fb80b36dcf06-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.236369 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.236299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae951262-860c-4a42-a6fb-fb80b36dcf06-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.236369 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.236330    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae951262-860c-4a42-a6fb-fb80b36dcf06-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.236369 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.236367    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjzxw\" (UniqueName: \"kubernetes.io/projected/ae951262-860c-4a42-a6fb-fb80b36dcf06-kube-api-access-wjzxw\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.236630 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.236412    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae951262-860c-4a42-a6fb-fb80b36dcf06-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.236835 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.236810    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae951262-860c-4a42-a6fb-fb80b36dcf06-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.236932 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.236873    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae951262-860c-4a42-a6fb-fb80b36dcf06-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.236984 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.236944    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae951262-860c-4a42-a6fb-fb80b36dcf06-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.236984 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.236959    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae951262-860c-4a42-a6fb-fb80b36dcf06-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.237188 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.237169    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae951262-860c-4a42-a6fb-fb80b36dcf06-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.238446 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.238426    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae951262-860c-4a42-a6fb-fb80b36dcf06-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.238687 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.238672    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae951262-860c-4a42-a6fb-fb80b36dcf06-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.243898 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.243865    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae951262-860c-4a42-a6fb-fb80b36dcf06-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.243983 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.243964    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjzxw\" (UniqueName: \"kubernetes.io/projected/ae951262-860c-4a42-a6fb-fb80b36dcf06-kube-api-access-wjzxw\") pod \"maas-default-gateway-openshift-default-56654dcf7-5lts6\" (UID: \"ae951262-860c-4a42-a6fb-fb80b36dcf06\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.372888 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.372795    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:28.502548 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.502481    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"]
Jul 06 14:00:28.505064 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:00:28.505040    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae951262_860c_4a42_a6fb_fb80b36dcf06.slice/crio-e24a6e5725bba6e91641c84711b4e4f4614a95fd385e891b16cb890108f12b81 WatchSource:0}: Error finding container e24a6e5725bba6e91641c84711b4e4f4614a95fd385e891b16cb890108f12b81: Status 404 returned error can't find the container with id e24a6e5725bba6e91641c84711b4e4f4614a95fd385e891b16cb890108f12b81
Jul 06 14:00:28.507019 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.506990    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:00:28.507090 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.507054    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:00:28.507090 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.507079    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:00:28.585752 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.585719    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:28.822213 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.822182    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6" event={"ID":"ae951262-860c-4a42-a6fb-fb80b36dcf06","Type":"ContainerStarted","Data":"1a202757d93f00e483a8b9fa8b4cc51c2ea51d02206b2abfc96296dab36dbf8f"}
Jul 06 14:00:28.822382 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.822232    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6" event={"ID":"ae951262-860c-4a42-a6fb-fb80b36dcf06","Type":"ContainerStarted","Data":"e24a6e5725bba6e91641c84711b4e4f4614a95fd385e891b16cb890108f12b81"}
Jul 06 14:00:28.842169 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:28.842119    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6" podStartSLOduration=0.842098448 podStartE2EDuration="842.098448ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:00:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:00:28.839967964 +0000 UTC m=+615.883578999" watchObservedRunningTime="2026-07-06 14:00:28.842098448 +0000 UTC m=+615.885709484"
Jul 06 14:00:29.373105 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:29.373070    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:29.377592 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:29.377569    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:29.827324 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:29.827278    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:29.828332 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:29.828309    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:00:41.348155 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.348080    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"]
Jul 06 14:00:41.351256 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.351234    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"
Jul 06 14:00:41.351890 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.351849    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:41.353520 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.353497    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 14:00:41.353649 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.353632    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9rxxc\""
Jul 06 14:00:41.360041 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.360014    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"]
Jul 06 14:00:41.434845 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.434812    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8bad5246-8f65-4a00-b7e0-4b318e9bb201-config-file\") pod \"limitador-limitador-64c94fd64f-v4bnn\" (UID: \"8bad5246-8f65-4a00-b7e0-4b318e9bb201\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"
Jul 06 14:00:41.435010 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.434899    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl7bv\" (UniqueName: \"kubernetes.io/projected/8bad5246-8f65-4a00-b7e0-4b318e9bb201-kube-api-access-zl7bv\") pod \"limitador-limitador-64c94fd64f-v4bnn\" (UID: \"8bad5246-8f65-4a00-b7e0-4b318e9bb201\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"
Jul 06 14:00:41.445018 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.444987    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"]
Jul 06 14:00:41.465905 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.465879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:41.536225 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.536198    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl7bv\" (UniqueName: \"kubernetes.io/projected/8bad5246-8f65-4a00-b7e0-4b318e9bb201-kube-api-access-zl7bv\") pod \"limitador-limitador-64c94fd64f-v4bnn\" (UID: \"8bad5246-8f65-4a00-b7e0-4b318e9bb201\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"
Jul 06 14:00:41.536369 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.536316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8bad5246-8f65-4a00-b7e0-4b318e9bb201-config-file\") pod \"limitador-limitador-64c94fd64f-v4bnn\" (UID: \"8bad5246-8f65-4a00-b7e0-4b318e9bb201\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"
Jul 06 14:00:41.536989 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.536971    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8bad5246-8f65-4a00-b7e0-4b318e9bb201-config-file\") pod \"limitador-limitador-64c94fd64f-v4bnn\" (UID: \"8bad5246-8f65-4a00-b7e0-4b318e9bb201\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"
Jul 06 14:00:41.544047 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.544027    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl7bv\" (UniqueName: \"kubernetes.io/projected/8bad5246-8f65-4a00-b7e0-4b318e9bb201-kube-api-access-zl7bv\") pod \"limitador-limitador-64c94fd64f-v4bnn\" (UID: \"8bad5246-8f65-4a00-b7e0-4b318e9bb201\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"
Jul 06 14:00:41.566852 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.566822    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:41.662362 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.662270    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"
Jul 06 14:00:41.788774 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.788751    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"]
Jul 06 14:00:41.790986 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:00:41.790957    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bad5246_8f65_4a00_b7e0_4b318e9bb201.slice/crio-ee6b027afa0c57e2c9f8cc31fcad5124721e595dd140fd2028af2e5c7cd6ca89 WatchSource:0}: Error finding container ee6b027afa0c57e2c9f8cc31fcad5124721e595dd140fd2028af2e5c7cd6ca89: Status 404 returned error can't find the container with id ee6b027afa0c57e2c9f8cc31fcad5124721e595dd140fd2028af2e5c7cd6ca89
Jul 06 14:00:41.876661 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:41.876633    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn" event={"ID":"8bad5246-8f65-4a00-b7e0-4b318e9bb201","Type":"ContainerStarted","Data":"ee6b027afa0c57e2c9f8cc31fcad5124721e595dd140fd2028af2e5c7cd6ca89"}
Jul 06 14:00:42.146084 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.146051    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-j52np"]
Jul 06 14:00:42.150373 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.150338    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-j52np"
Jul 06 14:00:42.152682 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.152664    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-c5vnx\""
Jul 06 14:00:42.158428 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.158115    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-j52np"]
Jul 06 14:00:42.181668 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.181646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:42.240760 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.240739    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7277\" (UniqueName: \"kubernetes.io/projected/ce19650d-08be-44a8-aa34-6bfd9e1fb97c-kube-api-access-m7277\") pod \"authorino-58cd955675-j52np\" (UID: \"ce19650d-08be-44a8-aa34-6bfd9e1fb97c\") " pod="kuadrant-system/authorino-58cd955675-j52np"
Jul 06 14:00:42.252613 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.252592    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:00:42.341857 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.341835    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7277\" (UniqueName: \"kubernetes.io/projected/ce19650d-08be-44a8-aa34-6bfd9e1fb97c-kube-api-access-m7277\") pod \"authorino-58cd955675-j52np\" (UID: \"ce19650d-08be-44a8-aa34-6bfd9e1fb97c\") " pod="kuadrant-system/authorino-58cd955675-j52np"
Jul 06 14:00:42.350539 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.350512    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7277\" (UniqueName: \"kubernetes.io/projected/ce19650d-08be-44a8-aa34-6bfd9e1fb97c-kube-api-access-m7277\") pod \"authorino-58cd955675-j52np\" (UID: \"ce19650d-08be-44a8-aa34-6bfd9e1fb97c\") " pod="kuadrant-system/authorino-58cd955675-j52np"
Jul 06 14:00:42.404213 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.404160    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-pk4qz"]
Jul 06 14:00:42.407366 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.407347    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pk4qz"
Jul 06 14:00:42.413373 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.413342    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pk4qz"]
Jul 06 14:00:42.442945 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.442926    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn8dc\" (UniqueName: \"kubernetes.io/projected/eab5a865-4ec1-4a0d-b6ac-a5615118bdd7-kube-api-access-rn8dc\") pod \"authorino-75d556bd77-pk4qz\" (UID: \"eab5a865-4ec1-4a0d-b6ac-a5615118bdd7\") " pod="kuadrant-system/authorino-75d556bd77-pk4qz"
Jul 06 14:00:42.460936 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.460884    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-j52np"
Jul 06 14:00:42.543879 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.543847    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn8dc\" (UniqueName: \"kubernetes.io/projected/eab5a865-4ec1-4a0d-b6ac-a5615118bdd7-kube-api-access-rn8dc\") pod \"authorino-75d556bd77-pk4qz\" (UID: \"eab5a865-4ec1-4a0d-b6ac-a5615118bdd7\") " pod="kuadrant-system/authorino-75d556bd77-pk4qz"
Jul 06 14:00:42.553085 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.553058    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn8dc\" (UniqueName: \"kubernetes.io/projected/eab5a865-4ec1-4a0d-b6ac-a5615118bdd7-kube-api-access-rn8dc\") pod \"authorino-75d556bd77-pk4qz\" (UID: \"eab5a865-4ec1-4a0d-b6ac-a5615118bdd7\") " pod="kuadrant-system/authorino-75d556bd77-pk4qz"
Jul 06 14:00:42.582690 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.582623    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-j52np"]
Jul 06 14:00:42.585315 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:00:42.585267    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce19650d_08be_44a8_aa34_6bfd9e1fb97c.slice/crio-f035494810f52791106f17d2f2ef86b7857d64565106232954fabba01ffa72f1 WatchSource:0}: Error finding container f035494810f52791106f17d2f2ef86b7857d64565106232954fabba01ffa72f1: Status 404 returned error can't find the container with id f035494810f52791106f17d2f2ef86b7857d64565106232954fabba01ffa72f1
Jul 06 14:00:42.717532 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.717503    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pk4qz"
Jul 06 14:00:42.882339 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.882261    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pk4qz"]
Jul 06 14:00:42.886370 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:42.886316    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-j52np" event={"ID":"ce19650d-08be-44a8-aa34-6bfd9e1fb97c","Type":"ContainerStarted","Data":"f035494810f52791106f17d2f2ef86b7857d64565106232954fabba01ffa72f1"}
Jul 06 14:00:42.887461 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:00:42.887403    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeab5a865_4ec1_4a0d_b6ac_a5615118bdd7.slice/crio-c4c916ce736f42a2e84b362d6a6ad4aa8d9a6d07149dc982321230b880669e18 WatchSource:0}: Error finding container c4c916ce736f42a2e84b362d6a6ad4aa8d9a6d07149dc982321230b880669e18: Status 404 returned error can't find the container with id c4c916ce736f42a2e84b362d6a6ad4aa8d9a6d07149dc982321230b880669e18
Jul 06 14:00:43.892994 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:43.892963    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pk4qz" event={"ID":"eab5a865-4ec1-4a0d-b6ac-a5615118bdd7","Type":"ContainerStarted","Data":"c4c916ce736f42a2e84b362d6a6ad4aa8d9a6d07149dc982321230b880669e18"}
Jul 06 14:00:44.906503 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:44.906463    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn" event={"ID":"8bad5246-8f65-4a00-b7e0-4b318e9bb201","Type":"ContainerStarted","Data":"ddf9343da73418193354c87fdabf049d00100b7299226bce6d7e9723ef0a16ed"}
Jul 06 14:00:44.907266 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:44.907243    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"
Jul 06 14:00:44.925794 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:44.925123    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn" podStartSLOduration=0.925532156 podStartE2EDuration="3.925101002s" totalImagesPullingTime="2.999568846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:00:44.922932016 +0000 UTC m=+631.966543052" watchObservedRunningTime="2026-07-06 14:00:44.925101002 +0000 UTC m=+631.968712041"
Jul 06 14:00:47.925271 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:47.925225    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pk4qz" event={"ID":"eab5a865-4ec1-4a0d-b6ac-a5615118bdd7","Type":"ContainerStarted","Data":"c9d3a9e1dd8bf38ca83154e54c8d87b345547fbc6070838417cb000ffeee1265"}
Jul 06 14:00:47.926708 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:47.926683    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-j52np" event={"ID":"ce19650d-08be-44a8-aa34-6bfd9e1fb97c","Type":"ContainerStarted","Data":"7562683c95392620b3c31a3453101cf097d6b40250beb8d777bea49093d84b18"}
Jul 06 14:00:47.939514 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:47.939464    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-pk4qz" podStartSLOduration=1.567685536 podStartE2EDuration="5.939446376s" totalImagesPullingTime="4.37176084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:00:47.939166922 +0000 UTC m=+634.982777983" watchObservedRunningTime="2026-07-06 14:00:47.939446376 +0000 UTC m=+634.983057429"
Jul 06 14:00:47.955038 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:47.954996    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-j52np" podStartSLOduration=1.2910220159999999 podStartE2EDuration="5.954984006s" totalImagesPullingTime="4.66396199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:00:47.953611125 +0000 UTC m=+634.997222160" watchObservedRunningTime="2026-07-06 14:00:47.954984006 +0000 UTC m=+634.998595039"
Jul 06 14:00:47.972973 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:47.972951    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-j52np"]
Jul 06 14:00:49.934984 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:49.934941    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-j52np" podUID="ce19650d-08be-44a8-aa34-6bfd9e1fb97c" containerName="authorino" containerID="cri-o://7562683c95392620b3c31a3453101cf097d6b40250beb8d777bea49093d84b18" gracePeriod=30
Jul 06 14:00:50.178517 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:50.178492    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-j52np"
Jul 06 14:00:50.308239 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:50.308205    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7277\" (UniqueName: \"kubernetes.io/projected/ce19650d-08be-44a8-aa34-6bfd9e1fb97c-kube-api-access-m7277\") pod \"ce19650d-08be-44a8-aa34-6bfd9e1fb97c\" (UID: \"ce19650d-08be-44a8-aa34-6bfd9e1fb97c\") "
Jul 06 14:00:50.310111 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:50.310085    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce19650d-08be-44a8-aa34-6bfd9e1fb97c-kube-api-access-m7277" (OuterVolumeSpecName: "kube-api-access-m7277") pod "ce19650d-08be-44a8-aa34-6bfd9e1fb97c" (UID: "ce19650d-08be-44a8-aa34-6bfd9e1fb97c"). InnerVolumeSpecName "kube-api-access-m7277". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:00:50.409569 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:50.409532    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7277\" (UniqueName: \"kubernetes.io/projected/ce19650d-08be-44a8-aa34-6bfd9e1fb97c-kube-api-access-m7277\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:00:50.940087 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:50.940051    2562 generic.go:356] "Generic (PLEG): container finished" podID="ce19650d-08be-44a8-aa34-6bfd9e1fb97c" containerID="7562683c95392620b3c31a3453101cf097d6b40250beb8d777bea49093d84b18" exitCode=0
Jul 06 14:00:50.940473 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:50.940094    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-j52np"
Jul 06 14:00:50.940473 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:50.940104    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-j52np" event={"ID":"ce19650d-08be-44a8-aa34-6bfd9e1fb97c","Type":"ContainerDied","Data":"7562683c95392620b3c31a3453101cf097d6b40250beb8d777bea49093d84b18"}
Jul 06 14:00:50.940473 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:50.940141    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-j52np" event={"ID":"ce19650d-08be-44a8-aa34-6bfd9e1fb97c","Type":"ContainerDied","Data":"f035494810f52791106f17d2f2ef86b7857d64565106232954fabba01ffa72f1"}
Jul 06 14:00:50.940473 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:50.940163    2562 scope.go:117] "RemoveContainer" containerID="7562683c95392620b3c31a3453101cf097d6b40250beb8d777bea49093d84b18"
Jul 06 14:00:50.948930 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:50.948905    2562 scope.go:117] "RemoveContainer" containerID="7562683c95392620b3c31a3453101cf097d6b40250beb8d777bea49093d84b18"
Jul 06 14:00:50.949169 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:00:50.949140    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7562683c95392620b3c31a3453101cf097d6b40250beb8d777bea49093d84b18\": container with ID starting with 7562683c95392620b3c31a3453101cf097d6b40250beb8d777bea49093d84b18 not found: ID does not exist" containerID="7562683c95392620b3c31a3453101cf097d6b40250beb8d777bea49093d84b18"
Jul 06 14:00:50.949223 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:50.949178    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7562683c95392620b3c31a3453101cf097d6b40250beb8d777bea49093d84b18"} err="failed to get container status \"7562683c95392620b3c31a3453101cf097d6b40250beb8d777bea49093d84b18\": rpc error: code = NotFound desc = could not find container \"7562683c95392620b3c31a3453101cf097d6b40250beb8d777bea49093d84b18\": container with ID starting with 7562683c95392620b3c31a3453101cf097d6b40250beb8d777bea49093d84b18 not found: ID does not exist"
Jul 06 14:00:50.960028 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:50.960009    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-j52np"]
Jul 06 14:00:50.963128 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:50.963108    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-j52np"]
Jul 06 14:00:51.476881 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:51.476843    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce19650d-08be-44a8-aa34-6bfd9e1fb97c" path="/var/lib/kubelet/pods/ce19650d-08be-44a8-aa34-6bfd9e1fb97c/volumes"
Jul 06 14:00:56.683357 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:56.683324    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"]
Jul 06 14:00:56.683819 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:56.683530    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn" podUID="8bad5246-8f65-4a00-b7e0-4b318e9bb201" containerName="limitador" containerID="cri-o://ddf9343da73418193354c87fdabf049d00100b7299226bce6d7e9723ef0a16ed" gracePeriod=30
Jul 06 14:00:56.684244 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:56.684224    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"
Jul 06 14:00:57.231110 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:57.231087    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"
Jul 06 14:00:57.360501 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:57.360417    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8bad5246-8f65-4a00-b7e0-4b318e9bb201-config-file\") pod \"8bad5246-8f65-4a00-b7e0-4b318e9bb201\" (UID: \"8bad5246-8f65-4a00-b7e0-4b318e9bb201\") "
Jul 06 14:00:57.360501 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:57.360476    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl7bv\" (UniqueName: \"kubernetes.io/projected/8bad5246-8f65-4a00-b7e0-4b318e9bb201-kube-api-access-zl7bv\") pod \"8bad5246-8f65-4a00-b7e0-4b318e9bb201\" (UID: \"8bad5246-8f65-4a00-b7e0-4b318e9bb201\") "
Jul 06 14:00:57.360814 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:57.360790    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bad5246-8f65-4a00-b7e0-4b318e9bb201-config-file" (OuterVolumeSpecName: "config-file") pod "8bad5246-8f65-4a00-b7e0-4b318e9bb201" (UID: "8bad5246-8f65-4a00-b7e0-4b318e9bb201"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:00:57.362439 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:57.362420    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bad5246-8f65-4a00-b7e0-4b318e9bb201-kube-api-access-zl7bv" (OuterVolumeSpecName: "kube-api-access-zl7bv") pod "8bad5246-8f65-4a00-b7e0-4b318e9bb201" (UID: "8bad5246-8f65-4a00-b7e0-4b318e9bb201"). InnerVolumeSpecName "kube-api-access-zl7bv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:00:57.461068 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:57.461045    2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8bad5246-8f65-4a00-b7e0-4b318e9bb201-config-file\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:00:57.461068 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:57.461065    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl7bv\" (UniqueName: \"kubernetes.io/projected/8bad5246-8f65-4a00-b7e0-4b318e9bb201-kube-api-access-zl7bv\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:00:57.971193 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:57.971154    2562 generic.go:356] "Generic (PLEG): container finished" podID="8bad5246-8f65-4a00-b7e0-4b318e9bb201" containerID="ddf9343da73418193354c87fdabf049d00100b7299226bce6d7e9723ef0a16ed" exitCode=0
Jul 06 14:00:57.971565 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:57.971201    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"
Jul 06 14:00:57.971565 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:57.971243    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn" event={"ID":"8bad5246-8f65-4a00-b7e0-4b318e9bb201","Type":"ContainerDied","Data":"ddf9343da73418193354c87fdabf049d00100b7299226bce6d7e9723ef0a16ed"}
Jul 06 14:00:57.971565 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:57.971311    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-v4bnn" event={"ID":"8bad5246-8f65-4a00-b7e0-4b318e9bb201","Type":"ContainerDied","Data":"ee6b027afa0c57e2c9f8cc31fcad5124721e595dd140fd2028af2e5c7cd6ca89"}
Jul 06 14:00:57.971565 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:57.971334    2562 scope.go:117] "RemoveContainer" containerID="ddf9343da73418193354c87fdabf049d00100b7299226bce6d7e9723ef0a16ed"
Jul 06 14:00:57.979385 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:57.979359    2562 scope.go:117] "RemoveContainer" containerID="ddf9343da73418193354c87fdabf049d00100b7299226bce6d7e9723ef0a16ed"
Jul 06 14:00:57.979623 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:00:57.979606    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddf9343da73418193354c87fdabf049d00100b7299226bce6d7e9723ef0a16ed\": container with ID starting with ddf9343da73418193354c87fdabf049d00100b7299226bce6d7e9723ef0a16ed not found: ID does not exist" containerID="ddf9343da73418193354c87fdabf049d00100b7299226bce6d7e9723ef0a16ed"
Jul 06 14:00:57.979678 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:57.979632    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddf9343da73418193354c87fdabf049d00100b7299226bce6d7e9723ef0a16ed"} err="failed to get container status \"ddf9343da73418193354c87fdabf049d00100b7299226bce6d7e9723ef0a16ed\": rpc error: code = NotFound desc = could not find container \"ddf9343da73418193354c87fdabf049d00100b7299226bce6d7e9723ef0a16ed\": container with ID starting with ddf9343da73418193354c87fdabf049d00100b7299226bce6d7e9723ef0a16ed not found: ID does not exist"
Jul 06 14:00:57.986917 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:57.986898    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"]
Jul 06 14:00:57.992594 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:57.992576    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v4bnn"]
Jul 06 14:00:59.476256 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:00:59.476228    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bad5246-8f65-4a00-b7e0-4b318e9bb201" path="/var/lib/kubelet/pods/8bad5246-8f65-4a00-b7e0-4b318e9bb201/volumes"
Jul 06 14:01:01.626166 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.626138    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-nqhlh"]
Jul 06 14:01:01.626539 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.626455    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce19650d-08be-44a8-aa34-6bfd9e1fb97c" containerName="authorino"
Jul 06 14:01:01.626539 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.626465    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce19650d-08be-44a8-aa34-6bfd9e1fb97c" containerName="authorino"
Jul 06 14:01:01.626539 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.626480    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bad5246-8f65-4a00-b7e0-4b318e9bb201" containerName="limitador"
Jul 06 14:01:01.626539 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.626485    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bad5246-8f65-4a00-b7e0-4b318e9bb201" containerName="limitador"
Jul 06 14:01:01.626539 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.626541    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce19650d-08be-44a8-aa34-6bfd9e1fb97c" containerName="authorino"
Jul 06 14:01:01.626717 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.626548    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bad5246-8f65-4a00-b7e0-4b318e9bb201" containerName="limitador"
Jul 06 14:01:01.630453 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.630434    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-nqhlh"
Jul 06 14:01:01.632560 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.632540    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 06 14:01:01.632679 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.632578    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-gg82t\""
Jul 06 14:01:01.639809 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.639787    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-nqhlh"]
Jul 06 14:01:01.663167 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.663144    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:01:01.688449 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.688427    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7z26\" (UniqueName: \"kubernetes.io/projected/63490b36-2a2d-43bf-85a9-85779be66eab-kube-api-access-c7z26\") pod \"postgres-69fb4594cf-nqhlh\" (UID: \"63490b36-2a2d-43bf-85a9-85779be66eab\") " pod="opendatahub/postgres-69fb4594cf-nqhlh"
Jul 06 14:01:01.688560 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.688471    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/63490b36-2a2d-43bf-85a9-85779be66eab-data\") pod \"postgres-69fb4594cf-nqhlh\" (UID: \"63490b36-2a2d-43bf-85a9-85779be66eab\") " pod="opendatahub/postgres-69fb4594cf-nqhlh"
Jul 06 14:01:01.789520 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.789494    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7z26\" (UniqueName: \"kubernetes.io/projected/63490b36-2a2d-43bf-85a9-85779be66eab-kube-api-access-c7z26\") pod \"postgres-69fb4594cf-nqhlh\" (UID: \"63490b36-2a2d-43bf-85a9-85779be66eab\") " pod="opendatahub/postgres-69fb4594cf-nqhlh"
Jul 06 14:01:01.789633 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.789534    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/63490b36-2a2d-43bf-85a9-85779be66eab-data\") pod \"postgres-69fb4594cf-nqhlh\" (UID: \"63490b36-2a2d-43bf-85a9-85779be66eab\") " pod="opendatahub/postgres-69fb4594cf-nqhlh"
Jul 06 14:01:01.789875 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.789860    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/63490b36-2a2d-43bf-85a9-85779be66eab-data\") pod \"postgres-69fb4594cf-nqhlh\" (UID: \"63490b36-2a2d-43bf-85a9-85779be66eab\") " pod="opendatahub/postgres-69fb4594cf-nqhlh"
Jul 06 14:01:01.798467 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.798449    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7z26\" (UniqueName: \"kubernetes.io/projected/63490b36-2a2d-43bf-85a9-85779be66eab-kube-api-access-c7z26\") pod \"postgres-69fb4594cf-nqhlh\" (UID: \"63490b36-2a2d-43bf-85a9-85779be66eab\") " pod="opendatahub/postgres-69fb4594cf-nqhlh"
Jul 06 14:01:01.943801 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:01.943741    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-nqhlh"
Jul 06 14:01:02.070535 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:02.070469    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-nqhlh"]
Jul 06 14:01:02.072829 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:01:02.072799    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63490b36_2a2d_43bf_85a9_85779be66eab.slice/crio-d5445b613a84b1d2894bba12d07f3d910d47f5d8f000902ad1badf3b47355101 WatchSource:0}: Error finding container d5445b613a84b1d2894bba12d07f3d910d47f5d8f000902ad1badf3b47355101: Status 404 returned error can't find the container with id d5445b613a84b1d2894bba12d07f3d910d47f5d8f000902ad1badf3b47355101
Jul 06 14:01:02.998537 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:02.998443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-nqhlh" event={"ID":"63490b36-2a2d-43bf-85a9-85779be66eab","Type":"ContainerStarted","Data":"d5445b613a84b1d2894bba12d07f3d910d47f5d8f000902ad1badf3b47355101"}
Jul 06 14:01:07.019609 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:07.019583    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-nqhlh" event={"ID":"63490b36-2a2d-43bf-85a9-85779be66eab","Type":"ContainerStarted","Data":"f432d869fef783ce97487630c8ba400424e92efc9f46a8252eca79cfcd1d5977"}
Jul 06 14:01:07.019912 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:07.019704    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-nqhlh"
Jul 06 14:01:07.036192 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:07.036149    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-nqhlh" podStartSLOduration=1.193871246 podStartE2EDuration="6.036135029s" totalImagesPullingTime="4.842263783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:01:07.034635638 +0000 UTC m=+654.078246671" watchObservedRunningTime="2026-07-06 14:01:07.036135029 +0000 UTC m=+654.079746070"
Jul 06 14:01:13.060057 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:13.060030    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-nqhlh"
Jul 06 14:01:13.420188 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:13.420099    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:01:13.579243 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:13.579219    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9pkmh"]
Jul 06 14:01:13.585804 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:13.585782    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9pkmh"
Jul 06 14:01:13.591241 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:13.591223    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9pkmh"]
Jul 06 14:01:13.682352 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:13.682297    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77zhj\" (UniqueName: \"kubernetes.io/projected/62078cb4-b27b-48d2-b22a-222f49416cfd-kube-api-access-77zhj\") pod \"authorino-5d4b67c446-9pkmh\" (UID: \"62078cb4-b27b-48d2-b22a-222f49416cfd\") " pod="kuadrant-system/authorino-5d4b67c446-9pkmh"
Jul 06 14:01:13.783397 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:13.783368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77zhj\" (UniqueName: \"kubernetes.io/projected/62078cb4-b27b-48d2-b22a-222f49416cfd-kube-api-access-77zhj\") pod \"authorino-5d4b67c446-9pkmh\" (UID: \"62078cb4-b27b-48d2-b22a-222f49416cfd\") " pod="kuadrant-system/authorino-5d4b67c446-9pkmh"
Jul 06 14:01:13.791361 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:13.791338    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77zhj\" (UniqueName: \"kubernetes.io/projected/62078cb4-b27b-48d2-b22a-222f49416cfd-kube-api-access-77zhj\") pod \"authorino-5d4b67c446-9pkmh\" (UID: \"62078cb4-b27b-48d2-b22a-222f49416cfd\") " pod="kuadrant-system/authorino-5d4b67c446-9pkmh"
Jul 06 14:01:13.791675 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:13.791656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:01:13.821299 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:13.820021    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9pkmh"]
Jul 06 14:01:13.821299 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:13.820475    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9pkmh"
Jul 06 14:01:13.844736 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:13.844711    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c69f74ccd-m2ptj"]
Jul 06 14:01:13.848821 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:13.848805    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c69f74ccd-m2ptj"
Jul 06 14:01:13.855239 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:13.855220    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c69f74ccd-m2ptj"]
Jul 06 14:01:13.932554 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:13.932484    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c69f74ccd-m2ptj"]
Jul 06 14:01:13.932740 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:01:13.932720    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lzmws], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6c69f74ccd-m2ptj" podUID="3f4abc75-feb4-4610-a0bd-618e802fe654"
Jul 06 14:01:13.953324 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:13.953271    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9pkmh"]
Jul 06 14:01:13.955876 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:01:13.955845    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62078cb4_b27b_48d2_b22a_222f49416cfd.slice/crio-8c65d397bb13b76962b39bb7ff79ad0171917d95a3d687c3e8de1b7d529fbfd2 WatchSource:0}: Error finding container 8c65d397bb13b76962b39bb7ff79ad0171917d95a3d687c3e8de1b7d529fbfd2: Status 404 returned error can't find the container with id 8c65d397bb13b76962b39bb7ff79ad0171917d95a3d687c3e8de1b7d529fbfd2
Jul 06 14:01:13.986439 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:13.986414    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzmws\" (UniqueName: \"kubernetes.io/projected/3f4abc75-feb4-4610-a0bd-618e802fe654-kube-api-access-lzmws\") pod \"authorino-6c69f74ccd-m2ptj\" (UID: \"3f4abc75-feb4-4610-a0bd-618e802fe654\") " pod="kuadrant-system/authorino-6c69f74ccd-m2ptj"
Jul 06 14:01:14.056987 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:14.056959    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9pkmh" event={"ID":"62078cb4-b27b-48d2-b22a-222f49416cfd","Type":"ContainerStarted","Data":"8c65d397bb13b76962b39bb7ff79ad0171917d95a3d687c3e8de1b7d529fbfd2"}
Jul 06 14:01:14.057078 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:14.056989    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c69f74ccd-m2ptj"
Jul 06 14:01:14.064426 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:14.064410    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c69f74ccd-m2ptj"
Jul 06 14:01:14.087257 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:14.087234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzmws\" (UniqueName: \"kubernetes.io/projected/3f4abc75-feb4-4610-a0bd-618e802fe654-kube-api-access-lzmws\") pod \"authorino-6c69f74ccd-m2ptj\" (UID: \"3f4abc75-feb4-4610-a0bd-618e802fe654\") " pod="kuadrant-system/authorino-6c69f74ccd-m2ptj"
Jul 06 14:01:14.095047 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:14.095025    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzmws\" (UniqueName: \"kubernetes.io/projected/3f4abc75-feb4-4610-a0bd-618e802fe654-kube-api-access-lzmws\") pod \"authorino-6c69f74ccd-m2ptj\" (UID: \"3f4abc75-feb4-4610-a0bd-618e802fe654\") " pod="kuadrant-system/authorino-6c69f74ccd-m2ptj"
Jul 06 14:01:14.187515 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:14.187459    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzmws\" (UniqueName: \"kubernetes.io/projected/3f4abc75-feb4-4610-a0bd-618e802fe654-kube-api-access-lzmws\") pod \"3f4abc75-feb4-4610-a0bd-618e802fe654\" (UID: \"3f4abc75-feb4-4610-a0bd-618e802fe654\") "
Jul 06 14:01:14.189497 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:14.189472    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f4abc75-feb4-4610-a0bd-618e802fe654-kube-api-access-lzmws" (OuterVolumeSpecName: "kube-api-access-lzmws") pod "3f4abc75-feb4-4610-a0bd-618e802fe654" (UID: "3f4abc75-feb4-4610-a0bd-618e802fe654"). InnerVolumeSpecName "kube-api-access-lzmws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:01:14.287994 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:14.287970    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzmws\" (UniqueName: \"kubernetes.io/projected/3f4abc75-feb4-4610-a0bd-618e802fe654-kube-api-access-lzmws\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:01:15.062391 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:15.062321    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c69f74ccd-m2ptj"
Jul 06 14:01:15.062391 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:15.062336    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9pkmh" event={"ID":"62078cb4-b27b-48d2-b22a-222f49416cfd","Type":"ContainerStarted","Data":"2fcd6ec5f3da96ba51f2b8cb9d45bf45da6eaf12d270f2ee0c73fc699b525f2c"}
Jul 06 14:01:15.062391 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:15.062377    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-9pkmh" podUID="62078cb4-b27b-48d2-b22a-222f49416cfd" containerName="authorino" containerID="cri-o://2fcd6ec5f3da96ba51f2b8cb9d45bf45da6eaf12d270f2ee0c73fc699b525f2c" gracePeriod=30
Jul 06 14:01:15.081075 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:15.081033    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-9pkmh" podStartSLOduration=1.723520105 podStartE2EDuration="2.081019891s" totalImagesPullingTime="357.499786ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:01:15.079493778 +0000 UTC m=+662.123104812" watchObservedRunningTime="2026-07-06 14:01:15.081019891 +0000 UTC m=+662.124630973"
Jul 06 14:01:15.101380 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:15.101359    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c69f74ccd-m2ptj"]
Jul 06 14:01:15.103470 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:15.103449    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c69f74ccd-m2ptj"]
Jul 06 14:01:15.298827 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:15.298808    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9pkmh"
Jul 06 14:01:15.396220 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:15.396147    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77zhj\" (UniqueName: \"kubernetes.io/projected/62078cb4-b27b-48d2-b22a-222f49416cfd-kube-api-access-77zhj\") pod \"62078cb4-b27b-48d2-b22a-222f49416cfd\" (UID: \"62078cb4-b27b-48d2-b22a-222f49416cfd\") "
Jul 06 14:01:15.397956 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:15.397930    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62078cb4-b27b-48d2-b22a-222f49416cfd-kube-api-access-77zhj" (OuterVolumeSpecName: "kube-api-access-77zhj") pod "62078cb4-b27b-48d2-b22a-222f49416cfd" (UID: "62078cb4-b27b-48d2-b22a-222f49416cfd"). InnerVolumeSpecName "kube-api-access-77zhj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:01:15.452783 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:15.452758    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:01:15.477923 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:15.477897    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f4abc75-feb4-4610-a0bd-618e802fe654" path="/var/lib/kubelet/pods/3f4abc75-feb4-4610-a0bd-618e802fe654/volumes"
Jul 06 14:01:15.497631 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:15.497607    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77zhj\" (UniqueName: \"kubernetes.io/projected/62078cb4-b27b-48d2-b22a-222f49416cfd-kube-api-access-77zhj\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:01:16.068347 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:16.068319    2562 generic.go:356] "Generic (PLEG): container finished" podID="62078cb4-b27b-48d2-b22a-222f49416cfd" containerID="2fcd6ec5f3da96ba51f2b8cb9d45bf45da6eaf12d270f2ee0c73fc699b525f2c" exitCode=0
Jul 06 14:01:16.068476 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:16.068372    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9pkmh"
Jul 06 14:01:16.068476 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:16.068411    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9pkmh" event={"ID":"62078cb4-b27b-48d2-b22a-222f49416cfd","Type":"ContainerDied","Data":"2fcd6ec5f3da96ba51f2b8cb9d45bf45da6eaf12d270f2ee0c73fc699b525f2c"}
Jul 06 14:01:16.068476 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:16.068456    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9pkmh" event={"ID":"62078cb4-b27b-48d2-b22a-222f49416cfd","Type":"ContainerDied","Data":"8c65d397bb13b76962b39bb7ff79ad0171917d95a3d687c3e8de1b7d529fbfd2"}
Jul 06 14:01:16.068476 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:16.068472    2562 scope.go:117] "RemoveContainer" containerID="2fcd6ec5f3da96ba51f2b8cb9d45bf45da6eaf12d270f2ee0c73fc699b525f2c"
Jul 06 14:01:16.076649 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:16.076633    2562 scope.go:117] "RemoveContainer" containerID="2fcd6ec5f3da96ba51f2b8cb9d45bf45da6eaf12d270f2ee0c73fc699b525f2c"
Jul 06 14:01:16.076875 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:01:16.076860    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fcd6ec5f3da96ba51f2b8cb9d45bf45da6eaf12d270f2ee0c73fc699b525f2c\": container with ID starting with 2fcd6ec5f3da96ba51f2b8cb9d45bf45da6eaf12d270f2ee0c73fc699b525f2c not found: ID does not exist" containerID="2fcd6ec5f3da96ba51f2b8cb9d45bf45da6eaf12d270f2ee0c73fc699b525f2c"
Jul 06 14:01:16.076936 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:16.076880    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fcd6ec5f3da96ba51f2b8cb9d45bf45da6eaf12d270f2ee0c73fc699b525f2c"} err="failed to get container status \"2fcd6ec5f3da96ba51f2b8cb9d45bf45da6eaf12d270f2ee0c73fc699b525f2c\": rpc error: code = NotFound desc = could not find container \"2fcd6ec5f3da96ba51f2b8cb9d45bf45da6eaf12d270f2ee0c73fc699b525f2c\": container with ID starting with 2fcd6ec5f3da96ba51f2b8cb9d45bf45da6eaf12d270f2ee0c73fc699b525f2c not found: ID does not exist"
Jul 06 14:01:16.083701 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:16.083678    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9pkmh"]
Jul 06 14:01:16.089910 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:16.089890    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9pkmh"]
Jul 06 14:01:17.477086 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:17.477043    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62078cb4-b27b-48d2-b22a-222f49416cfd" path="/var/lib/kubelet/pods/62078cb4-b27b-48d2-b22a-222f49416cfd/volumes"
Jul 06 14:01:18.825726 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:18.825693    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pk4qz"]
Jul 06 14:01:18.826123 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:18.825846    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-pk4qz" podUID="eab5a865-4ec1-4a0d-b6ac-a5615118bdd7" containerName="authorino" containerID="cri-o://c9d3a9e1dd8bf38ca83154e54c8d87b345547fbc6070838417cb000ffeee1265" gracePeriod=30
Jul 06 14:01:19.084156 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:19.084121    2562 generic.go:356] "Generic (PLEG): container finished" podID="eab5a865-4ec1-4a0d-b6ac-a5615118bdd7" containerID="c9d3a9e1dd8bf38ca83154e54c8d87b345547fbc6070838417cb000ffeee1265" exitCode=0
Jul 06 14:01:19.084276 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:19.084157    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pk4qz" event={"ID":"eab5a865-4ec1-4a0d-b6ac-a5615118bdd7","Type":"ContainerDied","Data":"c9d3a9e1dd8bf38ca83154e54c8d87b345547fbc6070838417cb000ffeee1265"}
Jul 06 14:01:19.120499 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:19.120478    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pk4qz"
Jul 06 14:01:19.224487 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:19.224466    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn8dc\" (UniqueName: \"kubernetes.io/projected/eab5a865-4ec1-4a0d-b6ac-a5615118bdd7-kube-api-access-rn8dc\") pod \"eab5a865-4ec1-4a0d-b6ac-a5615118bdd7\" (UID: \"eab5a865-4ec1-4a0d-b6ac-a5615118bdd7\") "
Jul 06 14:01:19.226424 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:19.226398    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eab5a865-4ec1-4a0d-b6ac-a5615118bdd7-kube-api-access-rn8dc" (OuterVolumeSpecName: "kube-api-access-rn8dc") pod "eab5a865-4ec1-4a0d-b6ac-a5615118bdd7" (UID: "eab5a865-4ec1-4a0d-b6ac-a5615118bdd7"). InnerVolumeSpecName "kube-api-access-rn8dc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:01:19.325655 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:19.325633    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn8dc\" (UniqueName: \"kubernetes.io/projected/eab5a865-4ec1-4a0d-b6ac-a5615118bdd7-kube-api-access-rn8dc\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:01:20.090250 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:20.090222    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pk4qz"
Jul 06 14:01:20.090250 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:20.090244    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pk4qz" event={"ID":"eab5a865-4ec1-4a0d-b6ac-a5615118bdd7","Type":"ContainerDied","Data":"c4c916ce736f42a2e84b362d6a6ad4aa8d9a6d07149dc982321230b880669e18"}
Jul 06 14:01:20.090750 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:20.090312    2562 scope.go:117] "RemoveContainer" containerID="c9d3a9e1dd8bf38ca83154e54c8d87b345547fbc6070838417cb000ffeee1265"
Jul 06 14:01:20.104227 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:20.104207    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pk4qz"]
Jul 06 14:01:20.107353 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:20.107331    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pk4qz"]
Jul 06 14:01:21.476654 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:21.476620    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eab5a865-4ec1-4a0d-b6ac-a5615118bdd7" path="/var/lib/kubelet/pods/eab5a865-4ec1-4a0d-b6ac-a5615118bdd7/volumes"
Jul 06 14:01:23.168913 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.168861    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:01:23.172056 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.172034    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d9d4ddfb5-4cblg"]
Jul 06 14:01:23.172356 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.172337    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62078cb4-b27b-48d2-b22a-222f49416cfd" containerName="authorino"
Jul 06 14:01:23.172414 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.172357    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="62078cb4-b27b-48d2-b22a-222f49416cfd" containerName="authorino"
Jul 06 14:01:23.172414 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.172367    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab5a865-4ec1-4a0d-b6ac-a5615118bdd7" containerName="authorino"
Jul 06 14:01:23.172414 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.172373    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab5a865-4ec1-4a0d-b6ac-a5615118bdd7" containerName="authorino"
Jul 06 14:01:23.172513 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.172421    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="eab5a865-4ec1-4a0d-b6ac-a5615118bdd7" containerName="authorino"
Jul 06 14:01:23.172513 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.172431    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="62078cb4-b27b-48d2-b22a-222f49416cfd" containerName="authorino"
Jul 06 14:01:23.264772 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.264739    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:01:23.307602 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.307580    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d9d4ddfb5-4cblg"]
Jul 06 14:01:23.307714 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.307657    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg"
Jul 06 14:01:23.309915 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.309897    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 14:01:23.310045 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.309914    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cwfp7\""
Jul 06 14:01:23.310409 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.310392    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 14:01:23.328329 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.328306    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:01:23.346991 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.346970    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-ccc479c74-9f9tq"]
Jul 06 14:01:23.361785 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.361763    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ccc479c74-9f9tq"]
Jul 06 14:01:23.361898 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.361860    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ccc479c74-9f9tq"
Jul 06 14:01:23.455237 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.455211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcqsw\" (UniqueName: \"kubernetes.io/projected/117b9fe8-8b50-440e-9cc0-cb9105668a0f-kube-api-access-qcqsw\") pod \"maas-controller-5d9d4ddfb5-4cblg\" (UID: \"117b9fe8-8b50-440e-9cc0-cb9105668a0f\") " pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg"
Jul 06 14:01:23.455411 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.455253    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/117b9fe8-8b50-440e-9cc0-cb9105668a0f-webhook-cert\") pod \"maas-controller-5d9d4ddfb5-4cblg\" (UID: \"117b9fe8-8b50-440e-9cc0-cb9105668a0f\") " pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg"
Jul 06 14:01:23.455411 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.455279    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxpb5\" (UniqueName: \"kubernetes.io/projected/be539433-a35f-41f2-aadc-1a9b5dc0c705-kube-api-access-nxpb5\") pod \"maas-controller-ccc479c74-9f9tq\" (UID: \"be539433-a35f-41f2-aadc-1a9b5dc0c705\") " pod="opendatahub/maas-controller-ccc479c74-9f9tq"
Jul 06 14:01:23.455411 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.455386    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be539433-a35f-41f2-aadc-1a9b5dc0c705-webhook-cert\") pod \"maas-controller-ccc479c74-9f9tq\" (UID: \"be539433-a35f-41f2-aadc-1a9b5dc0c705\") " pod="opendatahub/maas-controller-ccc479c74-9f9tq"
Jul 06 14:01:23.555952 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.555930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/117b9fe8-8b50-440e-9cc0-cb9105668a0f-webhook-cert\") pod \"maas-controller-5d9d4ddfb5-4cblg\" (UID: \"117b9fe8-8b50-440e-9cc0-cb9105668a0f\") " pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg"
Jul 06 14:01:23.556049 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.555976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxpb5\" (UniqueName: \"kubernetes.io/projected/be539433-a35f-41f2-aadc-1a9b5dc0c705-kube-api-access-nxpb5\") pod \"maas-controller-ccc479c74-9f9tq\" (UID: \"be539433-a35f-41f2-aadc-1a9b5dc0c705\") " pod="opendatahub/maas-controller-ccc479c74-9f9tq"
Jul 06 14:01:23.556049 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.556016    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be539433-a35f-41f2-aadc-1a9b5dc0c705-webhook-cert\") pod \"maas-controller-ccc479c74-9f9tq\" (UID: \"be539433-a35f-41f2-aadc-1a9b5dc0c705\") " pod="opendatahub/maas-controller-ccc479c74-9f9tq"
Jul 06 14:01:23.556049 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.556045    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcqsw\" (UniqueName: \"kubernetes.io/projected/117b9fe8-8b50-440e-9cc0-cb9105668a0f-kube-api-access-qcqsw\") pod \"maas-controller-5d9d4ddfb5-4cblg\" (UID: \"117b9fe8-8b50-440e-9cc0-cb9105668a0f\") " pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg"
Jul 06 14:01:23.556162 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:01:23.556071    2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 06 14:01:23.556162 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:01:23.556117    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/117b9fe8-8b50-440e-9cc0-cb9105668a0f-webhook-cert podName:117b9fe8-8b50-440e-9cc0-cb9105668a0f nodeName:}" failed. No retries permitted until 2026-07-06 14:01:24.056103153 +0000 UTC m=+671.099714165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/117b9fe8-8b50-440e-9cc0-cb9105668a0f-webhook-cert") pod "maas-controller-5d9d4ddfb5-4cblg" (UID: "117b9fe8-8b50-440e-9cc0-cb9105668a0f") : secret "maas-controller-webhook-cert" not found
Jul 06 14:01:23.556246 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:01:23.556163    2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 06 14:01:23.556246 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:01:23.556222    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be539433-a35f-41f2-aadc-1a9b5dc0c705-webhook-cert podName:be539433-a35f-41f2-aadc-1a9b5dc0c705 nodeName:}" failed. No retries permitted until 2026-07-06 14:01:24.056205973 +0000 UTC m=+671.099816994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/be539433-a35f-41f2-aadc-1a9b5dc0c705-webhook-cert") pod "maas-controller-ccc479c74-9f9tq" (UID: "be539433-a35f-41f2-aadc-1a9b5dc0c705") : secret "maas-controller-webhook-cert" not found
Jul 06 14:01:23.567079 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.567057    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcqsw\" (UniqueName: \"kubernetes.io/projected/117b9fe8-8b50-440e-9cc0-cb9105668a0f-kube-api-access-qcqsw\") pod \"maas-controller-5d9d4ddfb5-4cblg\" (UID: \"117b9fe8-8b50-440e-9cc0-cb9105668a0f\") " pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg"
Jul 06 14:01:23.567357 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.567330    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxpb5\" (UniqueName: \"kubernetes.io/projected/be539433-a35f-41f2-aadc-1a9b5dc0c705-kube-api-access-nxpb5\") pod \"maas-controller-ccc479c74-9f9tq\" (UID: \"be539433-a35f-41f2-aadc-1a9b5dc0c705\") " pod="opendatahub/maas-controller-ccc479c74-9f9tq"
Jul 06 14:01:23.654469 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:23.654446    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:01:24.059188 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:24.059162    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/117b9fe8-8b50-440e-9cc0-cb9105668a0f-webhook-cert\") pod \"maas-controller-5d9d4ddfb5-4cblg\" (UID: \"117b9fe8-8b50-440e-9cc0-cb9105668a0f\") " pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg"
Jul 06 14:01:24.059426 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:24.059217    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be539433-a35f-41f2-aadc-1a9b5dc0c705-webhook-cert\") pod \"maas-controller-ccc479c74-9f9tq\" (UID: \"be539433-a35f-41f2-aadc-1a9b5dc0c705\") " pod="opendatahub/maas-controller-ccc479c74-9f9tq"
Jul 06 14:01:24.061539 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:24.061515    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/117b9fe8-8b50-440e-9cc0-cb9105668a0f-webhook-cert\") pod \"maas-controller-5d9d4ddfb5-4cblg\" (UID: \"117b9fe8-8b50-440e-9cc0-cb9105668a0f\") " pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg"
Jul 06 14:01:24.061635 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:24.061556    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be539433-a35f-41f2-aadc-1a9b5dc0c705-webhook-cert\") pod \"maas-controller-ccc479c74-9f9tq\" (UID: \"be539433-a35f-41f2-aadc-1a9b5dc0c705\") " pod="opendatahub/maas-controller-ccc479c74-9f9tq"
Jul 06 14:01:24.217586 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:24.217553    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg"
Jul 06 14:01:24.271128 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:24.271103    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ccc479c74-9f9tq"
Jul 06 14:01:24.348684 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:24.348638    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d9d4ddfb5-4cblg"]
Jul 06 14:01:24.351097 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:01:24.351072    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod117b9fe8_8b50_440e_9cc0_cb9105668a0f.slice/crio-4f5398cedb85c97ab054b49241697cc613914773e2948736504bb013e97b401e WatchSource:0}: Error finding container 4f5398cedb85c97ab054b49241697cc613914773e2948736504bb013e97b401e: Status 404 returned error can't find the container with id 4f5398cedb85c97ab054b49241697cc613914773e2948736504bb013e97b401e
Jul 06 14:01:24.407024 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:24.406885    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ccc479c74-9f9tq"]
Jul 06 14:01:24.409378 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:01:24.409356    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe539433_a35f_41f2_aadc_1a9b5dc0c705.slice/crio-41e124b260dc89f5afea175b656fe8413bc5003552e0dceef8d1e92d39e74758 WatchSource:0}: Error finding container 41e124b260dc89f5afea175b656fe8413bc5003552e0dceef8d1e92d39e74758: Status 404 returned error can't find the container with id 41e124b260dc89f5afea175b656fe8413bc5003552e0dceef8d1e92d39e74758
Jul 06 14:01:25.117147 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:25.117109    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg" event={"ID":"117b9fe8-8b50-440e-9cc0-cb9105668a0f","Type":"ContainerStarted","Data":"4f5398cedb85c97ab054b49241697cc613914773e2948736504bb013e97b401e"}
Jul 06 14:01:25.118701 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:25.118669    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ccc479c74-9f9tq" event={"ID":"be539433-a35f-41f2-aadc-1a9b5dc0c705","Type":"ContainerStarted","Data":"41e124b260dc89f5afea175b656fe8413bc5003552e0dceef8d1e92d39e74758"}
Jul 06 14:01:27.399340 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:27.399303    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:01:27.483364 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:27.483327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:01:28.133340 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:28.133304    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg" event={"ID":"117b9fe8-8b50-440e-9cc0-cb9105668a0f","Type":"ContainerStarted","Data":"45b81b9afd46a15cf484b9601e19ade93fd6089e9ec47f792dfd9059a6393905"}
Jul 06 14:01:28.133533 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:28.133469    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg"
Jul 06 14:01:28.134900 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:28.134873    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ccc479c74-9f9tq" event={"ID":"be539433-a35f-41f2-aadc-1a9b5dc0c705","Type":"ContainerStarted","Data":"b142e955067ef91aa2884b96b9c9835a73909d86230784fae80bcd6f66fbff60"}
Jul 06 14:01:28.135025 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:28.134991    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-ccc479c74-9f9tq"
Jul 06 14:01:28.151377 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:28.151338    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg" podStartSLOduration=2.311008224 podStartE2EDuration="5.151326196s" totalImagesPullingTime="2.840317972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:01:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:01:28.150893335 +0000 UTC m=+675.194504399" watchObservedRunningTime="2026-07-06 14:01:28.151326196 +0000 UTC m=+675.194937229"
Jul 06 14:01:28.167276 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:28.167240    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-ccc479c74-9f9tq" podStartSLOduration=2.374839829 podStartE2EDuration="5.167228136s" totalImagesPullingTime="2.792388307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:01:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:01:28.166434812 +0000 UTC m=+675.210045845" watchObservedRunningTime="2026-07-06 14:01:28.167228136 +0000 UTC m=+675.210839197"
Jul 06 14:01:39.145467 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:39.145428    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-ccc479c74-9f9tq"
Jul 06 14:01:39.145978 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:39.145532    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg"
Jul 06 14:01:39.205402 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:39.205369    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d9d4ddfb5-4cblg"]
Jul 06 14:01:39.205604 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:39.205579    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg" podUID="117b9fe8-8b50-440e-9cc0-cb9105668a0f" containerName="manager" containerID="cri-o://45b81b9afd46a15cf484b9601e19ade93fd6089e9ec47f792dfd9059a6393905" gracePeriod=30
Jul 06 14:01:39.438565 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:39.438545    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg"
Jul 06 14:01:39.569331 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:39.569303    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcqsw\" (UniqueName: \"kubernetes.io/projected/117b9fe8-8b50-440e-9cc0-cb9105668a0f-kube-api-access-qcqsw\") pod \"117b9fe8-8b50-440e-9cc0-cb9105668a0f\" (UID: \"117b9fe8-8b50-440e-9cc0-cb9105668a0f\") "
Jul 06 14:01:39.569470 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:39.569409    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/117b9fe8-8b50-440e-9cc0-cb9105668a0f-webhook-cert\") pod \"117b9fe8-8b50-440e-9cc0-cb9105668a0f\" (UID: \"117b9fe8-8b50-440e-9cc0-cb9105668a0f\") "
Jul 06 14:01:39.571506 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:39.571476    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/117b9fe8-8b50-440e-9cc0-cb9105668a0f-kube-api-access-qcqsw" (OuterVolumeSpecName: "kube-api-access-qcqsw") pod "117b9fe8-8b50-440e-9cc0-cb9105668a0f" (UID: "117b9fe8-8b50-440e-9cc0-cb9105668a0f"). InnerVolumeSpecName "kube-api-access-qcqsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:01:39.571506 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:39.571489    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/117b9fe8-8b50-440e-9cc0-cb9105668a0f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "117b9fe8-8b50-440e-9cc0-cb9105668a0f" (UID: "117b9fe8-8b50-440e-9cc0-cb9105668a0f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:01:39.670605 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:39.670582    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcqsw\" (UniqueName: \"kubernetes.io/projected/117b9fe8-8b50-440e-9cc0-cb9105668a0f-kube-api-access-qcqsw\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:01:39.670605 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:39.670604    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/117b9fe8-8b50-440e-9cc0-cb9105668a0f-webhook-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:01:40.191918 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:40.191888    2562 generic.go:356] "Generic (PLEG): container finished" podID="117b9fe8-8b50-440e-9cc0-cb9105668a0f" containerID="45b81b9afd46a15cf484b9601e19ade93fd6089e9ec47f792dfd9059a6393905" exitCode=0
Jul 06 14:01:40.192261 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:40.191931    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg"
Jul 06 14:01:40.192261 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:40.191932    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg" event={"ID":"117b9fe8-8b50-440e-9cc0-cb9105668a0f","Type":"ContainerDied","Data":"45b81b9afd46a15cf484b9601e19ade93fd6089e9ec47f792dfd9059a6393905"}
Jul 06 14:01:40.192261 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:40.192070    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d9d4ddfb5-4cblg" event={"ID":"117b9fe8-8b50-440e-9cc0-cb9105668a0f","Type":"ContainerDied","Data":"4f5398cedb85c97ab054b49241697cc613914773e2948736504bb013e97b401e"}
Jul 06 14:01:40.192261 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:40.192099    2562 scope.go:117] "RemoveContainer" containerID="45b81b9afd46a15cf484b9601e19ade93fd6089e9ec47f792dfd9059a6393905"
Jul 06 14:01:40.200711 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:40.200695    2562 scope.go:117] "RemoveContainer" containerID="45b81b9afd46a15cf484b9601e19ade93fd6089e9ec47f792dfd9059a6393905"
Jul 06 14:01:40.200975 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:01:40.200959    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45b81b9afd46a15cf484b9601e19ade93fd6089e9ec47f792dfd9059a6393905\": container with ID starting with 45b81b9afd46a15cf484b9601e19ade93fd6089e9ec47f792dfd9059a6393905 not found: ID does not exist" containerID="45b81b9afd46a15cf484b9601e19ade93fd6089e9ec47f792dfd9059a6393905"
Jul 06 14:01:40.201044 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:40.200980    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b81b9afd46a15cf484b9601e19ade93fd6089e9ec47f792dfd9059a6393905"} err="failed to get container status \"45b81b9afd46a15cf484b9601e19ade93fd6089e9ec47f792dfd9059a6393905\": rpc error: code = NotFound desc = could not find container \"45b81b9afd46a15cf484b9601e19ade93fd6089e9ec47f792dfd9059a6393905\": container with ID starting with 45b81b9afd46a15cf484b9601e19ade93fd6089e9ec47f792dfd9059a6393905 not found: ID does not exist"
Jul 06 14:01:40.211647 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:40.211627    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d9d4ddfb5-4cblg"]
Jul 06 14:01:40.215217 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:40.215197    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5d9d4ddfb5-4cblg"]
Jul 06 14:01:41.477173 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:41.477139    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="117b9fe8-8b50-440e-9cc0-cb9105668a0f" path="/var/lib/kubelet/pods/117b9fe8-8b50-440e-9cc0-cb9105668a0f/volumes"
Jul 06 14:01:59.805782 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:01:59.805742    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:02:00.287067 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.287035    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:02:00.327240 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.327209    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-cf976bdf7-bc4s4"]
Jul 06 14:02:00.327539 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.327526    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="117b9fe8-8b50-440e-9cc0-cb9105668a0f" containerName="manager"
Jul 06 14:02:00.327584 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.327540    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="117b9fe8-8b50-440e-9cc0-cb9105668a0f" containerName="manager"
Jul 06 14:02:00.327621 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.327591    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="117b9fe8-8b50-440e-9cc0-cb9105668a0f" containerName="manager"
Jul 06 14:02:00.333148 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.333129    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-cf976bdf7-bc4s4"
Jul 06 14:02:00.335538 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.335517    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-dln66\""
Jul 06 14:02:00.336579 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.336561    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 06 14:02:00.343824 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.343802    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-cf976bdf7-bc4s4"]
Jul 06 14:02:00.367924 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.367893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:02:00.411036 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.411012    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn4k4\" (UniqueName: \"kubernetes.io/projected/c0a4d357-60a8-4fd9-8f09-51818b9e0ff6-kube-api-access-rn4k4\") pod \"maas-api-cf976bdf7-bc4s4\" (UID: \"c0a4d357-60a8-4fd9-8f09-51818b9e0ff6\") " pod="opendatahub/maas-api-cf976bdf7-bc4s4"
Jul 06 14:02:00.411113 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.411045    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a4d357-60a8-4fd9-8f09-51818b9e0ff6-openshift-service-ca\") pod \"maas-api-cf976bdf7-bc4s4\" (UID: \"c0a4d357-60a8-4fd9-8f09-51818b9e0ff6\") " pod="opendatahub/maas-api-cf976bdf7-bc4s4"
Jul 06 14:02:00.411156 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.411111    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0a4d357-60a8-4fd9-8f09-51818b9e0ff6-maas-api-tls\") pod \"maas-api-cf976bdf7-bc4s4\" (UID: \"c0a4d357-60a8-4fd9-8f09-51818b9e0ff6\") " pod="opendatahub/maas-api-cf976bdf7-bc4s4"
Jul 06 14:02:00.511588 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.511561    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0a4d357-60a8-4fd9-8f09-51818b9e0ff6-maas-api-tls\") pod \"maas-api-cf976bdf7-bc4s4\" (UID: \"c0a4d357-60a8-4fd9-8f09-51818b9e0ff6\") " pod="opendatahub/maas-api-cf976bdf7-bc4s4"
Jul 06 14:02:00.511681 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.511614    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn4k4\" (UniqueName: \"kubernetes.io/projected/c0a4d357-60a8-4fd9-8f09-51818b9e0ff6-kube-api-access-rn4k4\") pod \"maas-api-cf976bdf7-bc4s4\" (UID: \"c0a4d357-60a8-4fd9-8f09-51818b9e0ff6\") " pod="opendatahub/maas-api-cf976bdf7-bc4s4"
Jul 06 14:02:00.511745 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.511727    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a4d357-60a8-4fd9-8f09-51818b9e0ff6-openshift-service-ca\") pod \"maas-api-cf976bdf7-bc4s4\" (UID: \"c0a4d357-60a8-4fd9-8f09-51818b9e0ff6\") " pod="opendatahub/maas-api-cf976bdf7-bc4s4"
Jul 06 14:02:00.512344 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.512313    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a4d357-60a8-4fd9-8f09-51818b9e0ff6-openshift-service-ca\") pod \"maas-api-cf976bdf7-bc4s4\" (UID: \"c0a4d357-60a8-4fd9-8f09-51818b9e0ff6\") " pod="opendatahub/maas-api-cf976bdf7-bc4s4"
Jul 06 14:02:00.514028 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.514010    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0a4d357-60a8-4fd9-8f09-51818b9e0ff6-maas-api-tls\") pod \"maas-api-cf976bdf7-bc4s4\" (UID: \"c0a4d357-60a8-4fd9-8f09-51818b9e0ff6\") " pod="opendatahub/maas-api-cf976bdf7-bc4s4"
Jul 06 14:02:00.519095 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.519075    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn4k4\" (UniqueName: \"kubernetes.io/projected/c0a4d357-60a8-4fd9-8f09-51818b9e0ff6-kube-api-access-rn4k4\") pod \"maas-api-cf976bdf7-bc4s4\" (UID: \"c0a4d357-60a8-4fd9-8f09-51818b9e0ff6\") " pod="opendatahub/maas-api-cf976bdf7-bc4s4"
Jul 06 14:02:00.644013 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.643937    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-cf976bdf7-bc4s4"
Jul 06 14:02:00.780304 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.780247    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:02:00.802638 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.802567    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-cf976bdf7-bc4s4"]
Jul 06 14:02:00.806121 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:02:00.806072    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0a4d357_60a8_4fd9_8f09_51818b9e0ff6.slice/crio-6c221bb1dbeb7ecf0d6a07524eb29907b0829c0f0d02f855ea1397a0bc5d15fb WatchSource:0}: Error finding container 6c221bb1dbeb7ecf0d6a07524eb29907b0829c0f0d02f855ea1397a0bc5d15fb: Status 404 returned error can't find the container with id 6c221bb1dbeb7ecf0d6a07524eb29907b0829c0f0d02f855ea1397a0bc5d15fb
Jul 06 14:02:00.856142 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.856113    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:02:00.970784 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.970757    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-r44vg"]
Jul 06 14:02:00.974891 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.974873    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-r44vg"
Jul 06 14:02:00.976938 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.976916    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-md42c\""
Jul 06 14:02:00.977026 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.976918    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 14:02:00.984537 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:00.984519    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-r44vg"]
Jul 06 14:02:01.016188 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:01.016142    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da6028d8-6496-40de-b86e-f9e5ac13cf4f-plugins-config-volume\") pod \"payload-pre-processing-7964457696-r44vg\" (UID: \"da6028d8-6496-40de-b86e-f9e5ac13cf4f\") " pod="openshift-ingress/payload-pre-processing-7964457696-r44vg"
Jul 06 14:02:01.016351 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:01.016192    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtnq5\" (UniqueName: \"kubernetes.io/projected/da6028d8-6496-40de-b86e-f9e5ac13cf4f-kube-api-access-wtnq5\") pod \"payload-pre-processing-7964457696-r44vg\" (UID: \"da6028d8-6496-40de-b86e-f9e5ac13cf4f\") " pod="openshift-ingress/payload-pre-processing-7964457696-r44vg"
Jul 06 14:02:01.117484 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:01.117448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da6028d8-6496-40de-b86e-f9e5ac13cf4f-plugins-config-volume\") pod \"payload-pre-processing-7964457696-r44vg\" (UID: \"da6028d8-6496-40de-b86e-f9e5ac13cf4f\") " pod="openshift-ingress/payload-pre-processing-7964457696-r44vg"
Jul 06 14:02:01.117736 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:01.117492    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtnq5\" (UniqueName: \"kubernetes.io/projected/da6028d8-6496-40de-b86e-f9e5ac13cf4f-kube-api-access-wtnq5\") pod \"payload-pre-processing-7964457696-r44vg\" (UID: \"da6028d8-6496-40de-b86e-f9e5ac13cf4f\") " pod="openshift-ingress/payload-pre-processing-7964457696-r44vg"
Jul 06 14:02:01.118237 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:01.118215    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da6028d8-6496-40de-b86e-f9e5ac13cf4f-plugins-config-volume\") pod \"payload-pre-processing-7964457696-r44vg\" (UID: \"da6028d8-6496-40de-b86e-f9e5ac13cf4f\") " pod="openshift-ingress/payload-pre-processing-7964457696-r44vg"
Jul 06 14:02:01.125776 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:01.125746    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtnq5\" (UniqueName: \"kubernetes.io/projected/da6028d8-6496-40de-b86e-f9e5ac13cf4f-kube-api-access-wtnq5\") pod \"payload-pre-processing-7964457696-r44vg\" (UID: \"da6028d8-6496-40de-b86e-f9e5ac13cf4f\") " pod="openshift-ingress/payload-pre-processing-7964457696-r44vg"
Jul 06 14:02:01.286182 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:01.286106    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-r44vg"
Jul 06 14:02:01.288475 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:01.288449    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-cf976bdf7-bc4s4" event={"ID":"c0a4d357-60a8-4fd9-8f09-51818b9e0ff6","Type":"ContainerStarted","Data":"6c221bb1dbeb7ecf0d6a07524eb29907b0829c0f0d02f855ea1397a0bc5d15fb"}
Jul 06 14:02:01.434151 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:01.434119    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-r44vg"]
Jul 06 14:02:01.436017 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:02:01.435990    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6028d8_6496_40de_b86e_f9e5ac13cf4f.slice/crio-132e311547c7d06ced6a7ff16da37c9997257dabf9243bc2ca7c4d280aff6bde WatchSource:0}: Error finding container 132e311547c7d06ced6a7ff16da37c9997257dabf9243bc2ca7c4d280aff6bde: Status 404 returned error can't find the container with id 132e311547c7d06ced6a7ff16da37c9997257dabf9243bc2ca7c4d280aff6bde
Jul 06 14:02:02.308695 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:02.308654    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-r44vg" event={"ID":"da6028d8-6496-40de-b86e-f9e5ac13cf4f","Type":"ContainerStarted","Data":"132e311547c7d06ced6a7ff16da37c9997257dabf9243bc2ca7c4d280aff6bde"}
Jul 06 14:02:03.315389 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:03.315352    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-cf976bdf7-bc4s4" event={"ID":"c0a4d357-60a8-4fd9-8f09-51818b9e0ff6","Type":"ContainerStarted","Data":"408287df56b44f20bcda513ebe07ae41c03eaedb58c3437e4dd8a262a2613aae"}
Jul 06 14:02:03.315844 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:03.315416    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-cf976bdf7-bc4s4"
Jul 06 14:02:03.316782 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:03.316757    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-r44vg" event={"ID":"da6028d8-6496-40de-b86e-f9e5ac13cf4f","Type":"ContainerStarted","Data":"1b4b5e7d18a537d8a028f2c6df4d85d998ab715dc06fadc5c6f5a7d381991f1b"}
Jul 06 14:02:03.316877 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:03.316868    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-r44vg"
Jul 06 14:02:03.333866 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:03.333823    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-cf976bdf7-bc4s4" podStartSLOduration=1.510843994 podStartE2EDuration="3.33380669s" totalImagesPullingTime="1.822962696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:02:03.333480133 +0000 UTC m=+710.377091190" watchObservedRunningTime="2026-07-06 14:02:03.33380669 +0000 UTC m=+710.377417724"
Jul 06 14:02:03.350892 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:03.350855    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-r44vg" podStartSLOduration=1.610875843 podStartE2EDuration="3.350840937s" totalImagesPullingTime="1.739965094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:02:03.350452096 +0000 UTC m=+710.394063130" watchObservedRunningTime="2026-07-06 14:02:03.350840937 +0000 UTC m=+710.394451970"
Jul 06 14:02:09.326248 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:09.326217    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-cf976bdf7-bc4s4"
Jul 06 14:02:09.348239 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:09.348215    2562 generic.go:356] "Generic (PLEG): container finished" podID="ae951262-860c-4a42-a6fb-fb80b36dcf06" containerID="1a202757d93f00e483a8b9fa8b4cc51c2ea51d02206b2abfc96296dab36dbf8f" exitCode=0
Jul 06 14:02:09.348369 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:09.348258    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6" event={"ID":"ae951262-860c-4a42-a6fb-fb80b36dcf06","Type":"ContainerDied","Data":"1a202757d93f00e483a8b9fa8b4cc51c2ea51d02206b2abfc96296dab36dbf8f"}
Jul 06 14:02:09.348590 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:09.348577    2562 scope.go:117] "RemoveContainer" containerID="1a202757d93f00e483a8b9fa8b4cc51c2ea51d02206b2abfc96296dab36dbf8f"
Jul 06 14:02:09.349439 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:09.349412    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:02:09.349539 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:09.349488    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:02:09.349603 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:09.349538    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:02:10.356934 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:10.356898    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6" event={"ID":"ae951262-860c-4a42-a6fb-fb80b36dcf06","Type":"ContainerStarted","Data":"e61b68aa8b233d810a3723c3b689b94888aba5f15368f90a42ee45c98cc248e3"}
Jul 06 14:02:10.373805 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:10.373784    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:02:10.374905 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:10.374881    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-5lts6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 06 14:02:10.375005 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:10.374929    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6" podUID="ae951262-860c-4a42-a6fb-fb80b36dcf06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 06 14:02:10.480121 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:10.480085    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:02:11.373265 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:11.373231    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-5lts6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 06 14:02:11.373670 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:11.373299    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6" podUID="ae951262-860c-4a42-a6fb-fb80b36dcf06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 06 14:02:12.373111 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:12.373077    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-5lts6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 06 14:02:12.373304 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:12.373128    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6" podUID="ae951262-860c-4a42-a6fb-fb80b36dcf06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 06 14:02:13.080353 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:13.080314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:02:13.373787 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:13.373704    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-5lts6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 06 14:02:13.373787 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:13.373764    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6" podUID="ae951262-860c-4a42-a6fb-fb80b36dcf06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 06 14:02:14.323352 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:14.323323    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-r44vg"
Jul 06 14:02:14.373144 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:14.373106    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-5lts6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 06 14:02:14.373347 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:14.373165    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6" podUID="ae951262-860c-4a42-a6fb-fb80b36dcf06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 06 14:02:14.827277 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:14.827245    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:02:15.377381 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:15.377357    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:02:15.379463 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:15.379441    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5lts6"
Jul 06 14:02:16.752132 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.752100    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"]
Jul 06 14:02:16.757325 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.757305    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.759397 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.759372    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 14:02:16.759504 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.759433    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xm2d8\""
Jul 06 14:02:16.759504 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.759438    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 14:02:16.760154 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.760137    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 14:02:16.766262 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.766245    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"]
Jul 06 14:02:16.846342 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.846319    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:02:16.849404 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.849385    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5af45495-3394-4bb5-aa5e-abed54e1593c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.849500 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.849417    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5af45495-3394-4bb5-aa5e-abed54e1593c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.849500 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.849437    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5af45495-3394-4bb5-aa5e-abed54e1593c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.849500 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.849461    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn5rq\" (UniqueName: \"kubernetes.io/projected/5af45495-3394-4bb5-aa5e-abed54e1593c-kube-api-access-hn5rq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.849500 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.849495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5af45495-3394-4bb5-aa5e-abed54e1593c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.849656 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.849526    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5af45495-3394-4bb5-aa5e-abed54e1593c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.950916 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.950887    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5af45495-3394-4bb5-aa5e-abed54e1593c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.951059 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.950934    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5af45495-3394-4bb5-aa5e-abed54e1593c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.951059 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.950961    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5af45495-3394-4bb5-aa5e-abed54e1593c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.951174 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.951118    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn5rq\" (UniqueName: \"kubernetes.io/projected/5af45495-3394-4bb5-aa5e-abed54e1593c-kube-api-access-hn5rq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.951174 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.951165    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5af45495-3394-4bb5-aa5e-abed54e1593c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.951310 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.951220    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5af45495-3394-4bb5-aa5e-abed54e1593c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.951380 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.951332    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5af45495-3394-4bb5-aa5e-abed54e1593c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.951437 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.951379    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5af45495-3394-4bb5-aa5e-abed54e1593c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.951612 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.951593    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5af45495-3394-4bb5-aa5e-abed54e1593c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.953409 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.953393    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5af45495-3394-4bb5-aa5e-abed54e1593c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.953494 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.953479    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5af45495-3394-4bb5-aa5e-abed54e1593c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:16.958614 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:16.958595    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn5rq\" (UniqueName: \"kubernetes.io/projected/5af45495-3394-4bb5-aa5e-abed54e1593c-kube-api-access-hn5rq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k\" (UID: \"5af45495-3394-4bb5-aa5e-abed54e1593c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:17.068183 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:17.068129    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:17.201056 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:17.201026    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"]
Jul 06 14:02:17.205203 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:02:17.205170    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5af45495_3394_4bb5_aa5e_abed54e1593c.slice/crio-1b39a85409b52fdda9e0f9ce8a048f6e5bfd58a2d666f592bf7b8b632812a659 WatchSource:0}: Error finding container 1b39a85409b52fdda9e0f9ce8a048f6e5bfd58a2d666f592bf7b8b632812a659: Status 404 returned error can't find the container with id 1b39a85409b52fdda9e0f9ce8a048f6e5bfd58a2d666f592bf7b8b632812a659
Jul 06 14:02:17.388998 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:17.388933    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k" event={"ID":"5af45495-3394-4bb5-aa5e-abed54e1593c","Type":"ContainerStarted","Data":"1b39a85409b52fdda9e0f9ce8a048f6e5bfd58a2d666f592bf7b8b632812a659"}
Jul 06 14:02:19.400215 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:19.400173    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k" event={"ID":"5af45495-3394-4bb5-aa5e-abed54e1593c","Type":"ContainerStarted","Data":"58ff4aa774128e72437ffe93c9793c3c6eac654cb29526ab07dd760d71db19f7"}
Jul 06 14:02:19.418963 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:19.418917    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k" podStartSLOduration=1.975713337 podStartE2EDuration="3.418901896s" totalImagesPullingTime="1.443188559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:02:19.418199084 +0000 UTC m=+726.461810147" watchObservedRunningTime="2026-07-06 14:02:19.418901896 +0000 UTC m=+726.462512929"
Jul 06 14:02:27.069303 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:27.069243    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:27.069688 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:27.069334    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:27.081666 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:27.081635    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:27.447952 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:27.447862    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k"
Jul 06 14:02:28.750556 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:28.750524    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:02:29.041482 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.041395    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"]
Jul 06 14:02:29.044989 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.044965    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.046898 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.046882    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 06 14:02:29.053769 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.053748    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"]
Jul 06 14:02:29.078672 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.078646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:02:29.137727 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.137698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.137839 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.137792    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.137839 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.137829    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.137927 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.137851    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.137927 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.137889    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4w55\" (UniqueName: \"kubernetes.io/projected/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-kube-api-access-x4w55\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.137927 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.137911    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.238988 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.238954    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4w55\" (UniqueName: \"kubernetes.io/projected/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-kube-api-access-x4w55\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.238988 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.238990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.239205 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.239013    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.239205 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.239057    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.239205 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.239078    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.239205 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.239094    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.239472 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.239446    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.239535 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.239507    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.239579 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.239555    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.241377 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.241355    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.241579 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.241563    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.246376 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.246356    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4w55\" (UniqueName: \"kubernetes.io/projected/6d98bf8a-d97f-41e2-947e-77ddaf7f3321-kube-api-access-x4w55\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pt4q\" (UID: \"6d98bf8a-d97f-41e2-947e-77ddaf7f3321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.355266 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.355203    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:29.487342 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.487313    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"]
Jul 06 14:02:29.488841 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:02:29.488815    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d98bf8a_d97f_41e2_947e_77ddaf7f3321.slice/crio-63f92d19c6a5a122d90e6b075a954ee61c019a2003e970bc3c60c3ed62c1f7e6 WatchSource:0}: Error finding container 63f92d19c6a5a122d90e6b075a954ee61c019a2003e970bc3c60c3ed62c1f7e6: Status 404 returned error can't find the container with id 63f92d19c6a5a122d90e6b075a954ee61c019a2003e970bc3c60c3ed62c1f7e6
Jul 06 14:02:29.490205 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:29.490183    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:02:30.451160 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:30.451128    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q" event={"ID":"6d98bf8a-d97f-41e2-947e-77ddaf7f3321","Type":"ContainerStarted","Data":"613b87a4c4bcf5c1a547b960f2c0374f007f1f062d71bbfdebded7b2d4a3d30e"}
Jul 06 14:02:30.451579 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:30.451199    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q" event={"ID":"6d98bf8a-d97f-41e2-947e-77ddaf7f3321","Type":"ContainerStarted","Data":"63f92d19c6a5a122d90e6b075a954ee61c019a2003e970bc3c60c3ed62c1f7e6"}
Jul 06 14:02:30.471186 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:30.471139    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q" podStartSLOduration=1.244674641 podStartE2EDuration="1.47112689s" totalImagesPullingTime="226.452249ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:02:30.46954522 +0000 UTC m=+737.513156253" watchObservedRunningTime="2026-07-06 14:02:30.47112689 +0000 UTC m=+737.514737924"
Jul 06 14:02:35.969071 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:35.969025    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:02:36.041664 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:36.041635    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:02:39.355909 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:39.355873    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:39.356392 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:39.355931    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:39.368347 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:39.368315    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:39.503015 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:39.502992    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pt4q"
Jul 06 14:02:45.198845 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:45.198804    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:02:49.496069 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:49.495994    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:02:51.740963 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:51.740935    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"]
Jul 06 14:02:51.744380 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:51.744353    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:51.746510 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:51.746487    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 06 14:02:51.755512 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:51.755488    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"]
Jul 06 14:02:51.781806 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:51.781766    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:02:51.916638 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:51.916606    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e8b608b-a6bd-4037-962c-2b0c2c677977-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:51.916638 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:51.916638    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e8b608b-a6bd-4037-962c-2b0c2c677977-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:51.916848 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:51.916662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e8b608b-a6bd-4037-962c-2b0c2c677977-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:51.916848 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:51.916759    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e8b608b-a6bd-4037-962c-2b0c2c677977-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:51.916848 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:51.916808    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6bpj\" (UniqueName: \"kubernetes.io/projected/6e8b608b-a6bd-4037-962c-2b0c2c677977-kube-api-access-d6bpj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:51.916956 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:51.916875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e8b608b-a6bd-4037-962c-2b0c2c677977-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:52.018077 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:52.018015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6bpj\" (UniqueName: \"kubernetes.io/projected/6e8b608b-a6bd-4037-962c-2b0c2c677977-kube-api-access-d6bpj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:52.018077 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:52.018054    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e8b608b-a6bd-4037-962c-2b0c2c677977-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:52.018253 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:52.018085    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e8b608b-a6bd-4037-962c-2b0c2c677977-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:52.018253 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:52.018100    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e8b608b-a6bd-4037-962c-2b0c2c677977-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:52.018253 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:52.018125    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e8b608b-a6bd-4037-962c-2b0c2c677977-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:52.018253 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:52.018153    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e8b608b-a6bd-4037-962c-2b0c2c677977-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:52.018479 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:52.018443    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e8b608b-a6bd-4037-962c-2b0c2c677977-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:52.018535 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:52.018491    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e8b608b-a6bd-4037-962c-2b0c2c677977-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:52.018591 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:52.018550    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e8b608b-a6bd-4037-962c-2b0c2c677977-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:52.020432 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:52.020412    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e8b608b-a6bd-4037-962c-2b0c2c677977-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:52.020719 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:52.020700    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e8b608b-a6bd-4037-962c-2b0c2c677977-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:52.025751 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:52.025730    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6bpj\" (UniqueName: \"kubernetes.io/projected/6e8b608b-a6bd-4037-962c-2b0c2c677977-kube-api-access-d6bpj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql\" (UID: \"6e8b608b-a6bd-4037-962c-2b0c2c677977\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:52.056270 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:52.056247    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:02:52.192920 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:52.192886    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"]
Jul 06 14:02:52.196207 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:02:52.196173    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8b608b_a6bd_4037_962c_2b0c2c677977.slice/crio-344825db38ef7b5a8651bce7e87d537cd0985cb524260aa11e5193faa65ea60e WatchSource:0}: Error finding container 344825db38ef7b5a8651bce7e87d537cd0985cb524260aa11e5193faa65ea60e: Status 404 returned error can't find the container with id 344825db38ef7b5a8651bce7e87d537cd0985cb524260aa11e5193faa65ea60e
Jul 06 14:02:52.545879 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:52.545852    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql" event={"ID":"6e8b608b-a6bd-4037-962c-2b0c2c677977","Type":"ContainerStarted","Data":"344825db38ef7b5a8651bce7e87d537cd0985cb524260aa11e5193faa65ea60e"}
Jul 06 14:02:53.552047 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:53.552012    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql" event={"ID":"6e8b608b-a6bd-4037-962c-2b0c2c677977","Type":"ContainerStarted","Data":"93ec4fb477172317fbbbc1ee9c2c7397bfa3f7115b9d369f4979cf3f28b57f7c"}
Jul 06 14:02:53.572395 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:02:53.572350    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql" podStartSLOduration=2.254154963 podStartE2EDuration="2.572325426s" totalImagesPullingTime="318.170463ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:02:53.571150191 +0000 UTC m=+760.614761226" watchObservedRunningTime="2026-07-06 14:02:53.572325426 +0000 UTC m=+760.615936460"
Jul 06 14:03:02.056724 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:02.056689    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:03:02.057242 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:02.056773    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:03:02.068941 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:02.068912    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:03:02.602125 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:02.602105    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql"
Jul 06 14:03:08.345322 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.345276    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"]
Jul 06 14:03:08.349798 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.349777    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.351704 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.351687    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 06 14:03:08.357614 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.357586    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"]
Jul 06 14:03:08.453844 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.453812    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:03:08.536450 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.536419    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.536625 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.536455    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjx2n\" (UniqueName: \"kubernetes.io/projected/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-kube-api-access-pjx2n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.536625 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.536543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.536625 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.536586    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.536743 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.536633    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.536743 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.536652    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.637615 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.637539    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.637615 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.637580    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.637784 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.637706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.637784 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.637750    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjx2n\" (UniqueName: \"kubernetes.io/projected/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-kube-api-access-pjx2n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.637897 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.637855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.637951 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.637919    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.638004 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.637951    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.638264 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.638239    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.638375 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.638265    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.639910 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.639888    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.640336 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.640308    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.645580 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.645561    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjx2n\" (UniqueName: \"kubernetes.io/projected/6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20-kube-api-access-pjx2n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pl859\" (UID: \"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.660432 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.660413    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:08.790874 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:08.790845    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"]
Jul 06 14:03:08.793380 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:03:08.793353    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bf0780a_dcc5_4221_9d09_ff2d7f2f5a20.slice/crio-da6ca14e8b51fa05fc65eaaec8ab9772b2a6330b1c941d594f995303acb3e709 WatchSource:0}: Error finding container da6ca14e8b51fa05fc65eaaec8ab9772b2a6330b1c941d594f995303acb3e709: Status 404 returned error can't find the container with id da6ca14e8b51fa05fc65eaaec8ab9772b2a6330b1c941d594f995303acb3e709
Jul 06 14:03:09.626105 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:09.626070    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859" event={"ID":"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20","Type":"ContainerStarted","Data":"8ca8cadc5e20c98f2e5ea9e77f5b38b5b4b1071dd4d507e484f649ea50b22929"}
Jul 06 14:03:09.626508 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:09.626159    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859" event={"ID":"6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20","Type":"ContainerStarted","Data":"da6ca14e8b51fa05fc65eaaec8ab9772b2a6330b1c941d594f995303acb3e709"}
Jul 06 14:03:09.642696 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:09.642650    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859" podStartSLOduration=1.32757752 podStartE2EDuration="1.642636962s" totalImagesPullingTime="315.059442ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:03:09.641610498 +0000 UTC m=+776.685221543" watchObservedRunningTime="2026-07-06 14:03:09.642636962 +0000 UTC m=+776.686247996"
Jul 06 14:03:18.660947 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:18.660897    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:18.661589 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:18.660976    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:18.673916 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:18.673891    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:19.681170 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:19.681139    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pl859"
Jul 06 14:03:24.838314 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.838267    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"]
Jul 06 14:03:24.843082 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.843053    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.845233 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.845210    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 14:03:24.859176 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.859147    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.859318 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.859214    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.859318 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.859245    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.859318 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.859299    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.859510 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.859354    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.859510 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.859461    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w22g\" (UniqueName: \"kubernetes.io/projected/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-kube-api-access-6w22g\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.861072 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.861052    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"]
Jul 06 14:03:24.871855 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.871830    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:03:24.960776 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.960753    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.960877 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.960793    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w22g\" (UniqueName: \"kubernetes.io/projected/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-kube-api-access-6w22g\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.960877 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.960830    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.960877 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.960854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.960877 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.960871    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.961080 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.960890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.961217 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.961196    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.961272 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.961218    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.961359 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.961275    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.962920 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.962902    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.963277 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.963259    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:24.968358 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:24.968333    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w22g\" (UniqueName: \"kubernetes.io/projected/922b5ccd-d3d6-465a-a76d-5c2c96cc26c5-kube-api-access-6w22g\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x\" (UID: \"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:25.153680 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:25.153605    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:25.284098 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:25.284066    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"]
Jul 06 14:03:25.287572 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:03:25.287541    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod922b5ccd_d3d6_465a_a76d_5c2c96cc26c5.slice/crio-4b4fd7391cb578fac932e495ce14047572f8842ef0d71cfcac30e3bf4e71b9a1 WatchSource:0}: Error finding container 4b4fd7391cb578fac932e495ce14047572f8842ef0d71cfcac30e3bf4e71b9a1: Status 404 returned error can't find the container with id 4b4fd7391cb578fac932e495ce14047572f8842ef0d71cfcac30e3bf4e71b9a1
Jul 06 14:03:25.376523 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:25.376493    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:03:25.697155 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:25.697119    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x" event={"ID":"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5","Type":"ContainerStarted","Data":"315c02c9a8e419c3cf6b25b06c72aa6fe32ba9c22d780b4c2c69240e573d7325"}
Jul 06 14:03:25.697344 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:25.697162    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x" event={"ID":"922b5ccd-d3d6-465a-a76d-5c2c96cc26c5","Type":"ContainerStarted","Data":"4b4fd7391cb578fac932e495ce14047572f8842ef0d71cfcac30e3bf4e71b9a1"}
Jul 06 14:03:25.714923 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:25.714880    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x" podStartSLOduration=1.465708151 podStartE2EDuration="1.714866799s" totalImagesPullingTime="249.158648ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:03:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:03:25.713598782 +0000 UTC m=+792.757209818" watchObservedRunningTime="2026-07-06 14:03:25.714866799 +0000 UTC m=+792.758477872"
Jul 06 14:03:35.154167 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:35.154124    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:35.154167 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:35.154172    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:35.166312 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:35.166278    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:35.752024 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:35.751993    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x"
Jul 06 14:03:51.265940 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:03:51.265899    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:04:25.213064 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:04:25.213022    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:04:25.312449 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:04:25.312423    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:04:26.329989 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:04:26.329955    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:04:26.439142 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:04:26.439108    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:04:45.254398 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:04:45.254355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:04:46.918306 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:04:46.918247    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:04:47.018260 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:04:47.018234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:05:13.432522 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:13.432494    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 14:05:13.435915 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:13.435885    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 14:05:27.951921 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:27.951889    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:05:56.404911 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:56.404877    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:05:56.490960 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:56.490929    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ccc479c74-9f9tq"]
Jul 06 14:05:56.491140 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:56.491105    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-ccc479c74-9f9tq" podUID="be539433-a35f-41f2-aadc-1a9b5dc0c705" containerName="manager" containerID="cri-o://b142e955067ef91aa2884b96b9c9835a73909d86230784fae80bcd6f66fbff60" gracePeriod=30
Jul 06 14:05:56.743027 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:56.743005    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ccc479c74-9f9tq"
Jul 06 14:05:56.905690 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:56.905660    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be539433-a35f-41f2-aadc-1a9b5dc0c705-webhook-cert\") pod \"be539433-a35f-41f2-aadc-1a9b5dc0c705\" (UID: \"be539433-a35f-41f2-aadc-1a9b5dc0c705\") "
Jul 06 14:05:56.905851 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:56.905749    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxpb5\" (UniqueName: \"kubernetes.io/projected/be539433-a35f-41f2-aadc-1a9b5dc0c705-kube-api-access-nxpb5\") pod \"be539433-a35f-41f2-aadc-1a9b5dc0c705\" (UID: \"be539433-a35f-41f2-aadc-1a9b5dc0c705\") "
Jul 06 14:05:56.907642 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:56.907615    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be539433-a35f-41f2-aadc-1a9b5dc0c705-kube-api-access-nxpb5" (OuterVolumeSpecName: "kube-api-access-nxpb5") pod "be539433-a35f-41f2-aadc-1a9b5dc0c705" (UID: "be539433-a35f-41f2-aadc-1a9b5dc0c705"). InnerVolumeSpecName "kube-api-access-nxpb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:05:56.907767 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:56.907634    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be539433-a35f-41f2-aadc-1a9b5dc0c705-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "be539433-a35f-41f2-aadc-1a9b5dc0c705" (UID: "be539433-a35f-41f2-aadc-1a9b5dc0c705"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:05:57.006823 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:57.006802    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxpb5\" (UniqueName: \"kubernetes.io/projected/be539433-a35f-41f2-aadc-1a9b5dc0c705-kube-api-access-nxpb5\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:05:57.006823 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:57.006825    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be539433-a35f-41f2-aadc-1a9b5dc0c705-webhook-cert\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:05:57.410976 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:57.410946    2562 generic.go:356] "Generic (PLEG): container finished" podID="be539433-a35f-41f2-aadc-1a9b5dc0c705" containerID="b142e955067ef91aa2884b96b9c9835a73909d86230784fae80bcd6f66fbff60" exitCode=0
Jul 06 14:05:57.411375 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:57.410987    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ccc479c74-9f9tq"
Jul 06 14:05:57.411375 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:57.410988    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ccc479c74-9f9tq" event={"ID":"be539433-a35f-41f2-aadc-1a9b5dc0c705","Type":"ContainerDied","Data":"b142e955067ef91aa2884b96b9c9835a73909d86230784fae80bcd6f66fbff60"}
Jul 06 14:05:57.411375 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:57.411037    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ccc479c74-9f9tq" event={"ID":"be539433-a35f-41f2-aadc-1a9b5dc0c705","Type":"ContainerDied","Data":"41e124b260dc89f5afea175b656fe8413bc5003552e0dceef8d1e92d39e74758"}
Jul 06 14:05:57.411375 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:57.411061    2562 scope.go:117] "RemoveContainer" containerID="b142e955067ef91aa2884b96b9c9835a73909d86230784fae80bcd6f66fbff60"
Jul 06 14:05:57.420447 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:57.420434    2562 scope.go:117] "RemoveContainer" containerID="b142e955067ef91aa2884b96b9c9835a73909d86230784fae80bcd6f66fbff60"
Jul 06 14:05:57.420697 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:05:57.420679    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b142e955067ef91aa2884b96b9c9835a73909d86230784fae80bcd6f66fbff60\": container with ID starting with b142e955067ef91aa2884b96b9c9835a73909d86230784fae80bcd6f66fbff60 not found: ID does not exist" containerID="b142e955067ef91aa2884b96b9c9835a73909d86230784fae80bcd6f66fbff60"
Jul 06 14:05:57.420760 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:57.420704    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b142e955067ef91aa2884b96b9c9835a73909d86230784fae80bcd6f66fbff60"} err="failed to get container status \"b142e955067ef91aa2884b96b9c9835a73909d86230784fae80bcd6f66fbff60\": rpc error: code = NotFound desc = could not find container \"b142e955067ef91aa2884b96b9c9835a73909d86230784fae80bcd6f66fbff60\": container with ID starting with b142e955067ef91aa2884b96b9c9835a73909d86230784fae80bcd6f66fbff60 not found: ID does not exist"
Jul 06 14:05:57.431667 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:57.431645    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ccc479c74-9f9tq"]
Jul 06 14:05:57.435075 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:57.435057    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-ccc479c74-9f9tq"]
Jul 06 14:05:57.476997 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:57.476974    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be539433-a35f-41f2-aadc-1a9b5dc0c705" path="/var/lib/kubelet/pods/be539433-a35f-41f2-aadc-1a9b5dc0c705/volumes"
Jul 06 14:05:58.075032 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.075006    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:05:58.185336 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.185309    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-ccc479c74-ggsmn"]
Jul 06 14:05:58.185674 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.185658    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be539433-a35f-41f2-aadc-1a9b5dc0c705" containerName="manager"
Jul 06 14:05:58.185674 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.185674    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="be539433-a35f-41f2-aadc-1a9b5dc0c705" containerName="manager"
Jul 06 14:05:58.185779 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.185759    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="be539433-a35f-41f2-aadc-1a9b5dc0c705" containerName="manager"
Jul 06 14:05:58.190060 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.190043    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ccc479c74-ggsmn"
Jul 06 14:05:58.193828 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.193806    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 14:05:58.193929 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.193880    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cwfp7\""
Jul 06 14:05:58.193929 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.193913    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 14:05:58.199099 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.199077    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ccc479c74-ggsmn"]
Jul 06 14:05:58.315851 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.315825    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smqwh\" (UniqueName: \"kubernetes.io/projected/bb960442-b6e1-4207-8708-819bf1a4125a-kube-api-access-smqwh\") pod \"maas-controller-ccc479c74-ggsmn\" (UID: \"bb960442-b6e1-4207-8708-819bf1a4125a\") " pod="opendatahub/maas-controller-ccc479c74-ggsmn"
Jul 06 14:05:58.315980 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.315876    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb960442-b6e1-4207-8708-819bf1a4125a-webhook-cert\") pod \"maas-controller-ccc479c74-ggsmn\" (UID: \"bb960442-b6e1-4207-8708-819bf1a4125a\") " pod="opendatahub/maas-controller-ccc479c74-ggsmn"
Jul 06 14:05:58.416360 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.416251    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb960442-b6e1-4207-8708-819bf1a4125a-webhook-cert\") pod \"maas-controller-ccc479c74-ggsmn\" (UID: \"bb960442-b6e1-4207-8708-819bf1a4125a\") " pod="opendatahub/maas-controller-ccc479c74-ggsmn"
Jul 06 14:05:58.416771 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.416389    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smqwh\" (UniqueName: \"kubernetes.io/projected/bb960442-b6e1-4207-8708-819bf1a4125a-kube-api-access-smqwh\") pod \"maas-controller-ccc479c74-ggsmn\" (UID: \"bb960442-b6e1-4207-8708-819bf1a4125a\") " pod="opendatahub/maas-controller-ccc479c74-ggsmn"
Jul 06 14:05:58.418710 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.418682    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb960442-b6e1-4207-8708-819bf1a4125a-webhook-cert\") pod \"maas-controller-ccc479c74-ggsmn\" (UID: \"bb960442-b6e1-4207-8708-819bf1a4125a\") " pod="opendatahub/maas-controller-ccc479c74-ggsmn"
Jul 06 14:05:58.424868 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.424843    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smqwh\" (UniqueName: \"kubernetes.io/projected/bb960442-b6e1-4207-8708-819bf1a4125a-kube-api-access-smqwh\") pod \"maas-controller-ccc479c74-ggsmn\" (UID: \"bb960442-b6e1-4207-8708-819bf1a4125a\") " pod="opendatahub/maas-controller-ccc479c74-ggsmn"
Jul 06 14:05:58.501784 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.501762    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ccc479c74-ggsmn"
Jul 06 14:05:58.631884 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:58.631863    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ccc479c74-ggsmn"]
Jul 06 14:05:58.633802 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:05:58.633775    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb960442_b6e1_4207_8708_819bf1a4125a.slice/crio-0ecac18e365c8d3c93828f0b750150308b7aa4457796abfb6eeb12d04b277dd0 WatchSource:0}: Error finding container 0ecac18e365c8d3c93828f0b750150308b7aa4457796abfb6eeb12d04b277dd0: Status 404 returned error can't find the container with id 0ecac18e365c8d3c93828f0b750150308b7aa4457796abfb6eeb12d04b277dd0
Jul 06 14:05:59.423154 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:05:59.423120    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ccc479c74-ggsmn" event={"ID":"bb960442-b6e1-4207-8708-819bf1a4125a","Type":"ContainerStarted","Data":"0ecac18e365c8d3c93828f0b750150308b7aa4457796abfb6eeb12d04b277dd0"}
Jul 06 14:06:00.429377 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:06:00.429343    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ccc479c74-ggsmn" event={"ID":"bb960442-b6e1-4207-8708-819bf1a4125a","Type":"ContainerStarted","Data":"c389b46f4dbaa030b5a921f195a14e4435c763c05e0b64f11389f1a8d5be1035"}
Jul 06 14:06:00.429796 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:06:00.429481    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-ccc479c74-ggsmn"
Jul 06 14:06:00.460966 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:06:00.460919    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-ccc479c74-ggsmn" podStartSLOduration=1.271040075 podStartE2EDuration="2.460908235s" totalImagesPullingTime="1.18986816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:06:00.459073568 +0000 UTC m=+947.502684603" watchObservedRunningTime="2026-07-06 14:06:00.460908235 +0000 UTC m=+947.504519268"
Jul 06 14:06:11.441047 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:06:11.441016    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-ccc479c74-ggsmn"
Jul 06 14:06:37.735415 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:06:37.735335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:06:37.844711 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:06:37.844684    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:06:37.976263 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:06:37.976237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:06:44.485643 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:06:44.485590    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:06:44.601968 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:06:44.601936    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:06:44.689978 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:06:44.689947    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:06:44.835217 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:06:44.835155    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:06:50.950444 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:06:50.950407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:06:51.058508 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:06:51.058476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:09:55.755885 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:09:55.755855    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:09:58.100406 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:09:58.100372    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:10:06.316754 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:06.316710    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:10:06.600087 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:06.599991    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:10:06.703417 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:06.703375    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:10:13.462848 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:13.462820    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 14:10:13.463651 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:13.463625    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 14:10:44.072474 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:44.072442    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"]
Jul 06 14:10:44.073090 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:44.072650    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx" podUID="ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c" containerName="manager" containerID="cri-o://fdc04d07360fae9484a0f2688335cde496cac94965590116c1d2a5090f0378b3" gracePeriod=10
Jul 06 14:10:46.222754 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:46.222731    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"
Jul 06 14:10:46.280989 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:46.280927    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjnlw\" (UniqueName: \"kubernetes.io/projected/ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c-kube-api-access-fjnlw\") pod \"ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c\" (UID: \"ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c\") "
Jul 06 14:10:46.280989 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:46.280969    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c-extensions-socket-volume\") pod \"ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c\" (UID: \"ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c\") "
Jul 06 14:10:46.281384 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:46.281361    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c" (UID: "ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:10:46.282795 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:46.282771    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c-kube-api-access-fjnlw" (OuterVolumeSpecName: "kube-api-access-fjnlw") pod "ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c" (UID: "ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c"). InnerVolumeSpecName "kube-api-access-fjnlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:10:46.381979 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:46.381958    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjnlw\" (UniqueName: \"kubernetes.io/projected/ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c-kube-api-access-fjnlw\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:10:46.381979 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:46.381979    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c-extensions-socket-volume\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:10:46.767035 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:46.767005    2562 generic.go:356] "Generic (PLEG): container finished" podID="ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c" containerID="fdc04d07360fae9484a0f2688335cde496cac94965590116c1d2a5090f0378b3" exitCode=0
Jul 06 14:10:46.767143 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:46.767054    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"
Jul 06 14:10:46.767143 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:46.767064    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx" event={"ID":"ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c","Type":"ContainerDied","Data":"fdc04d07360fae9484a0f2688335cde496cac94965590116c1d2a5090f0378b3"}
Jul 06 14:10:46.767143 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:46.767108    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx" event={"ID":"ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c","Type":"ContainerDied","Data":"909ed4099f7fd93a73e0112980900919e27bd4753f9e1ab136aaeebcf25428f9"}
Jul 06 14:10:46.767143 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:46.767137    2562 scope.go:117] "RemoveContainer" containerID="fdc04d07360fae9484a0f2688335cde496cac94965590116c1d2a5090f0378b3"
Jul 06 14:10:46.776272 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:46.776255    2562 scope.go:117] "RemoveContainer" containerID="fdc04d07360fae9484a0f2688335cde496cac94965590116c1d2a5090f0378b3"
Jul 06 14:10:46.776559 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:10:46.776541    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdc04d07360fae9484a0f2688335cde496cac94965590116c1d2a5090f0378b3\": container with ID starting with fdc04d07360fae9484a0f2688335cde496cac94965590116c1d2a5090f0378b3 not found: ID does not exist" containerID="fdc04d07360fae9484a0f2688335cde496cac94965590116c1d2a5090f0378b3"
Jul 06 14:10:46.776610 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:46.776569    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdc04d07360fae9484a0f2688335cde496cac94965590116c1d2a5090f0378b3"} err="failed to get container status \"fdc04d07360fae9484a0f2688335cde496cac94965590116c1d2a5090f0378b3\": rpc error: code = NotFound desc = could not find container \"fdc04d07360fae9484a0f2688335cde496cac94965590116c1d2a5090f0378b3\": container with ID starting with fdc04d07360fae9484a0f2688335cde496cac94965590116c1d2a5090f0378b3 not found: ID does not exist"
Jul 06 14:10:46.788658 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:46.788634    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"]
Jul 06 14:10:46.794558 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:46.794539    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lfwnx"]
Jul 06 14:10:47.476608 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:10:47.476580    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c" path="/var/lib/kubelet/pods/ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c/volumes"
Jul 06 14:11:45.213403 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:45.213363    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hf48"]
Jul 06 14:11:45.213807 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:45.213751    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c" containerName="manager"
Jul 06 14:11:45.213807 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:45.213764    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c" containerName="manager"
Jul 06 14:11:45.213881 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:45.213829    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab6d9a7c-ea1d-484e-a672-ca2a281b9f3c" containerName="manager"
Jul 06 14:11:45.216767 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:45.216749    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hf48"
Jul 06 14:11:45.219328 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:45.219298    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-htt89\""
Jul 06 14:11:45.228091 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:45.228069    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hf48"]
Jul 06 14:11:45.315591 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:45.315556    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv26t\" (UniqueName: \"kubernetes.io/projected/93937712-cdfc-4c35-8e28-f3d51d5b34d7-kube-api-access-sv26t\") pod \"kuadrant-operator-controller-manager-86878c769f-7hf48\" (UID: \"93937712-cdfc-4c35-8e28-f3d51d5b34d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hf48"
Jul 06 14:11:45.315787 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:45.315700    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93937712-cdfc-4c35-8e28-f3d51d5b34d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7hf48\" (UID: \"93937712-cdfc-4c35-8e28-f3d51d5b34d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hf48"
Jul 06 14:11:45.416474 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:45.416439    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93937712-cdfc-4c35-8e28-f3d51d5b34d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7hf48\" (UID: \"93937712-cdfc-4c35-8e28-f3d51d5b34d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hf48"
Jul 06 14:11:45.416630 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:45.416485    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv26t\" (UniqueName: \"kubernetes.io/projected/93937712-cdfc-4c35-8e28-f3d51d5b34d7-kube-api-access-sv26t\") pod \"kuadrant-operator-controller-manager-86878c769f-7hf48\" (UID: \"93937712-cdfc-4c35-8e28-f3d51d5b34d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hf48"
Jul 06 14:11:45.416868 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:45.416849    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93937712-cdfc-4c35-8e28-f3d51d5b34d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7hf48\" (UID: \"93937712-cdfc-4c35-8e28-f3d51d5b34d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hf48"
Jul 06 14:11:45.424188 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:45.424163    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv26t\" (UniqueName: \"kubernetes.io/projected/93937712-cdfc-4c35-8e28-f3d51d5b34d7-kube-api-access-sv26t\") pod \"kuadrant-operator-controller-manager-86878c769f-7hf48\" (UID: \"93937712-cdfc-4c35-8e28-f3d51d5b34d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hf48"
Jul 06 14:11:45.527016 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:45.526943    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hf48"
Jul 06 14:11:45.661138 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:45.661083    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hf48"]
Jul 06 14:11:45.663636 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:11:45.663608    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93937712_cdfc_4c35_8e28_f3d51d5b34d7.slice/crio-b3e8bca95498dfc00069a5e42e853a06f2245bfa3bb5e7ef57b948d61bd5e9b5 WatchSource:0}: Error finding container b3e8bca95498dfc00069a5e42e853a06f2245bfa3bb5e7ef57b948d61bd5e9b5: Status 404 returned error can't find the container with id b3e8bca95498dfc00069a5e42e853a06f2245bfa3bb5e7ef57b948d61bd5e9b5
Jul 06 14:11:46.023064 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:46.023031    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hf48" event={"ID":"93937712-cdfc-4c35-8e28-f3d51d5b34d7","Type":"ContainerStarted","Data":"6662e0a1166ad2d904a057010f5ca750fdece03e7ca935a977642f3fa9ef8ac8"}
Jul 06 14:11:46.023239 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:46.023081    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hf48" event={"ID":"93937712-cdfc-4c35-8e28-f3d51d5b34d7","Type":"ContainerStarted","Data":"b3e8bca95498dfc00069a5e42e853a06f2245bfa3bb5e7ef57b948d61bd5e9b5"}
Jul 06 14:11:46.023239 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:46.023143    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hf48"
Jul 06 14:11:46.042392 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:46.042342    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hf48" podStartSLOduration=1.042325805 podStartE2EDuration="1.042325805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:11:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:11:46.041020634 +0000 UTC m=+1293.084631670" watchObservedRunningTime="2026-07-06 14:11:46.042325805 +0000 UTC m=+1293.085936843"
Jul 06 14:11:57.030413 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:11:57.030381    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hf48"
Jul 06 14:12:13.024805 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:12:13.024772    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:13:04.189358 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:13:04.189271    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:13:22.193064 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:13:22.193025    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:14:01.820577 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:14:01.820544    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:14:01.928476 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:14:01.928440    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:15:13.498974 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:15:13.498942    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 14:15:13.500264 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:15:13.500240    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 14:17:31.885642 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:31.885591    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:34.322431 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:34.322359    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:38.236153 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:38.236118    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:38.341001 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:38.340952    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:38.839076 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:38.839044    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:38.937588 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:38.937544    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:39.720758 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:39.720724    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:39.820994 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:39.820960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:39.931124 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:39.931089    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"]
Jul 06 14:17:39.935181 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:39.935157    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"
Jul 06 14:17:39.937357 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:39.937331    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-adf9a9af-serving-cert\""
Jul 06 14:17:39.942894 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:39.942514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl4g4\" (UniqueName: \"kubernetes.io/projected/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-kube-api-access-bl4g4\") pod \"maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d\" (UID: \"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c\") " pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"
Jul 06 14:17:39.942894 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:39.942617    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-openshift-service-ca\") pod \"maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d\" (UID: \"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c\") " pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"
Jul 06 14:17:39.942894 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:39.942682    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-maas-api-tls\") pod \"maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d\" (UID: \"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c\") " pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"
Jul 06 14:17:39.944333 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:39.944309    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"]
Jul 06 14:17:39.978340 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:39.978253    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:40.043577 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:40.043547    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-openshift-service-ca\") pod \"maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d\" (UID: \"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c\") " pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"
Jul 06 14:17:40.043719 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:40.043591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-maas-api-tls\") pod \"maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d\" (UID: \"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c\") " pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"
Jul 06 14:17:40.043719 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:40.043631    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl4g4\" (UniqueName: \"kubernetes.io/projected/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-kube-api-access-bl4g4\") pod \"maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d\" (UID: \"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c\") " pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"
Jul 06 14:17:40.043853 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:17:40.043746    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-adf9a9af-serving-cert: secret "maas-api-e2e-ait-adf9a9af-serving-cert" not found
Jul 06 14:17:40.043853 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:17:40.043817    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-maas-api-tls podName:0b0aaf5a-4be3-4b91-a17c-c1ae7547793c nodeName:}" failed. No retries permitted until 2026-07-06 14:17:40.543800546 +0000 UTC m=+1647.587411558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-maas-api-tls") pod "maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d" (UID: "0b0aaf5a-4be3-4b91-a17c-c1ae7547793c") : secret "maas-api-e2e-ait-adf9a9af-serving-cert" not found
Jul 06 14:17:40.044252 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:40.044228    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-openshift-service-ca\") pod \"maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d\" (UID: \"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c\") " pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"
Jul 06 14:17:40.052879 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:40.052858    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl4g4\" (UniqueName: \"kubernetes.io/projected/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-kube-api-access-bl4g4\") pod \"maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d\" (UID: \"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c\") " pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"
Jul 06 14:17:40.218991 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:40.218953    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:40.499275 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:40.499240    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:40.547850 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:40.547819    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-maas-api-tls\") pod \"maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d\" (UID: \"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c\") " pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"
Jul 06 14:17:40.550235 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:40.550215    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-maas-api-tls\") pod \"maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d\" (UID: \"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c\") " pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"
Jul 06 14:17:40.612411 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:40.612376    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:40.847407 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:40.847323    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"
Jul 06 14:17:40.989544 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:40.989521    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"]
Jul 06 14:17:40.991963 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:17:40.991935    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b0aaf5a_4be3_4b91_a17c_c1ae7547793c.slice/crio-4743c7f699f13737b09590b3c936db9f3536c65c3d148b69cc362a5e6c96eeca WatchSource:0}: Error finding container 4743c7f699f13737b09590b3c936db9f3536c65c3d148b69cc362a5e6c96eeca: Status 404 returned error can't find the container with id 4743c7f699f13737b09590b3c936db9f3536c65c3d148b69cc362a5e6c96eeca
Jul 06 14:17:40.993362 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:40.993342    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:17:41.685318 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:41.685266    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d" event={"ID":"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c","Type":"ContainerStarted","Data":"4743c7f699f13737b09590b3c936db9f3536c65c3d148b69cc362a5e6c96eeca"}
Jul 06 14:17:42.692172 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:42.692138    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d" event={"ID":"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c","Type":"ContainerStarted","Data":"2d9b826bf1b46e30a1d067ef81e61c1b34dbef18c263eea4f149545d81fe537d"}
Jul 06 14:17:42.692637 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:42.692311    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"
Jul 06 14:17:42.710777 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:42.710729    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d" podStartSLOduration=2.940249606 podStartE2EDuration="3.710711611s" totalImagesPullingTime="770.462005ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:17:42.710261648 +0000 UTC m=+1649.753872682" watchObservedRunningTime="2026-07-06 14:17:42.710711611 +0000 UTC m=+1649.754322646"
Jul 06 14:17:43.301583 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:43.301549    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:44.758001 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:44.757968    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:44.944896 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:44.944862    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:45.061041 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.060962    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:45.186453 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.186425    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"]
Jul 06 14:17:45.186651 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.186617    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d" podUID="0b0aaf5a-4be3-4b91-a17c-c1ae7547793c" containerName="maas-api" containerID="cri-o://2d9b826bf1b46e30a1d067ef81e61c1b34dbef18c263eea4f149545d81fe537d" gracePeriod=30
Jul 06 14:17:45.215745 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.215721    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:45.439229 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.439206    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"
Jul 06 14:17:45.490706 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.490676    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl4g4\" (UniqueName: \"kubernetes.io/projected/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-kube-api-access-bl4g4\") pod \"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c\" (UID: \"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c\") "
Jul 06 14:17:45.490864 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.490778    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-openshift-service-ca\") pod \"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c\" (UID: \"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c\") "
Jul 06 14:17:45.490864 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.490828    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-maas-api-tls\") pod \"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c\" (UID: \"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c\") "
Jul 06 14:17:45.491151 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.491130    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0b0aaf5a-4be3-4b91-a17c-c1ae7547793c" (UID: "0b0aaf5a-4be3-4b91-a17c-c1ae7547793c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:17:45.492799 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.492771    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0b0aaf5a-4be3-4b91-a17c-c1ae7547793c" (UID: "0b0aaf5a-4be3-4b91-a17c-c1ae7547793c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:45.492924 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.492827    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-kube-api-access-bl4g4" (OuterVolumeSpecName: "kube-api-access-bl4g4") pod "0b0aaf5a-4be3-4b91-a17c-c1ae7547793c" (UID: "0b0aaf5a-4be3-4b91-a17c-c1ae7547793c"). InnerVolumeSpecName "kube-api-access-bl4g4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:17:45.592209 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.592174    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl4g4\" (UniqueName: \"kubernetes.io/projected/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-kube-api-access-bl4g4\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:17:45.592348 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.592214    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-openshift-service-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:17:45.592348 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.592229    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c-maas-api-tls\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:17:45.709042 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.708997    2562 generic.go:356] "Generic (PLEG): container finished" podID="0b0aaf5a-4be3-4b91-a17c-c1ae7547793c" containerID="2d9b826bf1b46e30a1d067ef81e61c1b34dbef18c263eea4f149545d81fe537d" exitCode=0
Jul 06 14:17:45.709205 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.709064    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"
Jul 06 14:17:45.709205 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.709073    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d" event={"ID":"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c","Type":"ContainerDied","Data":"2d9b826bf1b46e30a1d067ef81e61c1b34dbef18c263eea4f149545d81fe537d"}
Jul 06 14:17:45.709205 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.709152    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d" event={"ID":"0b0aaf5a-4be3-4b91-a17c-c1ae7547793c","Type":"ContainerDied","Data":"4743c7f699f13737b09590b3c936db9f3536c65c3d148b69cc362a5e6c96eeca"}
Jul 06 14:17:45.709205 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.709184    2562 scope.go:117] "RemoveContainer" containerID="2d9b826bf1b46e30a1d067ef81e61c1b34dbef18c263eea4f149545d81fe537d"
Jul 06 14:17:45.718866 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.718846    2562 scope.go:117] "RemoveContainer" containerID="2d9b826bf1b46e30a1d067ef81e61c1b34dbef18c263eea4f149545d81fe537d"
Jul 06 14:17:45.719209 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:17:45.719182    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d9b826bf1b46e30a1d067ef81e61c1b34dbef18c263eea4f149545d81fe537d\": container with ID starting with 2d9b826bf1b46e30a1d067ef81e61c1b34dbef18c263eea4f149545d81fe537d not found: ID does not exist" containerID="2d9b826bf1b46e30a1d067ef81e61c1b34dbef18c263eea4f149545d81fe537d"
Jul 06 14:17:45.719366 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.719217    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d9b826bf1b46e30a1d067ef81e61c1b34dbef18c263eea4f149545d81fe537d"} err="failed to get container status \"2d9b826bf1b46e30a1d067ef81e61c1b34dbef18c263eea4f149545d81fe537d\": rpc error: code = NotFound desc = could not find container \"2d9b826bf1b46e30a1d067ef81e61c1b34dbef18c263eea4f149545d81fe537d\": container with ID starting with 2d9b826bf1b46e30a1d067ef81e61c1b34dbef18c263eea4f149545d81fe537d not found: ID does not exist"
Jul 06 14:17:45.732752 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.732727    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"]
Jul 06 14:17:45.736180 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:45.736160    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-adf9a9af-66fd88979-pnm8d"]
Jul 06 14:17:46.609159 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:46.609132    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:47.476894 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:47.476859    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b0aaf5a-4be3-4b91-a17c-c1ae7547793c" path="/var/lib/kubelet/pods/0b0aaf5a-4be3-4b91-a17c-c1ae7547793c/volumes"
Jul 06 14:17:51.136025 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:51.135990    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:51.338192 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:51.338159    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:51.438431 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:51.438341    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:51.564221 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:51.564184    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:51.669529 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:51.669502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:52.763201 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.763164    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:52.812326 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.812273    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"]
Jul 06 14:17:52.812879 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.812863    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b0aaf5a-4be3-4b91-a17c-c1ae7547793c" containerName="maas-api"
Jul 06 14:17:52.812922 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.812883    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b0aaf5a-4be3-4b91-a17c-c1ae7547793c" containerName="maas-api"
Jul 06 14:17:52.813002 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.812992    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b0aaf5a-4be3-4b91-a17c-c1ae7547793c" containerName="maas-api"
Jul 06 14:17:52.817555 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.817532    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"
Jul 06 14:17:52.819661 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.819640    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-9bc6d43e-serving-cert\""
Jul 06 14:17:52.827206 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.827172    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"]
Jul 06 14:17:52.853926 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.853899    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a25101f8-2e23-41b3-b101-85bd2a917de6-maas-api-tls\") pod \"maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm\" (UID: \"a25101f8-2e23-41b3-b101-85bd2a917de6\") " pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"
Jul 06 14:17:52.854036 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.853930    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4cng\" (UniqueName: \"kubernetes.io/projected/a25101f8-2e23-41b3-b101-85bd2a917de6-kube-api-access-f4cng\") pod \"maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm\" (UID: \"a25101f8-2e23-41b3-b101-85bd2a917de6\") " pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"
Jul 06 14:17:52.854036 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.853958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a25101f8-2e23-41b3-b101-85bd2a917de6-openshift-service-ca\") pod \"maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm\" (UID: \"a25101f8-2e23-41b3-b101-85bd2a917de6\") " pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"
Jul 06 14:17:52.862256 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.862228    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:52.954857 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.954820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a25101f8-2e23-41b3-b101-85bd2a917de6-maas-api-tls\") pod \"maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm\" (UID: \"a25101f8-2e23-41b3-b101-85bd2a917de6\") " pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"
Jul 06 14:17:52.954857 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.954858    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4cng\" (UniqueName: \"kubernetes.io/projected/a25101f8-2e23-41b3-b101-85bd2a917de6-kube-api-access-f4cng\") pod \"maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm\" (UID: \"a25101f8-2e23-41b3-b101-85bd2a917de6\") " pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"
Jul 06 14:17:52.955074 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.954889    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a25101f8-2e23-41b3-b101-85bd2a917de6-openshift-service-ca\") pod \"maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm\" (UID: \"a25101f8-2e23-41b3-b101-85bd2a917de6\") " pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"
Jul 06 14:17:52.955074 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:17:52.954977    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-9bc6d43e-serving-cert: secret "maas-api-e2e-ait-9bc6d43e-serving-cert" not found
Jul 06 14:17:52.955074 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:17:52.955059    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a25101f8-2e23-41b3-b101-85bd2a917de6-maas-api-tls podName:a25101f8-2e23-41b3-b101-85bd2a917de6 nodeName:}" failed. No retries permitted until 2026-07-06 14:17:53.455039731 +0000 UTC m=+1660.498650753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a25101f8-2e23-41b3-b101-85bd2a917de6-maas-api-tls") pod "maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm" (UID: "a25101f8-2e23-41b3-b101-85bd2a917de6") : secret "maas-api-e2e-ait-9bc6d43e-serving-cert" not found
Jul 06 14:17:52.955578 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.955561    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a25101f8-2e23-41b3-b101-85bd2a917de6-openshift-service-ca\") pod \"maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm\" (UID: \"a25101f8-2e23-41b3-b101-85bd2a917de6\") " pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"
Jul 06 14:17:52.965276 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.965246    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4cng\" (UniqueName: \"kubernetes.io/projected/a25101f8-2e23-41b3-b101-85bd2a917de6-kube-api-access-f4cng\") pod \"maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm\" (UID: \"a25101f8-2e23-41b3-b101-85bd2a917de6\") " pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"
Jul 06 14:17:52.966393 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:52.966364    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:53.452103 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:53.452071    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:53.459799 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:53.459774    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a25101f8-2e23-41b3-b101-85bd2a917de6-maas-api-tls\") pod \"maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm\" (UID: \"a25101f8-2e23-41b3-b101-85bd2a917de6\") " pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"
Jul 06 14:17:53.459923 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:17:53.459884    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-9bc6d43e-serving-cert: secret "maas-api-e2e-ait-9bc6d43e-serving-cert" not found
Jul 06 14:17:53.459960 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:17:53.459937    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a25101f8-2e23-41b3-b101-85bd2a917de6-maas-api-tls podName:a25101f8-2e23-41b3-b101-85bd2a917de6 nodeName:}" failed. No retries permitted until 2026-07-06 14:17:54.459925161 +0000 UTC m=+1661.503536173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a25101f8-2e23-41b3-b101-85bd2a917de6-maas-api-tls") pod "maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm" (UID: "a25101f8-2e23-41b3-b101-85bd2a917de6") : secret "maas-api-e2e-ait-9bc6d43e-serving-cert" not found
Jul 06 14:17:53.569682 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:53.569653    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:53.663377 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:53.663343    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:54.467401 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:54.467365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a25101f8-2e23-41b3-b101-85bd2a917de6-maas-api-tls\") pod \"maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm\" (UID: \"a25101f8-2e23-41b3-b101-85bd2a917de6\") " pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"
Jul 06 14:17:54.469720 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:54.469698    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a25101f8-2e23-41b3-b101-85bd2a917de6-maas-api-tls\") pod \"maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm\" (UID: \"a25101f8-2e23-41b3-b101-85bd2a917de6\") " pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"
Jul 06 14:17:54.630142 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:54.630111    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"
Jul 06 14:17:54.764225 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:54.764196    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"]
Jul 06 14:17:54.766887 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:17:54.766858    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda25101f8_2e23_41b3_b101_85bd2a917de6.slice/crio-f15b302cd8b47270e7a9c0d721ece0cad9748145a55f72b316a3069d268a7af9 WatchSource:0}: Error finding container f15b302cd8b47270e7a9c0d721ece0cad9748145a55f72b316a3069d268a7af9: Status 404 returned error can't find the container with id f15b302cd8b47270e7a9c0d721ece0cad9748145a55f72b316a3069d268a7af9
Jul 06 14:17:54.932207 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:54.932181    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:55.759450 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:55.759414    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm" event={"ID":"a25101f8-2e23-41b3-b101-85bd2a917de6","Type":"ContainerStarted","Data":"c0aec2fc1bc6ba95ed11f435582ffb9063f4864cf6a86fc88b3af41d83674a74"}
Jul 06 14:17:55.759828 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:55.759468    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm" event={"ID":"a25101f8-2e23-41b3-b101-85bd2a917de6","Type":"ContainerStarted","Data":"f15b302cd8b47270e7a9c0d721ece0cad9748145a55f72b316a3069d268a7af9"}
Jul 06 14:17:55.759828 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:55.759564    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"
Jul 06 14:17:55.785358 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:55.785313    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm" podStartSLOduration=3.239254757 podStartE2EDuration="3.7853006s" totalImagesPullingTime="546.045843ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:17:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:17:55.782422528 +0000 UTC m=+1662.826033562" watchObservedRunningTime="2026-07-06 14:17:55.7853006 +0000 UTC m=+1662.828911625"
Jul 06 14:17:57.863910 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:57.863878    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:58.166114 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.166026    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"]
Jul 06 14:17:58.166263 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.166242    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm" podUID="a25101f8-2e23-41b3-b101-85bd2a917de6" containerName="maas-api" containerID="cri-o://c0aec2fc1bc6ba95ed11f435582ffb9063f4864cf6a86fc88b3af41d83674a74" gracePeriod=30
Jul 06 14:17:58.193513 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.193484    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:17:58.414849 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.414828    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"
Jul 06 14:17:58.498931 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.498907    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a25101f8-2e23-41b3-b101-85bd2a917de6-maas-api-tls\") pod \"a25101f8-2e23-41b3-b101-85bd2a917de6\" (UID: \"a25101f8-2e23-41b3-b101-85bd2a917de6\") "
Jul 06 14:17:58.499099 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.498970    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a25101f8-2e23-41b3-b101-85bd2a917de6-openshift-service-ca\") pod \"a25101f8-2e23-41b3-b101-85bd2a917de6\" (UID: \"a25101f8-2e23-41b3-b101-85bd2a917de6\") "
Jul 06 14:17:58.499099 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.499004    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4cng\" (UniqueName: \"kubernetes.io/projected/a25101f8-2e23-41b3-b101-85bd2a917de6-kube-api-access-f4cng\") pod \"a25101f8-2e23-41b3-b101-85bd2a917de6\" (UID: \"a25101f8-2e23-41b3-b101-85bd2a917de6\") "
Jul 06 14:17:58.499602 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.499359    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a25101f8-2e23-41b3-b101-85bd2a917de6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a25101f8-2e23-41b3-b101-85bd2a917de6" (UID: "a25101f8-2e23-41b3-b101-85bd2a917de6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:17:58.499749 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.499692    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a25101f8-2e23-41b3-b101-85bd2a917de6-openshift-service-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.501105 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.501076    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a25101f8-2e23-41b3-b101-85bd2a917de6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a25101f8-2e23-41b3-b101-85bd2a917de6" (UID: "a25101f8-2e23-41b3-b101-85bd2a917de6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:58.501205 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.501191    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a25101f8-2e23-41b3-b101-85bd2a917de6-kube-api-access-f4cng" (OuterVolumeSpecName: "kube-api-access-f4cng") pod "a25101f8-2e23-41b3-b101-85bd2a917de6" (UID: "a25101f8-2e23-41b3-b101-85bd2a917de6"). InnerVolumeSpecName "kube-api-access-f4cng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:17:58.600995 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.600965    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a25101f8-2e23-41b3-b101-85bd2a917de6-maas-api-tls\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.600995 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.600994    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4cng\" (UniqueName: \"kubernetes.io/projected/a25101f8-2e23-41b3-b101-85bd2a917de6-kube-api-access-f4cng\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.774831 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.774742    2562 generic.go:356] "Generic (PLEG): container finished" podID="a25101f8-2e23-41b3-b101-85bd2a917de6" containerID="c0aec2fc1bc6ba95ed11f435582ffb9063f4864cf6a86fc88b3af41d83674a74" exitCode=0
Jul 06 14:17:58.774831 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.774792    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"
Jul 06 14:17:58.775038 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.774839    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm" event={"ID":"a25101f8-2e23-41b3-b101-85bd2a917de6","Type":"ContainerDied","Data":"c0aec2fc1bc6ba95ed11f435582ffb9063f4864cf6a86fc88b3af41d83674a74"}
Jul 06 14:17:58.775038 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.774895    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm" event={"ID":"a25101f8-2e23-41b3-b101-85bd2a917de6","Type":"ContainerDied","Data":"f15b302cd8b47270e7a9c0d721ece0cad9748145a55f72b316a3069d268a7af9"}
Jul 06 14:17:58.775038 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.774924    2562 scope.go:117] "RemoveContainer" containerID="c0aec2fc1bc6ba95ed11f435582ffb9063f4864cf6a86fc88b3af41d83674a74"
Jul 06 14:17:58.784247 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.784227    2562 scope.go:117] "RemoveContainer" containerID="c0aec2fc1bc6ba95ed11f435582ffb9063f4864cf6a86fc88b3af41d83674a74"
Jul 06 14:17:58.784551 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:17:58.784534    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0aec2fc1bc6ba95ed11f435582ffb9063f4864cf6a86fc88b3af41d83674a74\": container with ID starting with c0aec2fc1bc6ba95ed11f435582ffb9063f4864cf6a86fc88b3af41d83674a74 not found: ID does not exist" containerID="c0aec2fc1bc6ba95ed11f435582ffb9063f4864cf6a86fc88b3af41d83674a74"
Jul 06 14:17:58.784615 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.784558    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0aec2fc1bc6ba95ed11f435582ffb9063f4864cf6a86fc88b3af41d83674a74"} err="failed to get container status \"c0aec2fc1bc6ba95ed11f435582ffb9063f4864cf6a86fc88b3af41d83674a74\": rpc error: code = NotFound desc = could not find container \"c0aec2fc1bc6ba95ed11f435582ffb9063f4864cf6a86fc88b3af41d83674a74\": container with ID starting with c0aec2fc1bc6ba95ed11f435582ffb9063f4864cf6a86fc88b3af41d83674a74 not found: ID does not exist"
Jul 06 14:17:58.795490 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.795472    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"]
Jul 06 14:17:58.800700 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:58.800681    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-9bc6d43e-7ddfb95d4b-8czhm"]
Jul 06 14:17:59.476963 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:17:59.476932    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a25101f8-2e23-41b3-b101-85bd2a917de6" path="/var/lib/kubelet/pods/a25101f8-2e23-41b3-b101-85bd2a917de6/volumes"
Jul 06 14:18:04.238485 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:04.238451    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:04.339952 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:04.339922    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:05.923109 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:05.923076    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:10.500084 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:10.500052    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:10.588978 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:10.588945    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:10.877408 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:10.877373    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:10.970099 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:10.970070    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:12.070061 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.070027    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:12.139958 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.139927    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"]
Jul 06 14:18:12.140380 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.140364    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a25101f8-2e23-41b3-b101-85bd2a917de6" containerName="maas-api"
Jul 06 14:18:12.140463 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.140381    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a25101f8-2e23-41b3-b101-85bd2a917de6" containerName="maas-api"
Jul 06 14:18:12.140463 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.140452    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a25101f8-2e23-41b3-b101-85bd2a917de6" containerName="maas-api"
Jul 06 14:18:12.144709 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.144689    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"
Jul 06 14:18:12.146802 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.146779    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-b6f0103b-serving-cert\""
Jul 06 14:18:12.151807 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.151787    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"]
Jul 06 14:18:12.170442 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.170418    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:12.218728 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.218693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0b6223a-8546-418b-80d4-49ea2f38038b-openshift-service-ca\") pod \"maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn\" (UID: \"f0b6223a-8546-418b-80d4-49ea2f38038b\") " pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"
Jul 06 14:18:12.218879 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.218743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0b6223a-8546-418b-80d4-49ea2f38038b-maas-api-tls\") pod \"maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn\" (UID: \"f0b6223a-8546-418b-80d4-49ea2f38038b\") " pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"
Jul 06 14:18:12.218879 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.218763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l582x\" (UniqueName: \"kubernetes.io/projected/f0b6223a-8546-418b-80d4-49ea2f38038b-kube-api-access-l582x\") pod \"maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn\" (UID: \"f0b6223a-8546-418b-80d4-49ea2f38038b\") " pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"
Jul 06 14:18:12.271017 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.270981    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:12.319655 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.319620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0b6223a-8546-418b-80d4-49ea2f38038b-openshift-service-ca\") pod \"maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn\" (UID: \"f0b6223a-8546-418b-80d4-49ea2f38038b\") " pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"
Jul 06 14:18:12.319796 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.319673    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0b6223a-8546-418b-80d4-49ea2f38038b-maas-api-tls\") pod \"maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn\" (UID: \"f0b6223a-8546-418b-80d4-49ea2f38038b\") " pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"
Jul 06 14:18:12.319796 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.319701    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l582x\" (UniqueName: \"kubernetes.io/projected/f0b6223a-8546-418b-80d4-49ea2f38038b-kube-api-access-l582x\") pod \"maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn\" (UID: \"f0b6223a-8546-418b-80d4-49ea2f38038b\") " pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"
Jul 06 14:18:12.319796 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:18:12.319780    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-b6f0103b-serving-cert: secret "maas-api-e2e-derive-b6f0103b-serving-cert" not found
Jul 06 14:18:12.319978 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:18:12.319846    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b6223a-8546-418b-80d4-49ea2f38038b-maas-api-tls podName:f0b6223a-8546-418b-80d4-49ea2f38038b nodeName:}" failed. No retries permitted until 2026-07-06 14:18:12.819827573 +0000 UTC m=+1679.863438603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f0b6223a-8546-418b-80d4-49ea2f38038b-maas-api-tls") pod "maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn" (UID: "f0b6223a-8546-418b-80d4-49ea2f38038b") : secret "maas-api-e2e-derive-b6f0103b-serving-cert" not found
Jul 06 14:18:12.320316 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.320237    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0b6223a-8546-418b-80d4-49ea2f38038b-openshift-service-ca\") pod \"maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn\" (UID: \"f0b6223a-8546-418b-80d4-49ea2f38038b\") " pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"
Jul 06 14:18:12.327727 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.327700    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l582x\" (UniqueName: \"kubernetes.io/projected/f0b6223a-8546-418b-80d4-49ea2f38038b-kube-api-access-l582x\") pod \"maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn\" (UID: \"f0b6223a-8546-418b-80d4-49ea2f38038b\") " pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"
Jul 06 14:18:12.400777 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.400752    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:12.714162 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.714136    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:12.824622 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.824588    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0b6223a-8546-418b-80d4-49ea2f38038b-maas-api-tls\") pod \"maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn\" (UID: \"f0b6223a-8546-418b-80d4-49ea2f38038b\") " pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"
Jul 06 14:18:12.826973 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.826934    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0b6223a-8546-418b-80d4-49ea2f38038b-maas-api-tls\") pod \"maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn\" (UID: \"f0b6223a-8546-418b-80d4-49ea2f38038b\") " pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"
Jul 06 14:18:12.834302 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:12.834245    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:13.057262 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:13.057185    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"
Jul 06 14:18:13.190666 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:13.190633    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"]
Jul 06 14:18:13.192991 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:18:13.192960    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b6223a_8546_418b_80d4_49ea2f38038b.slice/crio-ee2b67f9af5e3770ef7a71961c24174532ebb1e4057ff3b3c8d7cc0df702e31c WatchSource:0}: Error finding container ee2b67f9af5e3770ef7a71961c24174532ebb1e4057ff3b3c8d7cc0df702e31c: Status 404 returned error can't find the container with id ee2b67f9af5e3770ef7a71961c24174532ebb1e4057ff3b3c8d7cc0df702e31c
Jul 06 14:18:13.848005 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:13.847920    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn" event={"ID":"f0b6223a-8546-418b-80d4-49ea2f38038b","Type":"ContainerStarted","Data":"50c09d6afd2628acdba279790d7126714d43ff3b9c483548ba99489db08d7f82"}
Jul 06 14:18:13.848005 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:13.847977    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn" event={"ID":"f0b6223a-8546-418b-80d4-49ea2f38038b","Type":"ContainerStarted","Data":"ee2b67f9af5e3770ef7a71961c24174532ebb1e4057ff3b3c8d7cc0df702e31c"}
Jul 06 14:18:13.848175 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:13.848028    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"
Jul 06 14:18:13.864604 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:13.864562    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn" podStartSLOduration=1.484466821 podStartE2EDuration="1.864548861s" totalImagesPullingTime="380.08204ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:18:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:18:13.86354198 +0000 UTC m=+1680.907153040" watchObservedRunningTime="2026-07-06 14:18:13.864548861 +0000 UTC m=+1680.908159894"
Jul 06 14:18:14.491975 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:14.491942    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:16.461809 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:16.461773    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:16.690789 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:16.690745    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:16.824963 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:16.824873    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"]
Jul 06 14:18:16.825136 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:16.825108    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn" podUID="f0b6223a-8546-418b-80d4-49ea2f38038b" containerName="maas-api" containerID="cri-o://50c09d6afd2628acdba279790d7126714d43ff3b9c483548ba99489db08d7f82" gracePeriod=30
Jul 06 14:18:16.954879 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:16.954850    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:17.072898 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.072873    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"
Jul 06 14:18:17.160450 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.160378    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0b6223a-8546-418b-80d4-49ea2f38038b-openshift-service-ca\") pod \"f0b6223a-8546-418b-80d4-49ea2f38038b\" (UID: \"f0b6223a-8546-418b-80d4-49ea2f38038b\") "
Jul 06 14:18:17.160581 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.160471    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0b6223a-8546-418b-80d4-49ea2f38038b-maas-api-tls\") pod \"f0b6223a-8546-418b-80d4-49ea2f38038b\" (UID: \"f0b6223a-8546-418b-80d4-49ea2f38038b\") "
Jul 06 14:18:17.160581 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.160541    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l582x\" (UniqueName: \"kubernetes.io/projected/f0b6223a-8546-418b-80d4-49ea2f38038b-kube-api-access-l582x\") pod \"f0b6223a-8546-418b-80d4-49ea2f38038b\" (UID: \"f0b6223a-8546-418b-80d4-49ea2f38038b\") "
Jul 06 14:18:17.160776 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.160755    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0b6223a-8546-418b-80d4-49ea2f38038b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f0b6223a-8546-418b-80d4-49ea2f38038b" (UID: "f0b6223a-8546-418b-80d4-49ea2f38038b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:18:17.162439 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.162408    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0b6223a-8546-418b-80d4-49ea2f38038b-kube-api-access-l582x" (OuterVolumeSpecName: "kube-api-access-l582x") pod "f0b6223a-8546-418b-80d4-49ea2f38038b" (UID: "f0b6223a-8546-418b-80d4-49ea2f38038b"). InnerVolumeSpecName "kube-api-access-l582x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:18:17.162554 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.162485    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0b6223a-8546-418b-80d4-49ea2f38038b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f0b6223a-8546-418b-80d4-49ea2f38038b" (UID: "f0b6223a-8546-418b-80d4-49ea2f38038b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:18:17.229850 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.229821    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:17.261238 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.261209    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0b6223a-8546-418b-80d4-49ea2f38038b-maas-api-tls\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:18:17.261238 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.261236    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l582x\" (UniqueName: \"kubernetes.io/projected/f0b6223a-8546-418b-80d4-49ea2f38038b-kube-api-access-l582x\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:18:17.261238 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.261246    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0b6223a-8546-418b-80d4-49ea2f38038b-openshift-service-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:18:17.868114 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.868017    2562 generic.go:356] "Generic (PLEG): container finished" podID="f0b6223a-8546-418b-80d4-49ea2f38038b" containerID="50c09d6afd2628acdba279790d7126714d43ff3b9c483548ba99489db08d7f82" exitCode=0
Jul 06 14:18:17.868114 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.868062    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"
Jul 06 14:18:17.868114 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.868105    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn" event={"ID":"f0b6223a-8546-418b-80d4-49ea2f38038b","Type":"ContainerDied","Data":"50c09d6afd2628acdba279790d7126714d43ff3b9c483548ba99489db08d7f82"}
Jul 06 14:18:17.868630 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.868151    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn" event={"ID":"f0b6223a-8546-418b-80d4-49ea2f38038b","Type":"ContainerDied","Data":"ee2b67f9af5e3770ef7a71961c24174532ebb1e4057ff3b3c8d7cc0df702e31c"}
Jul 06 14:18:17.868630 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.868173    2562 scope.go:117] "RemoveContainer" containerID="50c09d6afd2628acdba279790d7126714d43ff3b9c483548ba99489db08d7f82"
Jul 06 14:18:17.876544 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.876520    2562 scope.go:117] "RemoveContainer" containerID="50c09d6afd2628acdba279790d7126714d43ff3b9c483548ba99489db08d7f82"
Jul 06 14:18:17.876780 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:18:17.876761    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50c09d6afd2628acdba279790d7126714d43ff3b9c483548ba99489db08d7f82\": container with ID starting with 50c09d6afd2628acdba279790d7126714d43ff3b9c483548ba99489db08d7f82 not found: ID does not exist" containerID="50c09d6afd2628acdba279790d7126714d43ff3b9c483548ba99489db08d7f82"
Jul 06 14:18:17.876848 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.876790    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c09d6afd2628acdba279790d7126714d43ff3b9c483548ba99489db08d7f82"} err="failed to get container status \"50c09d6afd2628acdba279790d7126714d43ff3b9c483548ba99489db08d7f82\": rpc error: code = NotFound desc = could not find container \"50c09d6afd2628acdba279790d7126714d43ff3b9c483548ba99489db08d7f82\": container with ID starting with 50c09d6afd2628acdba279790d7126714d43ff3b9c483548ba99489db08d7f82 not found: ID does not exist"
Jul 06 14:18:17.885536 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.885515    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"]
Jul 06 14:18:17.889294 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:17.889266    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-b6f0103b-5b5b4fc88f-fh5gn"]
Jul 06 14:18:18.317811 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:18.317778    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:19.477782 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:19.477749    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0b6223a-8546-418b-80d4-49ea2f38038b" path="/var/lib/kubelet/pods/f0b6223a-8546-418b-80d4-49ea2f38038b/volumes"
Jul 06 14:18:23.146607 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:23.146575    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:23.282095 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:23.282060    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:23.407066 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:23.406985    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:24.812724 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:24.812695    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:30.935821 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:30.935787    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:31.047576 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:31.047539    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:31.152475 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:31.152448    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:31.250863 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:31.250834    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:31.621574 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:31.621492    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:18:57.566925 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:18:57.566886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:03.991755 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:03.991720    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:04.091980 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:04.091952    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:04.194207 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:04.194183    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:20.081436 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:20.081404    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:26.516700 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:26.516663    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:26.619170 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:26.619140    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:26.720487 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:26.720451    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:37.240965 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:37.240928    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:38.058267 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:38.058230    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:38.572703 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:38.572673    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:38.672646 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:38.672619    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:44.651767 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:44.651732    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:44.751642 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:44.751611    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:44.849302 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:44.849244    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:44.949608 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:44.949535    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:45.782965 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:45.782929    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:45.879607 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:45.879574    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:45.980170 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:45.980142    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:47.635721 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:47.635693    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:53.776258 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:53.776228    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:53.878129 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:53.878100    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:19:54.511815 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:19:54.511784    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:01.036789 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:01.036753    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:01.138338 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:01.138303    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:01.303849 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:01.303780    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:01.673005 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:01.672920    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:01.861738 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:01.861704    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:04.507437 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.507400    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:04.589940 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.589908    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"]
Jul 06 14:20:04.590303 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.590272    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0b6223a-8546-418b-80d4-49ea2f38038b" containerName="maas-api"
Jul 06 14:20:04.590354 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.590313    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0b6223a-8546-418b-80d4-49ea2f38038b" containerName="maas-api"
Jul 06 14:20:04.590390 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.590385    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0b6223a-8546-418b-80d4-49ea2f38038b" containerName="maas-api"
Jul 06 14:20:04.593337 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.593317    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"
Jul 06 14:20:04.594690 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.594668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:04.595448 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.595430    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-76ad21e4-serving-cert\""
Jul 06 14:20:04.604463 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.604433    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"]
Jul 06 14:20:04.680270 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.680245    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:04.693499 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.693469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-maas-api-tls\") pod \"maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8\" (UID: \"e8ea7fce-c1e5-4152-8e37-f8d2fc681a08\") " pod="opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"
Jul 06 14:20:04.693624 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.693535    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-openshift-service-ca\") pod \"maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8\" (UID: \"e8ea7fce-c1e5-4152-8e37-f8d2fc681a08\") " pod="opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"
Jul 06 14:20:04.693624 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.693616    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-692rt\" (UniqueName: \"kubernetes.io/projected/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-kube-api-access-692rt\") pod \"maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8\" (UID: \"e8ea7fce-c1e5-4152-8e37-f8d2fc681a08\") " pod="opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"
Jul 06 14:20:04.794214 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.794131    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-openshift-service-ca\") pod \"maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8\" (UID: \"e8ea7fce-c1e5-4152-8e37-f8d2fc681a08\") " pod="opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"
Jul 06 14:20:04.794214 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.794190    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-692rt\" (UniqueName: \"kubernetes.io/projected/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-kube-api-access-692rt\") pod \"maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8\" (UID: \"e8ea7fce-c1e5-4152-8e37-f8d2fc681a08\") " pod="opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"
Jul 06 14:20:04.794423 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.794249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-maas-api-tls\") pod \"maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8\" (UID: \"e8ea7fce-c1e5-4152-8e37-f8d2fc681a08\") " pod="opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"
Jul 06 14:20:04.794878 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.794859    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-openshift-service-ca\") pod \"maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8\" (UID: \"e8ea7fce-c1e5-4152-8e37-f8d2fc681a08\") " pod="opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"
Jul 06 14:20:04.796806 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.796783    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-maas-api-tls\") pod \"maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8\" (UID: \"e8ea7fce-c1e5-4152-8e37-f8d2fc681a08\") " pod="opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"
Jul 06 14:20:04.802824 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.802794    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-692rt\" (UniqueName: \"kubernetes.io/projected/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-kube-api-access-692rt\") pod \"maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8\" (UID: \"e8ea7fce-c1e5-4152-8e37-f8d2fc681a08\") " pod="opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"
Jul 06 14:20:04.849365 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.849343    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:04.903822 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:04.903798    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"
Jul 06 14:20:05.038722 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:05.038700    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"]
Jul 06 14:20:05.041215 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:20:05.041189    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ea7fce_c1e5_4152_8e37_f8d2fc681a08.slice/crio-dc2f92fb2484864b64e182b35ced061ee8eeff0d097d1244eba22ec6dab8f291 WatchSource:0}: Error finding container dc2f92fb2484864b64e182b35ced061ee8eeff0d097d1244eba22ec6dab8f291: Status 404 returned error can't find the container with id dc2f92fb2484864b64e182b35ced061ee8eeff0d097d1244eba22ec6dab8f291
Jul 06 14:20:05.365908 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:05.365822    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8" event={"ID":"e8ea7fce-c1e5-4152-8e37-f8d2fc681a08","Type":"ContainerStarted","Data":"dc2f92fb2484864b64e182b35ced061ee8eeff0d097d1244eba22ec6dab8f291"}
Jul 06 14:20:05.440213 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:05.440182    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:05.532772 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:05.532723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:07.679690 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:07.679607    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:07.739493 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:07.739465    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:09.028401 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:09.028368    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:09.710382 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:09.710347    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:09.807164 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:09.807128    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:10.208247 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:10.208218    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:13.524704 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:13.524678    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 14:20:13.527301 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:13.527263    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 14:20:16.005392 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:20:16.005347    2562 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \"https://s3.us-east-1.amazonaws.com/quayio-production-s3/sha256/52/5268ecf21a1bc96f7230ad1b338ecf5766cb1e3b763d3e720874aaa592f71e2a?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260706%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260706T142005Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=03f2b4fa001babda27928e4a7d86e8b3450e7e36512c46752dbe0b9ac96aef6a\": net/http: TLS handshake timeout; artifact err: provided artifact is a container image" image="quay.io/opendatahub/maas-api@sha256:a2fbd376a3d9b269a642113dddc75f53a1adedac293a4b83aea43cb8962cdfd2"
Jul 06 14:20:16.005738 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:20:16.005472    2562 kuberuntime_manager.go:1459] "Unhandled Error" err="container maas-api start failed in pod maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8_opendatahub(e8ea7fce-c1e5-4152-8e37-f8d2fc681a08): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \"https://s3.us-east-1.amazonaws.com/quayio-production-s3/sha256/52/5268ecf21a1bc96f7230ad1b338ecf5766cb1e3b763d3e720874aaa592f71e2a?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260706%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260706T142005Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=03f2b4fa001babda27928e4a7d86e8b3450e7e36512c46752dbe0b9ac96aef6a\": net/http: TLS handshake timeout; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 06 14:20:16.005738 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:20:16.005511    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \\\"https://s3.us-east-1.amazonaws.com/quayio-production-s3/sha256/52/5268ecf21a1bc96f7230ad1b338ecf5766cb1e3b763d3e720874aaa592f71e2a?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260706%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260706T142005Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=03f2b4fa001babda27928e4a7d86e8b3450e7e36512c46752dbe0b9ac96aef6a\\\": net/http: TLS handshake timeout; artifact err: provided artifact is a container image\"" pod="opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8" podUID="e8ea7fce-c1e5-4152-8e37-f8d2fc681a08"
Jul 06 14:20:16.415388 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:20:16.415271    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/maas-api@sha256:a2fbd376a3d9b269a642113dddc75f53a1adedac293a4b83aea43cb8962cdfd2\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \\\"https://s3.us-east-1.amazonaws.com/quayio-production-s3/sha256/52/5268ecf21a1bc96f7230ad1b338ecf5766cb1e3b763d3e720874aaa592f71e2a?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260706%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260706T142005Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=03f2b4fa001babda27928e4a7d86e8b3450e7e36512c46752dbe0b9ac96aef6a\\\": net/http: TLS handshake timeout; artifact err: provided artifact is a container image\"" pod="opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8" podUID="e8ea7fce-c1e5-4152-8e37-f8d2fc681a08"
Jul 06 14:20:17.556126 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:17.556094    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:17.656821 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:17.656789    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:18.082544 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:18.082485    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:18.444757 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:18.444682    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"]
Jul 06 14:20:18.468131 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:18.468098    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:18.546708 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:18.546672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:18.569131 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:18.569108    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"
Jul 06 14:20:18.609294 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:18.609264    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-openshift-service-ca\") pod \"e8ea7fce-c1e5-4152-8e37-f8d2fc681a08\" (UID: \"e8ea7fce-c1e5-4152-8e37-f8d2fc681a08\") "
Jul 06 14:20:18.609428 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:18.609367    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-692rt\" (UniqueName: \"kubernetes.io/projected/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-kube-api-access-692rt\") pod \"e8ea7fce-c1e5-4152-8e37-f8d2fc681a08\" (UID: \"e8ea7fce-c1e5-4152-8e37-f8d2fc681a08\") "
Jul 06 14:20:18.609428 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:18.609411    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-maas-api-tls\") pod \"e8ea7fce-c1e5-4152-8e37-f8d2fc681a08\" (UID: \"e8ea7fce-c1e5-4152-8e37-f8d2fc681a08\") "
Jul 06 14:20:18.609613 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:18.609592    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e8ea7fce-c1e5-4152-8e37-f8d2fc681a08" (UID: "e8ea7fce-c1e5-4152-8e37-f8d2fc681a08"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:20:18.611232 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:18.611212    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-kube-api-access-692rt" (OuterVolumeSpecName: "kube-api-access-692rt") pod "e8ea7fce-c1e5-4152-8e37-f8d2fc681a08" (UID: "e8ea7fce-c1e5-4152-8e37-f8d2fc681a08"). InnerVolumeSpecName "kube-api-access-692rt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:20:18.611375 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:18.611351    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e8ea7fce-c1e5-4152-8e37-f8d2fc681a08" (UID: "e8ea7fce-c1e5-4152-8e37-f8d2fc681a08"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:20:18.710230 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:18.710210    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-openshift-service-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:20:18.710230 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:18.710230    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-692rt\" (UniqueName: \"kubernetes.io/projected/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-kube-api-access-692rt\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:20:18.710413 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:18.710238    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08-maas-api-tls\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:20:19.437935 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:19.437899    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8" event={"ID":"e8ea7fce-c1e5-4152-8e37-f8d2fc681a08","Type":"ContainerDied","Data":"dc2f92fb2484864b64e182b35ced061ee8eeff0d097d1244eba22ec6dab8f291"}
Jul 06 14:20:19.438146 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:19.437909    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"
Jul 06 14:20:19.477583 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:19.477558    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"]
Jul 06 14:20:19.477583 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:19.477590    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-76ad21e4-bbf47674f-vprp8"]
Jul 06 14:20:21.477620 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:21.477587    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8ea7fce-c1e5-4152-8e37-f8d2fc681a08" path="/var/lib/kubelet/pods/e8ea7fce-c1e5-4152-8e37-f8d2fc681a08/volumes"
Jul 06 14:20:25.353962 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:25.353930    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:25.480194 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:25.480165    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:25.656604 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:25.656524    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:25.822216 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:25.822184    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:25.957968 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:25.957926    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:26.050096 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:26.050067    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:26.149704 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:26.149675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:32.320475 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:32.320442    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:32.427205 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:32.427149    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:32.520672 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:32.520643    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:32.734132 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:32.734101    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:38.884811 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:38.884778    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:38.943986 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:38.943952    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:45.648977 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:45.648944    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:45.951012 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:45.950931    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:46.223313 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:46.223195    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:48.588502 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.588462    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:48.667137 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.667109    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"]
Jul 06 14:20:48.670499 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.670474    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"
Jul 06 14:20:48.673496 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.673473    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-2b745686-serving-cert\""
Jul 06 14:20:48.687001 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.686979    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"]
Jul 06 14:20:48.696759 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.696735    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:48.756942 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.756869    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw262\" (UniqueName: \"kubernetes.io/projected/27cb895a-a897-46b5-a8c7-bd5089a2166c-kube-api-access-sw262\") pod \"maas-api-e2e-mt-2b745686-758b586687-fjbvx\" (UID: \"27cb895a-a897-46b5-a8c7-bd5089a2166c\") " pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"
Jul 06 14:20:48.756942 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.756913    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27cb895a-a897-46b5-a8c7-bd5089a2166c-maas-api-tls\") pod \"maas-api-e2e-mt-2b745686-758b586687-fjbvx\" (UID: \"27cb895a-a897-46b5-a8c7-bd5089a2166c\") " pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"
Jul 06 14:20:48.756942 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.756938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27cb895a-a897-46b5-a8c7-bd5089a2166c-openshift-service-ca\") pod \"maas-api-e2e-mt-2b745686-758b586687-fjbvx\" (UID: \"27cb895a-a897-46b5-a8c7-bd5089a2166c\") " pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"
Jul 06 14:20:48.797950 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.797920    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:48.857736 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.857708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw262\" (UniqueName: \"kubernetes.io/projected/27cb895a-a897-46b5-a8c7-bd5089a2166c-kube-api-access-sw262\") pod \"maas-api-e2e-mt-2b745686-758b586687-fjbvx\" (UID: \"27cb895a-a897-46b5-a8c7-bd5089a2166c\") " pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"
Jul 06 14:20:48.857876 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.857754    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27cb895a-a897-46b5-a8c7-bd5089a2166c-maas-api-tls\") pod \"maas-api-e2e-mt-2b745686-758b586687-fjbvx\" (UID: \"27cb895a-a897-46b5-a8c7-bd5089a2166c\") " pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"
Jul 06 14:20:48.857876 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.857786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27cb895a-a897-46b5-a8c7-bd5089a2166c-openshift-service-ca\") pod \"maas-api-e2e-mt-2b745686-758b586687-fjbvx\" (UID: \"27cb895a-a897-46b5-a8c7-bd5089a2166c\") " pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"
Jul 06 14:20:48.858463 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.858447    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27cb895a-a897-46b5-a8c7-bd5089a2166c-openshift-service-ca\") pod \"maas-api-e2e-mt-2b745686-758b586687-fjbvx\" (UID: \"27cb895a-a897-46b5-a8c7-bd5089a2166c\") " pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"
Jul 06 14:20:48.860127 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.860111    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27cb895a-a897-46b5-a8c7-bd5089a2166c-maas-api-tls\") pod \"maas-api-e2e-mt-2b745686-758b586687-fjbvx\" (UID: \"27cb895a-a897-46b5-a8c7-bd5089a2166c\") " pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"
Jul 06 14:20:48.874775 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.874757    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw262\" (UniqueName: \"kubernetes.io/projected/27cb895a-a897-46b5-a8c7-bd5089a2166c-kube-api-access-sw262\") pod \"maas-api-e2e-mt-2b745686-758b586687-fjbvx\" (UID: \"27cb895a-a897-46b5-a8c7-bd5089a2166c\") " pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"
Jul 06 14:20:48.917135 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.917107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:48.981240 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:48.981219    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"
Jul 06 14:20:49.131434 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:49.131413    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"]
Jul 06 14:20:49.134095 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:20:49.134066    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27cb895a_a897_46b5_a8c7_bd5089a2166c.slice/crio-2314ad61f3f1d29a0af5da86d88a0f4b3795dcfa9b062506c1785993c7cd2f52 WatchSource:0}: Error finding container 2314ad61f3f1d29a0af5da86d88a0f4b3795dcfa9b062506c1785993c7cd2f52: Status 404 returned error can't find the container with id 2314ad61f3f1d29a0af5da86d88a0f4b3795dcfa9b062506c1785993c7cd2f52
Jul 06 14:20:49.381378 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:49.381271    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:49.547898 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:49.547863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:49.580637 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:49.580603    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx" event={"ID":"27cb895a-a897-46b5-a8c7-bd5089a2166c","Type":"ContainerStarted","Data":"2314ad61f3f1d29a0af5da86d88a0f4b3795dcfa9b062506c1785993c7cd2f52"}
Jul 06 14:20:50.587783 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:50.587749    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx" event={"ID":"27cb895a-a897-46b5-a8c7-bd5089a2166c","Type":"ContainerStarted","Data":"28b5742ae8551befa9a04e3e0e11af8cdf74fbbd372fff7d9c07dc693b1fd385"}
Jul 06 14:20:50.588218 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:50.587893    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"
Jul 06 14:20:50.608026 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:50.607981    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx" podStartSLOduration=2.03721419 podStartE2EDuration="2.607963943s" totalImagesPullingTime="570.749753ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:20:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:50.605944182 +0000 UTC m=+1837.649555225" watchObservedRunningTime="2026-07-06 14:20:50.607963943 +0000 UTC m=+1837.651574976"
Jul 06 14:20:53.037947 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:53.037920    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:20:56.599491 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:20:56.599458    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"
Jul 06 14:21:06.694051 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:06.694015    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:21:20.019551 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:20.019511    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:21:20.121644 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:20.121613    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:21:30.557030 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:30.556995    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:21:31.063174 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.063142    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:21:31.166848 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.166813    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:21:31.167214 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.167190    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"]
Jul 06 14:21:31.167488 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.167458    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx" podUID="27cb895a-a897-46b5-a8c7-bd5089a2166c" containerName="maas-api" containerID="cri-o://28b5742ae8551befa9a04e3e0e11af8cdf74fbbd372fff7d9c07dc693b1fd385" gracePeriod=30
Jul 06 14:21:31.233182 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.233160    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:21:31.412852 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.412831    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"
Jul 06 14:21:31.503032 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.503002    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sw262\" (UniqueName: \"kubernetes.io/projected/27cb895a-a897-46b5-a8c7-bd5089a2166c-kube-api-access-sw262\") pod \"27cb895a-a897-46b5-a8c7-bd5089a2166c\" (UID: \"27cb895a-a897-46b5-a8c7-bd5089a2166c\") "
Jul 06 14:21:31.503189 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.503046    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27cb895a-a897-46b5-a8c7-bd5089a2166c-openshift-service-ca\") pod \"27cb895a-a897-46b5-a8c7-bd5089a2166c\" (UID: \"27cb895a-a897-46b5-a8c7-bd5089a2166c\") "
Jul 06 14:21:31.503189 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.503082    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27cb895a-a897-46b5-a8c7-bd5089a2166c-maas-api-tls\") pod \"27cb895a-a897-46b5-a8c7-bd5089a2166c\" (UID: \"27cb895a-a897-46b5-a8c7-bd5089a2166c\") "
Jul 06 14:21:31.503460 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.503432    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27cb895a-a897-46b5-a8c7-bd5089a2166c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "27cb895a-a897-46b5-a8c7-bd5089a2166c" (UID: "27cb895a-a897-46b5-a8c7-bd5089a2166c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:21:31.505164 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.505142    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27cb895a-a897-46b5-a8c7-bd5089a2166c-kube-api-access-sw262" (OuterVolumeSpecName: "kube-api-access-sw262") pod "27cb895a-a897-46b5-a8c7-bd5089a2166c" (UID: "27cb895a-a897-46b5-a8c7-bd5089a2166c"). InnerVolumeSpecName "kube-api-access-sw262". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:21:31.505388 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.505362    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27cb895a-a897-46b5-a8c7-bd5089a2166c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "27cb895a-a897-46b5-a8c7-bd5089a2166c" (UID: "27cb895a-a897-46b5-a8c7-bd5089a2166c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:21:31.604662 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.604585    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sw262\" (UniqueName: \"kubernetes.io/projected/27cb895a-a897-46b5-a8c7-bd5089a2166c-kube-api-access-sw262\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:21:31.605005 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.604676    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27cb895a-a897-46b5-a8c7-bd5089a2166c-openshift-service-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:21:31.605005 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.604734    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27cb895a-a897-46b5-a8c7-bd5089a2166c-maas-api-tls\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:21:31.786337 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.786301    2562 generic.go:356] "Generic (PLEG): container finished" podID="27cb895a-a897-46b5-a8c7-bd5089a2166c" containerID="28b5742ae8551befa9a04e3e0e11af8cdf74fbbd372fff7d9c07dc693b1fd385" exitCode=0
Jul 06 14:21:31.786487 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.786354    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"
Jul 06 14:21:31.786487 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.786362    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx" event={"ID":"27cb895a-a897-46b5-a8c7-bd5089a2166c","Type":"ContainerDied","Data":"28b5742ae8551befa9a04e3e0e11af8cdf74fbbd372fff7d9c07dc693b1fd385"}
Jul 06 14:21:31.786487 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.786416    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx" event={"ID":"27cb895a-a897-46b5-a8c7-bd5089a2166c","Type":"ContainerDied","Data":"2314ad61f3f1d29a0af5da86d88a0f4b3795dcfa9b062506c1785993c7cd2f52"}
Jul 06 14:21:31.786487 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.786447    2562 scope.go:117] "RemoveContainer" containerID="28b5742ae8551befa9a04e3e0e11af8cdf74fbbd372fff7d9c07dc693b1fd385"
Jul 06 14:21:31.795468 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.795450    2562 scope.go:117] "RemoveContainer" containerID="28b5742ae8551befa9a04e3e0e11af8cdf74fbbd372fff7d9c07dc693b1fd385"
Jul 06 14:21:31.795738 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:21:31.795716    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28b5742ae8551befa9a04e3e0e11af8cdf74fbbd372fff7d9c07dc693b1fd385\": container with ID starting with 28b5742ae8551befa9a04e3e0e11af8cdf74fbbd372fff7d9c07dc693b1fd385 not found: ID does not exist" containerID="28b5742ae8551befa9a04e3e0e11af8cdf74fbbd372fff7d9c07dc693b1fd385"
Jul 06 14:21:31.795845 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.795745    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b5742ae8551befa9a04e3e0e11af8cdf74fbbd372fff7d9c07dc693b1fd385"} err="failed to get container status \"28b5742ae8551befa9a04e3e0e11af8cdf74fbbd372fff7d9c07dc693b1fd385\": rpc error: code = NotFound desc = could not find container \"28b5742ae8551befa9a04e3e0e11af8cdf74fbbd372fff7d9c07dc693b1fd385\": container with ID starting with 28b5742ae8551befa9a04e3e0e11af8cdf74fbbd372fff7d9c07dc693b1fd385 not found: ID does not exist"
Jul 06 14:21:31.807009 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.806985    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"]
Jul 06 14:21:31.810466 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:31.810448    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-2b745686-758b586687-fjbvx"]
Jul 06 14:21:33.478754 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:33.478718    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27cb895a-a897-46b5-a8c7-bd5089a2166c" path="/var/lib/kubelet/pods/27cb895a-a897-46b5-a8c7-bd5089a2166c/volumes"
Jul 06 14:21:36.578209 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:36.578131    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:21:41.607851 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:21:41.607817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:19.390315 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:19.390255    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:19.525412 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:19.525382    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:25.678515 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:25.678478    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:31.716438 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:31.716401    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:31.817636 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:31.817602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:31.996352 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:31.996219    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:32.223024 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:32.222981    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:33.287857 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:33.287794    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:33.382934 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:33.382900    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:33.481381 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:33.481352    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:34.239678 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:34.239640    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:35.346754 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:35.346718    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:35.703212 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:35.703180    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:42.830510 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:42.830477    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:42.929815 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:42.929784    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:43.481851 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:43.481797    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:49.642157 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:49.642127    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:49.712865 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:49.712833    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:22:49.784853 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:22:49.784818    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:00.400869 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:00.400833    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:00.724472 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:00.724446    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:21.651061 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:21.650989    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:28.192966 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:28.192929    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:28.348050 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:28.348013    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:28.545718 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:28.545686    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:28.839885 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:28.839808    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:29.079734 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:29.079696    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:31.472050 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.472005    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:31.537537 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.537508    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"]
Jul 06 14:23:31.537904 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.537891    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27cb895a-a897-46b5-a8c7-bd5089a2166c" containerName="maas-api"
Jul 06 14:23:31.537949 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.537906    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="27cb895a-a897-46b5-a8c7-bd5089a2166c" containerName="maas-api"
Jul 06 14:23:31.537994 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.537971    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="27cb895a-a897-46b5-a8c7-bd5089a2166c" containerName="maas-api"
Jul 06 14:23:31.546947 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.546920    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"
Jul 06 14:23:31.548728 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.548701    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"]
Jul 06 14:23:31.548997 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.548976    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-2b44a1-serving-cert\""
Jul 06 14:23:31.551434 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.551413    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:31.620936 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.620903    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:31.695637 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.695605    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c876d8c-d94b-44a5-9348-709ced870719-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q\" (UID: \"6c876d8c-d94b-44a5-9348-709ced870719\") " pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"
Jul 06 14:23:31.695808 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.695644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c876d8c-d94b-44a5-9348-709ced870719-maas-api-tls\") pod \"maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q\" (UID: \"6c876d8c-d94b-44a5-9348-709ced870719\") " pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"
Jul 06 14:23:31.695808 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.695693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dfkx\" (UniqueName: \"kubernetes.io/projected/6c876d8c-d94b-44a5-9348-709ced870719-kube-api-access-8dfkx\") pod \"maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q\" (UID: \"6c876d8c-d94b-44a5-9348-709ced870719\") " pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"
Jul 06 14:23:31.796547 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.796458    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dfkx\" (UniqueName: \"kubernetes.io/projected/6c876d8c-d94b-44a5-9348-709ced870719-kube-api-access-8dfkx\") pod \"maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q\" (UID: \"6c876d8c-d94b-44a5-9348-709ced870719\") " pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"
Jul 06 14:23:31.796695 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.796585    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c876d8c-d94b-44a5-9348-709ced870719-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q\" (UID: \"6c876d8c-d94b-44a5-9348-709ced870719\") " pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"
Jul 06 14:23:31.796695 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.796614    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c876d8c-d94b-44a5-9348-709ced870719-maas-api-tls\") pod \"maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q\" (UID: \"6c876d8c-d94b-44a5-9348-709ced870719\") " pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"
Jul 06 14:23:31.796786 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:23:31.796736    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-2b44a1-serving-cert: secret "maas-api-e2e-inf-a-2b44a1-serving-cert" not found
Jul 06 14:23:31.796831 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:23:31.796812    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c876d8c-d94b-44a5-9348-709ced870719-maas-api-tls podName:6c876d8c-d94b-44a5-9348-709ced870719 nodeName:}" failed. No retries permitted until 2026-07-06 14:23:32.29678957 +0000 UTC m=+1999.340400591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6c876d8c-d94b-44a5-9348-709ced870719-maas-api-tls") pod "maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q" (UID: "6c876d8c-d94b-44a5-9348-709ced870719") : secret "maas-api-e2e-inf-a-2b44a1-serving-cert" not found
Jul 06 14:23:31.797193 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.797175    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c876d8c-d94b-44a5-9348-709ced870719-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q\" (UID: \"6c876d8c-d94b-44a5-9348-709ced870719\") " pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"
Jul 06 14:23:31.805860 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:31.805833    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dfkx\" (UniqueName: \"kubernetes.io/projected/6c876d8c-d94b-44a5-9348-709ced870719-kube-api-access-8dfkx\") pod \"maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q\" (UID: \"6c876d8c-d94b-44a5-9348-709ced870719\") " pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"
Jul 06 14:23:32.028013 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:32.027978    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:32.136902 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:32.136823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:32.301407 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:32.301367    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c876d8c-d94b-44a5-9348-709ced870719-maas-api-tls\") pod \"maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q\" (UID: \"6c876d8c-d94b-44a5-9348-709ced870719\") " pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"
Jul 06 14:23:32.303892 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:32.303859    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c876d8c-d94b-44a5-9348-709ced870719-maas-api-tls\") pod \"maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q\" (UID: \"6c876d8c-d94b-44a5-9348-709ced870719\") " pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"
Jul 06 14:23:32.460182 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:32.460147    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"
Jul 06 14:23:32.596224 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:32.596201    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"]
Jul 06 14:23:32.598260 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:23:32.598229    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c876d8c_d94b_44a5_9348_709ced870719.slice/crio-62c38f2f888287af4f97c0d6a9ede786241ad13b0789e41843f8096c2c038265 WatchSource:0}: Error finding container 62c38f2f888287af4f97c0d6a9ede786241ad13b0789e41843f8096c2c038265: Status 404 returned error can't find the container with id 62c38f2f888287af4f97c0d6a9ede786241ad13b0789e41843f8096c2c038265
Jul 06 14:23:32.599922 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:32.599905    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:23:33.347896 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:33.347855    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q" event={"ID":"6c876d8c-d94b-44a5-9348-709ced870719","Type":"ContainerStarted","Data":"0145ea421aa8cda9ea04610f48efabaf73b38454fd47e628ca803a35bd3ca754"}
Jul 06 14:23:33.348042 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:33.347992    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"
Jul 06 14:23:33.348042 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:33.348023    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q" event={"ID":"6c876d8c-d94b-44a5-9348-709ced870719","Type":"ContainerStarted","Data":"62c38f2f888287af4f97c0d6a9ede786241ad13b0789e41843f8096c2c038265"}
Jul 06 14:23:33.364147 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:33.363900    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q" podStartSLOduration=1.7997315459999998 podStartE2EDuration="2.363884595s" totalImagesPullingTime="564.153049ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:23:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:33.363632916 +0000 UTC m=+2000.407243950" watchObservedRunningTime="2026-07-06 14:23:33.363884595 +0000 UTC m=+2000.407495631"
Jul 06 14:23:35.961937 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:35.961874    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:36.293273 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:36.293163    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:36.580584 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:36.580486    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:36.741686 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:36.741620    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:39.357404 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.357377    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"
Jul 06 14:23:39.553623 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.553568    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:39.604355 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.604310    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"]
Jul 06 14:23:39.608030 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.607922    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"
Jul 06 14:23:39.610512 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.610486    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-198d8c-serving-cert\""
Jul 06 14:23:39.617180 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.617155    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"]
Jul 06 14:23:39.636669 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.636645    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:39.711552 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.711519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:39.769303 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.769249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-maas-api-tls\") pod \"maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4\" (UID: \"b1b7ed34-48ee-4bbc-a458-afb1353c64eb\") " pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"
Jul 06 14:23:39.769478 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.769311    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrlqf\" (UniqueName: \"kubernetes.io/projected/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-kube-api-access-qrlqf\") pod \"maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4\" (UID: \"b1b7ed34-48ee-4bbc-a458-afb1353c64eb\") " pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"
Jul 06 14:23:39.769478 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.769363    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4\" (UID: \"b1b7ed34-48ee-4bbc-a458-afb1353c64eb\") " pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"
Jul 06 14:23:39.809349 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.809313    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:39.870747 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.870662    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-maas-api-tls\") pod \"maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4\" (UID: \"b1b7ed34-48ee-4bbc-a458-afb1353c64eb\") " pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"
Jul 06 14:23:39.870747 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.870699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrlqf\" (UniqueName: \"kubernetes.io/projected/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-kube-api-access-qrlqf\") pod \"maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4\" (UID: \"b1b7ed34-48ee-4bbc-a458-afb1353c64eb\") " pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"
Jul 06 14:23:39.870747 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.870735    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4\" (UID: \"b1b7ed34-48ee-4bbc-a458-afb1353c64eb\") " pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"
Jul 06 14:23:39.871369 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.871343    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4\" (UID: \"b1b7ed34-48ee-4bbc-a458-afb1353c64eb\") " pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"
Jul 06 14:23:39.873109 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.873083    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-maas-api-tls\") pod \"maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4\" (UID: \"b1b7ed34-48ee-4bbc-a458-afb1353c64eb\") " pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"
Jul 06 14:23:39.877426 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.877408    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrlqf\" (UniqueName: \"kubernetes.io/projected/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-kube-api-access-qrlqf\") pod \"maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4\" (UID: \"b1b7ed34-48ee-4bbc-a458-afb1353c64eb\") " pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"
Jul 06 14:23:39.920180 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:39.920153    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"
Jul 06 14:23:40.064267 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:40.064243    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"]
Jul 06 14:23:40.066581 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:23:40.066550    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b7ed34_48ee_4bbc_a458_afb1353c64eb.slice/crio-8fb1bff273bf9263d2877e7117a138cb5813c527649a9152194efdaa4ce91fd1 WatchSource:0}: Error finding container 8fb1bff273bf9263d2877e7117a138cb5813c527649a9152194efdaa4ce91fd1: Status 404 returned error can't find the container with id 8fb1bff273bf9263d2877e7117a138cb5813c527649a9152194efdaa4ce91fd1
Jul 06 14:23:40.118098 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:40.118066    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:40.220950 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:40.220918    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:40.381799 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:40.381259    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4" event={"ID":"b1b7ed34-48ee-4bbc-a458-afb1353c64eb","Type":"ContainerStarted","Data":"8fb1bff273bf9263d2877e7117a138cb5813c527649a9152194efdaa4ce91fd1"}
Jul 06 14:23:41.389348 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:41.389309    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4" event={"ID":"b1b7ed34-48ee-4bbc-a458-afb1353c64eb","Type":"ContainerStarted","Data":"3c41c1d9ebdbbf88c7c852fd5cc6baa3b23c675b0fbb74beb5671c088984d72e"}
Jul 06 14:23:41.389804 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:41.389371    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"
Jul 06 14:23:41.407616 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:41.407568    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4" podStartSLOduration=1.8304612310000001 podStartE2EDuration="2.407553867s" totalImagesPullingTime="577.092636ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:23:41.405433149 +0000 UTC m=+2008.449044206" watchObservedRunningTime="2026-07-06 14:23:41.407553867 +0000 UTC m=+2008.451164901"
Jul 06 14:23:44.105365 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:44.105333    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:47.399482 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:47.399453    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"
Jul 06 14:23:52.712539 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:52.712499    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:52.812734 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:52.812708    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:23:59.065249 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:23:59.065215    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:01.596402 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:01.596360    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:01.695060 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:01.695030    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:23.076822 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:23.076789    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:42.652723 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:42.652646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:43.573794 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:43.573762    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:43.731784 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:43.731749    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:44.146930 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.146885    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:44.254055 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.254017    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:44.351545 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.351518    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:44.439540 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.439455    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"]
Jul 06 14:24:44.439701 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.439666    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q" podUID="6c876d8c-d94b-44a5-9348-709ced870719" containerName="maas-api" containerID="cri-o://0145ea421aa8cda9ea04610f48efabaf73b38454fd47e628ca803a35bd3ca754" gracePeriod=30
Jul 06 14:24:44.511451 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.511422    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:24:44.690801 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.690737    2562 generic.go:356] "Generic (PLEG): container finished" podID="6c876d8c-d94b-44a5-9348-709ced870719" containerID="0145ea421aa8cda9ea04610f48efabaf73b38454fd47e628ca803a35bd3ca754" exitCode=0
Jul 06 14:24:44.690914 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.690800    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q" event={"ID":"6c876d8c-d94b-44a5-9348-709ced870719","Type":"ContainerDied","Data":"0145ea421aa8cda9ea04610f48efabaf73b38454fd47e628ca803a35bd3ca754"}
Jul 06 14:24:44.690914 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.690839    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q" event={"ID":"6c876d8c-d94b-44a5-9348-709ced870719","Type":"ContainerDied","Data":"62c38f2f888287af4f97c0d6a9ede786241ad13b0789e41843f8096c2c038265"}
Jul 06 14:24:44.690914 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.690859    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62c38f2f888287af4f97c0d6a9ede786241ad13b0789e41843f8096c2c038265"
Jul 06 14:24:44.692168 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.692153    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"
Jul 06 14:24:44.797957 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.797927    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c876d8c-d94b-44a5-9348-709ced870719-maas-api-tls\") pod \"6c876d8c-d94b-44a5-9348-709ced870719\" (UID: \"6c876d8c-d94b-44a5-9348-709ced870719\") "
Jul 06 14:24:44.798445 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.797997    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c876d8c-d94b-44a5-9348-709ced870719-openshift-service-ca\") pod \"6c876d8c-d94b-44a5-9348-709ced870719\" (UID: \"6c876d8c-d94b-44a5-9348-709ced870719\") "
Jul 06 14:24:44.798445 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.798029    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dfkx\" (UniqueName: \"kubernetes.io/projected/6c876d8c-d94b-44a5-9348-709ced870719-kube-api-access-8dfkx\") pod \"6c876d8c-d94b-44a5-9348-709ced870719\" (UID: \"6c876d8c-d94b-44a5-9348-709ced870719\") "
Jul 06 14:24:44.798445 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.798399    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c876d8c-d94b-44a5-9348-709ced870719-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6c876d8c-d94b-44a5-9348-709ced870719" (UID: "6c876d8c-d94b-44a5-9348-709ced870719"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:24:44.800086 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.800057    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c876d8c-d94b-44a5-9348-709ced870719-kube-api-access-8dfkx" (OuterVolumeSpecName: "kube-api-access-8dfkx") pod "6c876d8c-d94b-44a5-9348-709ced870719" (UID: "6c876d8c-d94b-44a5-9348-709ced870719"). InnerVolumeSpecName "kube-api-access-8dfkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:24:44.800086 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.800058    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c876d8c-d94b-44a5-9348-709ced870719-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6c876d8c-d94b-44a5-9348-709ced870719" (UID: "6c876d8c-d94b-44a5-9348-709ced870719"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:24:44.898819 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.898770    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c876d8c-d94b-44a5-9348-709ced870719-maas-api-tls\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:24:44.898819 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.898820    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c876d8c-d94b-44a5-9348-709ced870719-openshift-service-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:24:44.899016 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:44.898835    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dfkx\" (UniqueName: \"kubernetes.io/projected/6c876d8c-d94b-44a5-9348-709ced870719-kube-api-access-8dfkx\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:24:45.695870 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:45.695841    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"
Jul 06 14:24:45.710926 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:45.710900    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"]
Jul 06 14:24:45.716107 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:45.716086    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2b44a1-9fd9985bf-2l79q"]
Jul 06 14:24:47.477869 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:47.477835    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c876d8c-d94b-44a5-9348-709ced870719" path="/var/lib/kubelet/pods/6c876d8c-d94b-44a5-9348-709ced870719/volumes"
Jul 06 14:24:49.196777 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:24:49.196719    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:13.560199 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:13.560173    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 14:25:13.561056 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:13.561034    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 14:25:26.498729 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:26.498700    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:26.800518 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:26.800411    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:27.011922 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:27.011886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:27.262958 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:27.262926    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:27.643732 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:27.643643    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:27.848325 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:27.848268    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:27.861545 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:27.861517    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"]
Jul 06 14:25:27.861719 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:27.861697    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4" podUID="b1b7ed34-48ee-4bbc-a458-afb1353c64eb" containerName="maas-api" containerID="cri-o://3c41c1d9ebdbbf88c7c852fd5cc6baa3b23c675b0fbb74beb5671c088984d72e" gracePeriod=30
Jul 06 14:25:27.946347 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:27.946253    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:28.111451 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.111429    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"
Jul 06 14:25:28.261381 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.261353    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-maas-api-tls\") pod \"b1b7ed34-48ee-4bbc-a458-afb1353c64eb\" (UID: \"b1b7ed34-48ee-4bbc-a458-afb1353c64eb\") "
Jul 06 14:25:28.261540 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.261406    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-openshift-service-ca\") pod \"b1b7ed34-48ee-4bbc-a458-afb1353c64eb\" (UID: \"b1b7ed34-48ee-4bbc-a458-afb1353c64eb\") "
Jul 06 14:25:28.261540 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.261444    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrlqf\" (UniqueName: \"kubernetes.io/projected/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-kube-api-access-qrlqf\") pod \"b1b7ed34-48ee-4bbc-a458-afb1353c64eb\" (UID: \"b1b7ed34-48ee-4bbc-a458-afb1353c64eb\") "
Jul 06 14:25:28.261743 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.261715    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b1b7ed34-48ee-4bbc-a458-afb1353c64eb" (UID: "b1b7ed34-48ee-4bbc-a458-afb1353c64eb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:25:28.263512 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.263477    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b1b7ed34-48ee-4bbc-a458-afb1353c64eb" (UID: "b1b7ed34-48ee-4bbc-a458-afb1353c64eb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:28.263632 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.263604    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-kube-api-access-qrlqf" (OuterVolumeSpecName: "kube-api-access-qrlqf") pod "b1b7ed34-48ee-4bbc-a458-afb1353c64eb" (UID: "b1b7ed34-48ee-4bbc-a458-afb1353c64eb"). InnerVolumeSpecName "kube-api-access-qrlqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:25:28.362392 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.362365    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrlqf\" (UniqueName: \"kubernetes.io/projected/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-kube-api-access-qrlqf\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:25:28.362392 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.362387    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-maas-api-tls\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:25:28.362392 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.362396    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1b7ed34-48ee-4bbc-a458-afb1353c64eb-openshift-service-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:25:28.901272 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.901236    2562 generic.go:356] "Generic (PLEG): container finished" podID="b1b7ed34-48ee-4bbc-a458-afb1353c64eb" containerID="3c41c1d9ebdbbf88c7c852fd5cc6baa3b23c675b0fbb74beb5671c088984d72e" exitCode=0
Jul 06 14:25:28.901696 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.901273    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4" event={"ID":"b1b7ed34-48ee-4bbc-a458-afb1353c64eb","Type":"ContainerDied","Data":"3c41c1d9ebdbbf88c7c852fd5cc6baa3b23c675b0fbb74beb5671c088984d72e"}
Jul 06 14:25:28.901696 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.901347    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4" event={"ID":"b1b7ed34-48ee-4bbc-a458-afb1353c64eb","Type":"ContainerDied","Data":"8fb1bff273bf9263d2877e7117a138cb5813c527649a9152194efdaa4ce91fd1"}
Jul 06 14:25:28.901696 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.901277    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"
Jul 06 14:25:28.901696 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.901381    2562 scope.go:117] "RemoveContainer" containerID="3c41c1d9ebdbbf88c7c852fd5cc6baa3b23c675b0fbb74beb5671c088984d72e"
Jul 06 14:25:28.910815 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.910525    2562 scope.go:117] "RemoveContainer" containerID="3c41c1d9ebdbbf88c7c852fd5cc6baa3b23c675b0fbb74beb5671c088984d72e"
Jul 06 14:25:28.910910 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:25:28.910880    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c41c1d9ebdbbf88c7c852fd5cc6baa3b23c675b0fbb74beb5671c088984d72e\": container with ID starting with 3c41c1d9ebdbbf88c7c852fd5cc6baa3b23c675b0fbb74beb5671c088984d72e not found: ID does not exist" containerID="3c41c1d9ebdbbf88c7c852fd5cc6baa3b23c675b0fbb74beb5671c088984d72e"
Jul 06 14:25:28.910964 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.910919    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c41c1d9ebdbbf88c7c852fd5cc6baa3b23c675b0fbb74beb5671c088984d72e"} err="failed to get container status \"3c41c1d9ebdbbf88c7c852fd5cc6baa3b23c675b0fbb74beb5671c088984d72e\": rpc error: code = NotFound desc = could not find container \"3c41c1d9ebdbbf88c7c852fd5cc6baa3b23c675b0fbb74beb5671c088984d72e\": container with ID starting with 3c41c1d9ebdbbf88c7c852fd5cc6baa3b23c675b0fbb74beb5671c088984d72e not found: ID does not exist"
Jul 06 14:25:28.922439 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.922413    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"]
Jul 06 14:25:28.926129 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:28.926110    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-198d8c-669b87b967-ql2z4"]
Jul 06 14:25:29.150017 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:29.149988    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:29.477142 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:29.477111    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1b7ed34-48ee-4bbc-a458-afb1353c64eb" path="/var/lib/kubelet/pods/b1b7ed34-48ee-4bbc-a458-afb1353c64eb/volumes"
Jul 06 14:25:34.011634 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:34.011602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:34.109792 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:34.109760    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:34.273848 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:34.273760    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:34.496617 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:34.496583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:34.821108 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:34.821076    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:35.147705 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:35.147628    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:35.490165 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:35.490137    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:38.177812 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.177778    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:38.282028 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.281985    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"]
Jul 06 14:25:38.282378 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.282363    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c876d8c-d94b-44a5-9348-709ced870719" containerName="maas-api"
Jul 06 14:25:38.282378 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.282379    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c876d8c-d94b-44a5-9348-709ced870719" containerName="maas-api"
Jul 06 14:25:38.282511 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.282402    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1b7ed34-48ee-4bbc-a458-afb1353c64eb" containerName="maas-api"
Jul 06 14:25:38.282511 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.282407    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1b7ed34-48ee-4bbc-a458-afb1353c64eb" containerName="maas-api"
Jul 06 14:25:38.282511 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.282467    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1b7ed34-48ee-4bbc-a458-afb1353c64eb" containerName="maas-api"
Jul 06 14:25:38.282511 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.282476    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c876d8c-d94b-44a5-9348-709ced870719" containerName="maas-api"
Jul 06 14:25:38.286666 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.286643    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"
Jul 06 14:25:38.288998 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.288975    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-51dadf-serving-cert\""
Jul 06 14:25:38.289126 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.289023    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:38.307480 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.307458    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"]
Jul 06 14:25:38.393754 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.393725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:38.454236 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.454205    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkj4l\" (UniqueName: \"kubernetes.io/projected/77f06b72-86fb-4f78-ab77-156395909984-kube-api-access-nkj4l\") pod \"maas-api-e2e-api-a-51dadf-6dc4889945-92zgt\" (UID: \"77f06b72-86fb-4f78-ab77-156395909984\") " pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"
Jul 06 14:25:38.454420 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.454253    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77f06b72-86fb-4f78-ab77-156395909984-openshift-service-ca\") pod \"maas-api-e2e-api-a-51dadf-6dc4889945-92zgt\" (UID: \"77f06b72-86fb-4f78-ab77-156395909984\") " pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"
Jul 06 14:25:38.454420 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.454278    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77f06b72-86fb-4f78-ab77-156395909984-maas-api-tls\") pod \"maas-api-e2e-api-a-51dadf-6dc4889945-92zgt\" (UID: \"77f06b72-86fb-4f78-ab77-156395909984\") " pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"
Jul 06 14:25:38.491667 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.491642    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:38.555424 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.555392    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkj4l\" (UniqueName: \"kubernetes.io/projected/77f06b72-86fb-4f78-ab77-156395909984-kube-api-access-nkj4l\") pod \"maas-api-e2e-api-a-51dadf-6dc4889945-92zgt\" (UID: \"77f06b72-86fb-4f78-ab77-156395909984\") " pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"
Jul 06 14:25:38.555517 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.555442    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77f06b72-86fb-4f78-ab77-156395909984-openshift-service-ca\") pod \"maas-api-e2e-api-a-51dadf-6dc4889945-92zgt\" (UID: \"77f06b72-86fb-4f78-ab77-156395909984\") " pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"
Jul 06 14:25:38.555571 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.555549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77f06b72-86fb-4f78-ab77-156395909984-maas-api-tls\") pod \"maas-api-e2e-api-a-51dadf-6dc4889945-92zgt\" (UID: \"77f06b72-86fb-4f78-ab77-156395909984\") " pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"
Jul 06 14:25:38.556046 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.556026    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77f06b72-86fb-4f78-ab77-156395909984-openshift-service-ca\") pod \"maas-api-e2e-api-a-51dadf-6dc4889945-92zgt\" (UID: \"77f06b72-86fb-4f78-ab77-156395909984\") " pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"
Jul 06 14:25:38.557914 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.557894    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77f06b72-86fb-4f78-ab77-156395909984-maas-api-tls\") pod \"maas-api-e2e-api-a-51dadf-6dc4889945-92zgt\" (UID: \"77f06b72-86fb-4f78-ab77-156395909984\") " pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"
Jul 06 14:25:38.562427 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.562406    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkj4l\" (UniqueName: \"kubernetes.io/projected/77f06b72-86fb-4f78-ab77-156395909984-kube-api-access-nkj4l\") pod \"maas-api-e2e-api-a-51dadf-6dc4889945-92zgt\" (UID: \"77f06b72-86fb-4f78-ab77-156395909984\") " pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"
Jul 06 14:25:38.596814 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.596790    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"
Jul 06 14:25:38.734555 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.734530    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"]
Jul 06 14:25:38.737180 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:25:38.737155    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77f06b72_86fb_4f78_ab77_156395909984.slice/crio-f3eb72ef59c17f8ef55870832044cbe29c72951042aa1111b55f682e3e6bcbc9 WatchSource:0}: Error finding container f3eb72ef59c17f8ef55870832044cbe29c72951042aa1111b55f682e3e6bcbc9: Status 404 returned error can't find the container with id f3eb72ef59c17f8ef55870832044cbe29c72951042aa1111b55f682e3e6bcbc9
Jul 06 14:25:38.933943 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.933909    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:38.952964 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:38.952936    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt" event={"ID":"77f06b72-86fb-4f78-ab77-156395909984","Type":"ContainerStarted","Data":"f3eb72ef59c17f8ef55870832044cbe29c72951042aa1111b55f682e3e6bcbc9"}
Jul 06 14:25:39.029744 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:39.029672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:39.960036 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:39.960000    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt" event={"ID":"77f06b72-86fb-4f78-ab77-156395909984","Type":"ContainerStarted","Data":"e81d0ac17b1b0c65891dee1b750c83618d7f5c78406a546bc480980484c04c3b"}
Jul 06 14:25:39.960528 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:39.960130    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"
Jul 06 14:25:39.976838 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:39.976788    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt" podStartSLOduration=1.525531161 podStartE2EDuration="1.976774538s" totalImagesPullingTime="451.243377ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:39.974476811 +0000 UTC m=+2127.018087841" watchObservedRunningTime="2026-07-06 14:25:39.976774538 +0000 UTC m=+2127.020385571"
Jul 06 14:25:42.678460 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:42.678429    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:43.132640 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:43.132610    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:43.453558 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:43.453528    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:43.683063 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:43.683026    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:45.970788 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:45.970759    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"
Jul 06 14:25:46.328905 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.328781    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:46.459143 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.459096    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:46.521343 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.521313    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"]
Jul 06 14:25:46.524566 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.524544    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"
Jul 06 14:25:46.526715 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.526693    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-46a8c8-serving-cert\""
Jul 06 14:25:46.535311 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.535187    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"]
Jul 06 14:25:46.569331 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.569273    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:46.624589 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.624524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcgpb\" (UniqueName: \"kubernetes.io/projected/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-kube-api-access-zcgpb\") pod \"maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh\" (UID: \"ec2e3e30-31ed-4786-a0cb-c3d756556fc5\") " pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"
Jul 06 14:25:46.624589 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.624559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-openshift-service-ca\") pod \"maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh\" (UID: \"ec2e3e30-31ed-4786-a0cb-c3d756556fc5\") " pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"
Jul 06 14:25:46.624756 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.624595    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-maas-api-tls\") pod \"maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh\" (UID: \"ec2e3e30-31ed-4786-a0cb-c3d756556fc5\") " pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"
Jul 06 14:25:46.705142 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.705111    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:46.725325 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.725303    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcgpb\" (UniqueName: \"kubernetes.io/projected/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-kube-api-access-zcgpb\") pod \"maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh\" (UID: \"ec2e3e30-31ed-4786-a0cb-c3d756556fc5\") " pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"
Jul 06 14:25:46.725446 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.725337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-openshift-service-ca\") pod \"maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh\" (UID: \"ec2e3e30-31ed-4786-a0cb-c3d756556fc5\") " pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"
Jul 06 14:25:46.725446 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.725366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-maas-api-tls\") pod \"maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh\" (UID: \"ec2e3e30-31ed-4786-a0cb-c3d756556fc5\") " pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"
Jul 06 14:25:46.726001 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.725980    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-openshift-service-ca\") pod \"maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh\" (UID: \"ec2e3e30-31ed-4786-a0cb-c3d756556fc5\") " pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"
Jul 06 14:25:46.727843 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.727820    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-maas-api-tls\") pod \"maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh\" (UID: \"ec2e3e30-31ed-4786-a0cb-c3d756556fc5\") " pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"
Jul 06 14:25:46.735104 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.735080    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcgpb\" (UniqueName: \"kubernetes.io/projected/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-kube-api-access-zcgpb\") pod \"maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh\" (UID: \"ec2e3e30-31ed-4786-a0cb-c3d756556fc5\") " pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"
Jul 06 14:25:46.839144 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.839121    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"
Jul 06 14:25:46.973092 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.973068    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"]
Jul 06 14:25:46.976537 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:25:46.976510    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec2e3e30_31ed_4786_a0cb_c3d756556fc5.slice/crio-756898c098febc214830204de0844f8edb3a64b8d5b373b5e67f45244e2bcd12 WatchSource:0}: Error finding container 756898c098febc214830204de0844f8edb3a64b8d5b373b5e67f45244e2bcd12: Status 404 returned error can't find the container with id 756898c098febc214830204de0844f8edb3a64b8d5b373b5e67f45244e2bcd12
Jul 06 14:25:46.988591 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.988563    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:46.995554 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:46.995525    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh" event={"ID":"ec2e3e30-31ed-4786-a0cb-c3d756556fc5","Type":"ContainerStarted","Data":"756898c098febc214830204de0844f8edb3a64b8d5b373b5e67f45244e2bcd12"}
Jul 06 14:25:47.153471 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:47.153382    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:48.003045 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:48.003005    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh" event={"ID":"ec2e3e30-31ed-4786-a0cb-c3d756556fc5","Type":"ContainerStarted","Data":"d7c1e476af4870d17a6a335c8dfc134c1b1358d95c1676bbfae2f43d1999c7f2"}
Jul 06 14:25:48.003545 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:48.003154    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"
Jul 06 14:25:48.020056 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:48.020008    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh" podStartSLOduration=1.655290345 podStartE2EDuration="2.019992875s" totalImagesPullingTime="364.70253ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:48.019147246 +0000 UTC m=+2135.062758312" watchObservedRunningTime="2026-07-06 14:25:48.019992875 +0000 UTC m=+2135.063603982"
Jul 06 14:25:50.721539 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:50.721501    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:54.013617 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:54.013590    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"
Jul 06 14:25:58.789093 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:58.789061    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:59.148846 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:59.148772    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:59.249187 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:59.249159    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:59.349509 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:59.349482    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:59.431374 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:59.431302    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"]
Jul 06 14:25:59.431565 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:59.431518    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt" podUID="77f06b72-86fb-4f78-ab77-156395909984" containerName="maas-api" containerID="cri-o://e81d0ac17b1b0c65891dee1b750c83618d7f5c78406a546bc480980484c04c3b" gracePeriod=30
Jul 06 14:25:59.462373 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:59.462341    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:25:59.683093 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:59.683002    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"
Jul 06 14:25:59.722566 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:59.722541    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkj4l\" (UniqueName: \"kubernetes.io/projected/77f06b72-86fb-4f78-ab77-156395909984-kube-api-access-nkj4l\") pod \"77f06b72-86fb-4f78-ab77-156395909984\" (UID: \"77f06b72-86fb-4f78-ab77-156395909984\") "
Jul 06 14:25:59.722705 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:59.722580    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77f06b72-86fb-4f78-ab77-156395909984-openshift-service-ca\") pod \"77f06b72-86fb-4f78-ab77-156395909984\" (UID: \"77f06b72-86fb-4f78-ab77-156395909984\") "
Jul 06 14:25:59.722705 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:59.722616    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77f06b72-86fb-4f78-ab77-156395909984-maas-api-tls\") pod \"77f06b72-86fb-4f78-ab77-156395909984\" (UID: \"77f06b72-86fb-4f78-ab77-156395909984\") "
Jul 06 14:25:59.723004 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:59.722975    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77f06b72-86fb-4f78-ab77-156395909984-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "77f06b72-86fb-4f78-ab77-156395909984" (UID: "77f06b72-86fb-4f78-ab77-156395909984"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:25:59.724644 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:59.724614    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77f06b72-86fb-4f78-ab77-156395909984-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "77f06b72-86fb-4f78-ab77-156395909984" (UID: "77f06b72-86fb-4f78-ab77-156395909984"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:25:59.724735 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:59.724711    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77f06b72-86fb-4f78-ab77-156395909984-kube-api-access-nkj4l" (OuterVolumeSpecName: "kube-api-access-nkj4l") pod "77f06b72-86fb-4f78-ab77-156395909984" (UID: "77f06b72-86fb-4f78-ab77-156395909984"). InnerVolumeSpecName "kube-api-access-nkj4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:25:59.823861 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:59.823830    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkj4l\" (UniqueName: \"kubernetes.io/projected/77f06b72-86fb-4f78-ab77-156395909984-kube-api-access-nkj4l\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:25:59.823861 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:59.823857    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77f06b72-86fb-4f78-ab77-156395909984-openshift-service-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:25:59.824179 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:25:59.823872    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77f06b72-86fb-4f78-ab77-156395909984-maas-api-tls\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:26:00.061463 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:00.061432    2562 generic.go:356] "Generic (PLEG): container finished" podID="77f06b72-86fb-4f78-ab77-156395909984" containerID="e81d0ac17b1b0c65891dee1b750c83618d7f5c78406a546bc480980484c04c3b" exitCode=0
Jul 06 14:26:00.061626 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:00.061477    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"
Jul 06 14:26:00.061626 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:00.061503    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt" event={"ID":"77f06b72-86fb-4f78-ab77-156395909984","Type":"ContainerDied","Data":"e81d0ac17b1b0c65891dee1b750c83618d7f5c78406a546bc480980484c04c3b"}
Jul 06 14:26:00.061626 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:00.061580    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt" event={"ID":"77f06b72-86fb-4f78-ab77-156395909984","Type":"ContainerDied","Data":"f3eb72ef59c17f8ef55870832044cbe29c72951042aa1111b55f682e3e6bcbc9"}
Jul 06 14:26:00.061626 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:00.061610    2562 scope.go:117] "RemoveContainer" containerID="e81d0ac17b1b0c65891dee1b750c83618d7f5c78406a546bc480980484c04c3b"
Jul 06 14:26:00.070869 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:00.070853    2562 scope.go:117] "RemoveContainer" containerID="e81d0ac17b1b0c65891dee1b750c83618d7f5c78406a546bc480980484c04c3b"
Jul 06 14:26:00.071095 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:26:00.071078    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e81d0ac17b1b0c65891dee1b750c83618d7f5c78406a546bc480980484c04c3b\": container with ID starting with e81d0ac17b1b0c65891dee1b750c83618d7f5c78406a546bc480980484c04c3b not found: ID does not exist" containerID="e81d0ac17b1b0c65891dee1b750c83618d7f5c78406a546bc480980484c04c3b"
Jul 06 14:26:00.071153 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:00.071104    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e81d0ac17b1b0c65891dee1b750c83618d7f5c78406a546bc480980484c04c3b"} err="failed to get container status \"e81d0ac17b1b0c65891dee1b750c83618d7f5c78406a546bc480980484c04c3b\": rpc error: code = NotFound desc = could not find container \"e81d0ac17b1b0c65891dee1b750c83618d7f5c78406a546bc480980484c04c3b\": container with ID starting with e81d0ac17b1b0c65891dee1b750c83618d7f5c78406a546bc480980484c04c3b not found: ID does not exist"
Jul 06 14:26:00.081639 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:00.081596    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"]
Jul 06 14:26:00.084333 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:00.084310    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-51dadf-6dc4889945-92zgt"]
Jul 06 14:26:01.477487 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:01.477446    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77f06b72-86fb-4f78-ab77-156395909984" path="/var/lib/kubelet/pods/77f06b72-86fb-4f78-ab77-156395909984/volumes"
Jul 06 14:26:05.705938 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:05.705904    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:05.805322 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:05.805267    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:05.992129 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:05.992011    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:06.183092 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:06.183036    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:06.349184 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:06.349081    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:06.761709 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:06.761680    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:06.867184 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:06.867158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:06.964866 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:06.964820    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:07.056859 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:07.056776    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"]
Jul 06 14:26:07.057069 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:07.057044    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh" podUID="ec2e3e30-31ed-4786-a0cb-c3d756556fc5" containerName="maas-api" containerID="cri-o://d7c1e476af4870d17a6a335c8dfc134c1b1358d95c1676bbfae2f43d1999c7f2" gracePeriod=30
Jul 06 14:26:07.101989 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:07.101961    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:07.302783 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:07.302760    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"
Jul 06 14:26:07.384087 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:07.384017    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-maas-api-tls\") pod \"ec2e3e30-31ed-4786-a0cb-c3d756556fc5\" (UID: \"ec2e3e30-31ed-4786-a0cb-c3d756556fc5\") "
Jul 06 14:26:07.384213 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:07.384140    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-openshift-service-ca\") pod \"ec2e3e30-31ed-4786-a0cb-c3d756556fc5\" (UID: \"ec2e3e30-31ed-4786-a0cb-c3d756556fc5\") "
Jul 06 14:26:07.384213 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:07.384186    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcgpb\" (UniqueName: \"kubernetes.io/projected/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-kube-api-access-zcgpb\") pod \"ec2e3e30-31ed-4786-a0cb-c3d756556fc5\" (UID: \"ec2e3e30-31ed-4786-a0cb-c3d756556fc5\") "
Jul 06 14:26:07.384580 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:07.384554    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ec2e3e30-31ed-4786-a0cb-c3d756556fc5" (UID: "ec2e3e30-31ed-4786-a0cb-c3d756556fc5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:26:07.386249 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:07.386221    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ec2e3e30-31ed-4786-a0cb-c3d756556fc5" (UID: "ec2e3e30-31ed-4786-a0cb-c3d756556fc5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:26:07.386465 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:07.386442    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-kube-api-access-zcgpb" (OuterVolumeSpecName: "kube-api-access-zcgpb") pod "ec2e3e30-31ed-4786-a0cb-c3d756556fc5" (UID: "ec2e3e30-31ed-4786-a0cb-c3d756556fc5"). InnerVolumeSpecName "kube-api-access-zcgpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:26:07.485624 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:07.485598    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-maas-api-tls\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:26:07.485624 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:07.485625    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-openshift-service-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:26:07.485805 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:07.485635    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcgpb\" (UniqueName: \"kubernetes.io/projected/ec2e3e30-31ed-4786-a0cb-c3d756556fc5-kube-api-access-zcgpb\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:26:08.105898 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:08.105864    2562 generic.go:356] "Generic (PLEG): container finished" podID="ec2e3e30-31ed-4786-a0cb-c3d756556fc5" containerID="d7c1e476af4870d17a6a335c8dfc134c1b1358d95c1676bbfae2f43d1999c7f2" exitCode=0
Jul 06 14:26:08.106344 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:08.105923    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"
Jul 06 14:26:08.106344 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:08.105954    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh" event={"ID":"ec2e3e30-31ed-4786-a0cb-c3d756556fc5","Type":"ContainerDied","Data":"d7c1e476af4870d17a6a335c8dfc134c1b1358d95c1676bbfae2f43d1999c7f2"}
Jul 06 14:26:08.106344 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:08.106012    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh" event={"ID":"ec2e3e30-31ed-4786-a0cb-c3d756556fc5","Type":"ContainerDied","Data":"756898c098febc214830204de0844f8edb3a64b8d5b373b5e67f45244e2bcd12"}
Jul 06 14:26:08.106344 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:08.106033    2562 scope.go:117] "RemoveContainer" containerID="d7c1e476af4870d17a6a335c8dfc134c1b1358d95c1676bbfae2f43d1999c7f2"
Jul 06 14:26:08.114454 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:08.114438    2562 scope.go:117] "RemoveContainer" containerID="d7c1e476af4870d17a6a335c8dfc134c1b1358d95c1676bbfae2f43d1999c7f2"
Jul 06 14:26:08.114706 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:26:08.114689    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7c1e476af4870d17a6a335c8dfc134c1b1358d95c1676bbfae2f43d1999c7f2\": container with ID starting with d7c1e476af4870d17a6a335c8dfc134c1b1358d95c1676bbfae2f43d1999c7f2 not found: ID does not exist" containerID="d7c1e476af4870d17a6a335c8dfc134c1b1358d95c1676bbfae2f43d1999c7f2"
Jul 06 14:26:08.114758 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:08.114716    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c1e476af4870d17a6a335c8dfc134c1b1358d95c1676bbfae2f43d1999c7f2"} err="failed to get container status \"d7c1e476af4870d17a6a335c8dfc134c1b1358d95c1676bbfae2f43d1999c7f2\": rpc error: code = NotFound desc = could not find container \"d7c1e476af4870d17a6a335c8dfc134c1b1358d95c1676bbfae2f43d1999c7f2\": container with ID starting with d7c1e476af4870d17a6a335c8dfc134c1b1358d95c1676bbfae2f43d1999c7f2 not found: ID does not exist"
Jul 06 14:26:08.120930 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:08.120911    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"]
Jul 06 14:26:08.122704 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:08.122685    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-46a8c8-7649895d49-hz9sh"]
Jul 06 14:26:09.477117 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:09.477084    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec2e3e30-31ed-4786-a0cb-c3d756556fc5" path="/var/lib/kubelet/pods/ec2e3e30-31ed-4786-a0cb-c3d756556fc5/volumes"
Jul 06 14:26:12.960676 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:12.960646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:13.060272 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:13.060249    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:13.222696 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:13.222610    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:13.459237 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:13.459200    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:13.796116 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:13.796081    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:14.093410 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:14.093376    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:14.437631 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:14.437553    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:17.408221 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.408183    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:17.457273 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.457245    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"]
Jul 06 14:26:17.457625 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.457610    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec2e3e30-31ed-4786-a0cb-c3d756556fc5" containerName="maas-api"
Jul 06 14:26:17.457625 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.457624    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec2e3e30-31ed-4786-a0cb-c3d756556fc5" containerName="maas-api"
Jul 06 14:26:17.457765 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.457643    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f06b72-86fb-4f78-ab77-156395909984" containerName="maas-api"
Jul 06 14:26:17.457765 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.457649    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f06b72-86fb-4f78-ab77-156395909984" containerName="maas-api"
Jul 06 14:26:17.457765 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.457695    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec2e3e30-31ed-4786-a0cb-c3d756556fc5" containerName="maas-api"
Jul 06 14:26:17.457765 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.457706    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="77f06b72-86fb-4f78-ab77-156395909984" containerName="maas-api"
Jul 06 14:26:17.461777 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.461755    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"
Jul 06 14:26:17.463864 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.463841    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-2c86e0-serving-cert\""
Jul 06 14:26:17.479206 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.479181    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"]
Jul 06 14:26:17.509978 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.509949    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:17.567408 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.567382    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7bwp\" (UniqueName: \"kubernetes.io/projected/a300937a-c01e-4ede-b77f-8daac34faeda-kube-api-access-w7bwp\") pod \"maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f\" (UID: \"a300937a-c01e-4ede-b77f-8daac34faeda\") " pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"
Jul 06 14:26:17.567504 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.567418    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a300937a-c01e-4ede-b77f-8daac34faeda-openshift-service-ca\") pod \"maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f\" (UID: \"a300937a-c01e-4ede-b77f-8daac34faeda\") " pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"
Jul 06 14:26:17.567552 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.567524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a300937a-c01e-4ede-b77f-8daac34faeda-maas-api-tls\") pod \"maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f\" (UID: \"a300937a-c01e-4ede-b77f-8daac34faeda\") " pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"
Jul 06 14:26:17.610199 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.610174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:17.668255 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.668179    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a300937a-c01e-4ede-b77f-8daac34faeda-maas-api-tls\") pod \"maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f\" (UID: \"a300937a-c01e-4ede-b77f-8daac34faeda\") " pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"
Jul 06 14:26:17.668255 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.668236    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7bwp\" (UniqueName: \"kubernetes.io/projected/a300937a-c01e-4ede-b77f-8daac34faeda-kube-api-access-w7bwp\") pod \"maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f\" (UID: \"a300937a-c01e-4ede-b77f-8daac34faeda\") " pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"
Jul 06 14:26:17.668455 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.668259    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a300937a-c01e-4ede-b77f-8daac34faeda-openshift-service-ca\") pod \"maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f\" (UID: \"a300937a-c01e-4ede-b77f-8daac34faeda\") " pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"
Jul 06 14:26:17.668909 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.668891    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a300937a-c01e-4ede-b77f-8daac34faeda-openshift-service-ca\") pod \"maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f\" (UID: \"a300937a-c01e-4ede-b77f-8daac34faeda\") " pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"
Jul 06 14:26:17.670568 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.670550    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a300937a-c01e-4ede-b77f-8daac34faeda-maas-api-tls\") pod \"maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f\" (UID: \"a300937a-c01e-4ede-b77f-8daac34faeda\") " pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"
Jul 06 14:26:17.675313 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.675267    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7bwp\" (UniqueName: \"kubernetes.io/projected/a300937a-c01e-4ede-b77f-8daac34faeda-kube-api-access-w7bwp\") pod \"maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f\" (UID: \"a300937a-c01e-4ede-b77f-8daac34faeda\") " pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"
Jul 06 14:26:17.713461 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.713425    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:17.772910 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.772887    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"
Jul 06 14:26:17.912371 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.912337    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"]
Jul 06 14:26:17.913679 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:26:17.913649    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda300937a_c01e_4ede_b77f_8daac34faeda.slice/crio-9f403086b76b5a4bd429213e2585781ac1b0fcffe60335856fb1e005edabe115 WatchSource:0}: Error finding container 9f403086b76b5a4bd429213e2585781ac1b0fcffe60335856fb1e005edabe115: Status 404 returned error can't find the container with id 9f403086b76b5a4bd429213e2585781ac1b0fcffe60335856fb1e005edabe115
Jul 06 14:26:17.964034 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:17.964001    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:18.062542 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:18.062507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:18.153484 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:18.153453    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f" event={"ID":"a300937a-c01e-4ede-b77f-8daac34faeda","Type":"ContainerStarted","Data":"9f403086b76b5a4bd429213e2585781ac1b0fcffe60335856fb1e005edabe115"}
Jul 06 14:26:19.159643 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:19.159601    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f" event={"ID":"a300937a-c01e-4ede-b77f-8daac34faeda","Type":"ContainerStarted","Data":"faacaa5ccaca54c5a099f598e20156c95c5ad72d83258eca955378314a5f68f1"}
Jul 06 14:26:19.160031 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:19.159670    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"
Jul 06 14:26:19.175772 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:19.175722    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f" podStartSLOduration=1.7493661600000001 podStartE2EDuration="2.175705876s" totalImagesPullingTime="426.339716ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:26:19.174517894 +0000 UTC m=+2166.218128946" watchObservedRunningTime="2026-07-06 14:26:19.175705876 +0000 UTC m=+2166.219316911"
Jul 06 14:26:20.693972 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:20.693942    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:20.794756 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:20.794728    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:21.911846 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:21.911792    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:22.271963 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:22.271924    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:22.550496 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:22.550415    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:22.623320 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:22.623266    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:25.169364 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:25.169339    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"
Jul 06 14:26:25.461603 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:25.461520    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:25.531921 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:25.531893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:25.705613 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:25.705570    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:25.810692 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:25.810614    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:26.133129 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:26.133051    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:26.202383 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:26.202350    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:29.962544 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:29.962505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:37.270859 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:37.270814    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:39.496057 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:39.496007    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:39.596073 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:39.596038    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:47.668233 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:47.668204    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:47.768588 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:47.768558    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:26:58.527411 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:26:58.527372    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:14.695906 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:27:14.695852    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:43.777029 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:27:43.776949    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:27:45.807686 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:27:45.807651    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:28:32.747656 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:28:32.747621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:20.510651 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:29:20.510558    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:20.610840 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:29:20.610759    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:26.516792 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:29:26.516738    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:27.342954 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:29:27.342906    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:33.370619 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:29:33.370584    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:29:57.378632 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:29:57.378580    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:13.588656 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:30:13.588626    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 14:30:13.590906 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:30:13.590885    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nd55z_c2b3489c-dd27-4729-99cf-caf01ddf702f/ovn-acl-logging/0.log"
Jul 06 14:30:13.705191 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:30:13.705166    2562 scope.go:117] "RemoveContainer" containerID="0145ea421aa8cda9ea04610f48efabaf73b38454fd47e628ca803a35bd3ca754"
Jul 06 14:30:44.056603 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:30:44.056557    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:44.782606 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:30:44.782576    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:30:57.679500 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:30:57.679462    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:21.475860 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:31:21.475829    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:21.635915 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:31:21.635883    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:25.067673 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:31:25.067640    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:40.194555 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:31:40.194511    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:40.297100 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:31:40.297063    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:48.364453 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:31:48.364415    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:31:48.472687 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:31:48.472653    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:07.837987 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:07.837910    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:08.452347 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:08.452292    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:08.553617 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:08.553584    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:08.653322 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:08.653272    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:09.742457 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:09.742425    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:10.164001 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.163920    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:10.264087 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.264045    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:10.365224 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.365192    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:10.443128 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.443054    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"]
Jul 06 14:32:10.443277 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.443255    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f" podUID="a300937a-c01e-4ede-b77f-8daac34faeda" containerName="maas-api" containerID="cri-o://faacaa5ccaca54c5a099f598e20156c95c5ad72d83258eca955378314a5f68f1" gracePeriod=30
Jul 06 14:32:10.506474 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.506434    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:10.689577 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.689556    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"
Jul 06 14:32:10.695013 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.694959    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a300937a-c01e-4ede-b77f-8daac34faeda-openshift-service-ca\") pod \"a300937a-c01e-4ede-b77f-8daac34faeda\" (UID: \"a300937a-c01e-4ede-b77f-8daac34faeda\") "
Jul 06 14:32:10.695013 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.694993    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a300937a-c01e-4ede-b77f-8daac34faeda-maas-api-tls\") pod \"a300937a-c01e-4ede-b77f-8daac34faeda\" (UID: \"a300937a-c01e-4ede-b77f-8daac34faeda\") "
Jul 06 14:32:10.695177 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.695031    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7bwp\" (UniqueName: \"kubernetes.io/projected/a300937a-c01e-4ede-b77f-8daac34faeda-kube-api-access-w7bwp\") pod \"a300937a-c01e-4ede-b77f-8daac34faeda\" (UID: \"a300937a-c01e-4ede-b77f-8daac34faeda\") "
Jul 06 14:32:10.695326 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.695304    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a300937a-c01e-4ede-b77f-8daac34faeda-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a300937a-c01e-4ede-b77f-8daac34faeda" (UID: "a300937a-c01e-4ede-b77f-8daac34faeda"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:32:10.695411 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.695396    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a300937a-c01e-4ede-b77f-8daac34faeda-openshift-service-ca\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:32:10.696972 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.696945    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a300937a-c01e-4ede-b77f-8daac34faeda-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a300937a-c01e-4ede-b77f-8daac34faeda" (UID: "a300937a-c01e-4ede-b77f-8daac34faeda"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:32:10.697084 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.697060    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a300937a-c01e-4ede-b77f-8daac34faeda-kube-api-access-w7bwp" (OuterVolumeSpecName: "kube-api-access-w7bwp") pod "a300937a-c01e-4ede-b77f-8daac34faeda" (UID: "a300937a-c01e-4ede-b77f-8daac34faeda"). InnerVolumeSpecName "kube-api-access-w7bwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:32:10.796110 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.796082    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a300937a-c01e-4ede-b77f-8daac34faeda-maas-api-tls\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:32:10.796110 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.796107    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7bwp\" (UniqueName: \"kubernetes.io/projected/a300937a-c01e-4ede-b77f-8daac34faeda-kube-api-access-w7bwp\") on node \"ip-10-0-134-29.ec2.internal\" DevicePath \"\""
Jul 06 14:32:10.819434 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.819409    2562 generic.go:356] "Generic (PLEG): container finished" podID="a300937a-c01e-4ede-b77f-8daac34faeda" containerID="faacaa5ccaca54c5a099f598e20156c95c5ad72d83258eca955378314a5f68f1" exitCode=0
Jul 06 14:32:10.819553 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.819456    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"
Jul 06 14:32:10.819553 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.819475    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f" event={"ID":"a300937a-c01e-4ede-b77f-8daac34faeda","Type":"ContainerDied","Data":"faacaa5ccaca54c5a099f598e20156c95c5ad72d83258eca955378314a5f68f1"}
Jul 06 14:32:10.819553 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.819516    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f" event={"ID":"a300937a-c01e-4ede-b77f-8daac34faeda","Type":"ContainerDied","Data":"9f403086b76b5a4bd429213e2585781ac1b0fcffe60335856fb1e005edabe115"}
Jul 06 14:32:10.819553 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.819538    2562 scope.go:117] "RemoveContainer" containerID="faacaa5ccaca54c5a099f598e20156c95c5ad72d83258eca955378314a5f68f1"
Jul 06 14:32:10.829180 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.829162    2562 scope.go:117] "RemoveContainer" containerID="faacaa5ccaca54c5a099f598e20156c95c5ad72d83258eca955378314a5f68f1"
Jul 06 14:32:10.829459 ip-10-0-134-29 kubenswrapper[2562]: E0706 14:32:10.829438    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faacaa5ccaca54c5a099f598e20156c95c5ad72d83258eca955378314a5f68f1\": container with ID starting with faacaa5ccaca54c5a099f598e20156c95c5ad72d83258eca955378314a5f68f1 not found: ID does not exist" containerID="faacaa5ccaca54c5a099f598e20156c95c5ad72d83258eca955378314a5f68f1"
Jul 06 14:32:10.829521 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.829469    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faacaa5ccaca54c5a099f598e20156c95c5ad72d83258eca955378314a5f68f1"} err="failed to get container status \"faacaa5ccaca54c5a099f598e20156c95c5ad72d83258eca955378314a5f68f1\": rpc error: code = NotFound desc = could not find container \"faacaa5ccaca54c5a099f598e20156c95c5ad72d83258eca955378314a5f68f1\": container with ID starting with faacaa5ccaca54c5a099f598e20156c95c5ad72d83258eca955378314a5f68f1 not found: ID does not exist"
Jul 06 14:32:10.839249 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.839232    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"]
Jul 06 14:32:10.843196 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:10.843177    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-2c86e0-7d4c66cc79-4bz2f"]
Jul 06 14:32:11.477183 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:11.477141    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a300937a-c01e-4ede-b77f-8daac34faeda" path="/var/lib/kubelet/pods/a300937a-c01e-4ede-b77f-8daac34faeda/volumes"
Jul 06 14:32:15.236439 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:15.236408    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:48.884751 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:48.884719    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:50.093928 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:50.093898    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:50.174196 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:50.174162    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:56.318005 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:56.317971    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:56.418770 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:56.418729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:56.578229 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:56.578149    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:32:56.795963 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:32:56.795929    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:01.714562 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:01.714529    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8rvn9_1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff/manager/0.log"
Jul 06 14:33:01.832127 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:01.832103    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zdjkc_4f18de81-e9cd-40b6-8454-ec576c220cf0/manager/0.log"
Jul 06 14:33:01.948558 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:01.948533    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-cf976bdf7-bc4s4_c0a4d357-60a8-4fd9-8f09-51818b9e0ff6/maas-api/0.log"
Jul 06 14:33:02.296686 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:02.296656    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-ccc479c74-ggsmn_bb960442-b6e1-4207-8708-819bf1a4125a/manager/0.log"
Jul 06 14:33:02.405530 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:02.405503    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qzt79_493caa25-6613-49b7-b33d-504f939cd182/server/0.log"
Jul 06 14:33:02.521101 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:02.521077    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bl2ks_43550359-6195-4904-9914-c2be03380e58/manager/0.log"
Jul 06 14:33:02.880302 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:02.880258    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8f457c8b-wprb5_0e53dd21-9406-48bd-ab19-d561825f96e7/manager/0.log"
Jul 06 14:33:02.886652 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:02.886631    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8f457c8b-wprb5_0e53dd21-9406-48bd-ab19-d561825f96e7/copy-manifests/0.log"
Jul 06 14:33:02.994000 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:02.993973    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-nqhlh_63490b36-2a2d-43bf-85a9-85779be66eab/postgres/0.log"
Jul 06 14:33:04.403617 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:04.403585    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-h2n4g_1e0e614a-13c5-481d-b5e7-66a46073d161/manager/0.log"
Jul 06 14:33:04.748781 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:04.748754    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xk76l_465e1166-e467-4fe1-84af-5c879ce2d745/registry-server/0.log"
Jul 06 14:33:04.860932 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:04.860902    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7hf48_93937712-cdfc-4c35-8e28-f3d51d5b34d7/manager/0.log"
Jul 06 14:33:05.429625 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:05.429597    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cdnsk_de50a145-08b8-4aa2-a36e-8efd7a536603/istio-proxy/0.log"
Jul 06 14:33:05.783038 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:05.783014    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6c964b95-vjh7s_67180de5-a0c7-4f3c-9a00-3a3a87d88369/kube-auth-proxy/0.log"
Jul 06 14:33:05.895922 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:05.895894    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5lts6_ae951262-860c-4a42-a6fb-fb80b36dcf06/istio-proxy/1.log"
Jul 06 14:33:06.007541 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:06.007516    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-r44vg_da6028d8-6496-40de-b86e-f9e5ac13cf4f/payload-pre-processing/0.log"
Jul 06 14:33:06.577747 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:06.577699    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-gth8k_5af45495-3394-4bb5-aa5e-abed54e1593c/main/0.log"
Jul 06 14:33:06.692704 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:06.692675    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-6pt4q_6d98bf8a-d97f-41e2-947e-77ddaf7f3321/main/0.log"
Jul 06 14:33:06.906107 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:06.906035    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkwbql_6e8b608b-a6bd-4037-962c-2b0c2c677977/main/0.log"
Jul 06 14:33:07.010706 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:07.010686    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-pl859_6bf0780a-dcc5-4221-9d09-ff2d7f2f5a20/main/0.log"
Jul 06 14:33:07.124258 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:07.124233    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-rbn2x_922b5ccd-d3d6-465a-a76d-5c2c96cc26c5/main/0.log"
Jul 06 14:33:11.205458 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:11.205416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:11.268819 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:11.268794    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:14.567526 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:14.567494    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-phwdx_3a9a4e3f-18cb-454f-ac12-66bf74123320/global-pull-secret-syncer/0.log"
Jul 06 14:33:14.616657 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:14.616627    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log"
Jul 06 14:33:14.726642 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:14.726614    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-29.ec2.internal_301d2e284fa3bf2b30f75ef544be44ae/haproxy/0.log"
Jul 06 14:33:19.964259 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:19.964227    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:20.027627 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:20.027599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pqhrv_18c06939-f48c-4f07-9be4-73b7f7968162/konnectivity-agent/0.log" limit=1024
Jul 06 14:33:20.599178 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:20.599148    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-h2n4g_1e0e614a-13c5-481d-b5e7-66a46073d161/manager/0.log"
Jul 06 14:33:20.706339 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:20.706311    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xk76l_465e1166-e467-4fe1-84af-5c879ce2d745/registry-server/0.log"
Jul 06 14:33:20.842020 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:20.841991    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7hf48_93937712-cdfc-4c35-8e28-f3d51d5b34d7/manager/0.log"
Jul 06 14:33:23.067399 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:23.067375    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j9mm5_99dca4be-3df5-49b5-af7d-7a95bfdac877/node-exporter/0.log"
Jul 06 14:33:23.089334 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:23.089314    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j9mm5_99dca4be-3df5-49b5-af7d-7a95bfdac877/kube-rbac-proxy/0.log"
Jul 06 14:33:23.110623 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:23.110601    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j9mm5_99dca4be-3df5-49b5-af7d-7a95bfdac877/init-textfile/0.log"
Jul 06 14:33:24.776043 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.776006    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"]
Jul 06 14:33:24.776870 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.776845    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a300937a-c01e-4ede-b77f-8daac34faeda" containerName="maas-api"
Jul 06 14:33:24.776985 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.776872    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a300937a-c01e-4ede-b77f-8daac34faeda" containerName="maas-api"
Jul 06 14:33:24.777069 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.777057    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a300937a-c01e-4ede-b77f-8daac34faeda" containerName="maas-api"
Jul 06 14:33:24.780892 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.780862    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:24.782995 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.782974    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-55pjj\"/\"kube-root-ca.crt\""
Jul 06 14:33:24.783801 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.783778    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-55pjj\"/\"openshift-service-ca.crt\""
Jul 06 14:33:24.783952 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.783794    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-55pjj\"/\"default-dockercfg-gmtfx\""
Jul 06 14:33:24.786249 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.786227    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"]
Jul 06 14:33:24.789949 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.789928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06b5a8a2-9212-41c4-a7b2-56389cc18c81-lib-modules\") pod \"perf-node-gather-daemonset-4blbv\" (UID: \"06b5a8a2-9212-41c4-a7b2-56389cc18c81\") " pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:24.790047 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.789961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06b5a8a2-9212-41c4-a7b2-56389cc18c81-podres\") pod \"perf-node-gather-daemonset-4blbv\" (UID: \"06b5a8a2-9212-41c4-a7b2-56389cc18c81\") " pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:24.790047 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.789978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06b5a8a2-9212-41c4-a7b2-56389cc18c81-proc\") pod \"perf-node-gather-daemonset-4blbv\" (UID: \"06b5a8a2-9212-41c4-a7b2-56389cc18c81\") " pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:24.790136 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.790084    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4dvx\" (UniqueName: \"kubernetes.io/projected/06b5a8a2-9212-41c4-a7b2-56389cc18c81-kube-api-access-n4dvx\") pod \"perf-node-gather-daemonset-4blbv\" (UID: \"06b5a8a2-9212-41c4-a7b2-56389cc18c81\") " pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:24.790136 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.790128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06b5a8a2-9212-41c4-a7b2-56389cc18c81-sys\") pod \"perf-node-gather-daemonset-4blbv\" (UID: \"06b5a8a2-9212-41c4-a7b2-56389cc18c81\") " pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:24.890537 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.890510    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06b5a8a2-9212-41c4-a7b2-56389cc18c81-lib-modules\") pod \"perf-node-gather-daemonset-4blbv\" (UID: \"06b5a8a2-9212-41c4-a7b2-56389cc18c81\") " pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:24.890708 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.890545    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06b5a8a2-9212-41c4-a7b2-56389cc18c81-podres\") pod \"perf-node-gather-daemonset-4blbv\" (UID: \"06b5a8a2-9212-41c4-a7b2-56389cc18c81\") " pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:24.890708 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.890562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06b5a8a2-9212-41c4-a7b2-56389cc18c81-proc\") pod \"perf-node-gather-daemonset-4blbv\" (UID: \"06b5a8a2-9212-41c4-a7b2-56389cc18c81\") " pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:24.890708 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.890597    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4dvx\" (UniqueName: \"kubernetes.io/projected/06b5a8a2-9212-41c4-a7b2-56389cc18c81-kube-api-access-n4dvx\") pod \"perf-node-gather-daemonset-4blbv\" (UID: \"06b5a8a2-9212-41c4-a7b2-56389cc18c81\") " pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:24.890708 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.890619    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06b5a8a2-9212-41c4-a7b2-56389cc18c81-sys\") pod \"perf-node-gather-daemonset-4blbv\" (UID: \"06b5a8a2-9212-41c4-a7b2-56389cc18c81\") " pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:24.890708 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.890665    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06b5a8a2-9212-41c4-a7b2-56389cc18c81-proc\") pod \"perf-node-gather-daemonset-4blbv\" (UID: \"06b5a8a2-9212-41c4-a7b2-56389cc18c81\") " pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:24.890708 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.890675    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06b5a8a2-9212-41c4-a7b2-56389cc18c81-sys\") pod \"perf-node-gather-daemonset-4blbv\" (UID: \"06b5a8a2-9212-41c4-a7b2-56389cc18c81\") " pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:24.890708 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.890685    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06b5a8a2-9212-41c4-a7b2-56389cc18c81-podres\") pod \"perf-node-gather-daemonset-4blbv\" (UID: \"06b5a8a2-9212-41c4-a7b2-56389cc18c81\") " pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:24.890708 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.890685    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06b5a8a2-9212-41c4-a7b2-56389cc18c81-lib-modules\") pod \"perf-node-gather-daemonset-4blbv\" (UID: \"06b5a8a2-9212-41c4-a7b2-56389cc18c81\") " pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:24.897599 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:24.897579    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4dvx\" (UniqueName: \"kubernetes.io/projected/06b5a8a2-9212-41c4-a7b2-56389cc18c81-kube-api-access-n4dvx\") pod \"perf-node-gather-daemonset-4blbv\" (UID: \"06b5a8a2-9212-41c4-a7b2-56389cc18c81\") " pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:25.092336 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:25.092220    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:25.224606 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:25.224578    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"]
Jul 06 14:33:25.229513 ip-10-0-134-29 kubenswrapper[2562]: W0706 14:33:25.229480    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod06b5a8a2_9212_41c4_a7b2_56389cc18c81.slice/crio-7604da7dbcfb663f67072dc90d5192ec3fa7501314f0e8ab772a434604ad18a2 WatchSource:0}: Error finding container 7604da7dbcfb663f67072dc90d5192ec3fa7501314f0e8ab772a434604ad18a2: Status 404 returned error can't find the container with id 7604da7dbcfb663f67072dc90d5192ec3fa7501314f0e8ab772a434604ad18a2
Jul 06 14:33:26.170188 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:26.170154    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv" event={"ID":"06b5a8a2-9212-41c4-a7b2-56389cc18c81","Type":"ContainerStarted","Data":"75b0667529a90522e94b3e2329ac9c0ab07a2cf4f98eed8746b3bbb9d02cae02"}
Jul 06 14:33:26.170593 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:26.170204    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv" event={"ID":"06b5a8a2-9212-41c4-a7b2-56389cc18c81","Type":"ContainerStarted","Data":"7604da7dbcfb663f67072dc90d5192ec3fa7501314f0e8ab772a434604ad18a2"}
Jul 06 14:33:26.170593 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:26.170268    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:26.184875 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:26.184831    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv" podStartSLOduration=2.1848179500000002 podStartE2EDuration="2.18481795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:33:26.184509718 +0000 UTC m=+2593.228120752" watchObservedRunningTime="2026-07-06 14:33:26.18481795 +0000 UTC m=+2593.228428984"
Jul 06 14:33:27.725870 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:27.725844    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qthdk_291d0af7-2df1-4fce-87ea-3891408c3616/dns/0.log"
Jul 06 14:33:27.748577 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:27.748555    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qthdk_291d0af7-2df1-4fce-87ea-3891408c3616/kube-rbac-proxy/0.log"
Jul 06 14:33:27.800461 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:27.800437    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f5jwm_a94e9db3-8b8e-462e-be17-8c0581a5063a/dns-node-resolver/0.log"
Jul 06 14:33:28.401143 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:28.401113    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rgwl6_38acd46b-6d99-4d86-afc7-88f95742a5ae/node-ca/0.log"
Jul 06 14:33:29.321636 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:29.321609    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cdnsk_de50a145-08b8-4aa2-a36e-8efd7a536603/istio-proxy/0.log"
Jul 06 14:33:29.475300 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:29.475256    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6c964b95-vjh7s_67180de5-a0c7-4f3c-9a00-3a3a87d88369/kube-auth-proxy/0.log"
Jul 06 14:33:29.506209 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:29.506155    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5lts6_ae951262-860c-4a42-a6fb-fb80b36dcf06/istio-proxy/0.log"
Jul 06 14:33:29.532645 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:29.532622    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5lts6_ae951262-860c-4a42-a6fb-fb80b36dcf06/istio-proxy/1.log"
Jul 06 14:33:29.561406 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:29.561383    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-r44vg_da6028d8-6496-40de-b86e-f9e5ac13cf4f/payload-pre-processing/0.log"
Jul 06 14:33:30.352636 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:30.352615    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w8j6d_9b8a09c7-319d-465b-82a2-d98f690fdb98/serve-healthcheck-canary/0.log"
Jul 06 14:33:30.905368 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:30.905339    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gmc4m_9b086829-b4d0-496f-ac10-87b31f68c230/kube-rbac-proxy/0.log"
Jul 06 14:33:30.925842 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:30.925820    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gmc4m_9b086829-b4d0-496f-ac10-87b31f68c230/exporter/0.log"
Jul 06 14:33:30.947413 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:30.947388    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gmc4m_9b086829-b4d0-496f-ac10-87b31f68c230/extractor/0.log"
Jul 06 14:33:32.184034 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:32.184010    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-55pjj/perf-node-gather-daemonset-4blbv"
Jul 06 14:33:33.064777 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:33.064753    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8rvn9_1d59f4f3-c041-4c34-b25c-8d32bfa6c5ff/manager/0.log"
Jul 06 14:33:33.188563 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:33.188535    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zdjkc_4f18de81-e9cd-40b6-8454-ec576c220cf0/manager/0.log"
Jul 06 14:33:33.221119 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:33.221093    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-cf976bdf7-bc4s4_c0a4d357-60a8-4fd9-8f09-51818b9e0ff6/maas-api/0.log"
Jul 06 14:33:33.359762 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:33.359693    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-ccc479c74-ggsmn_bb960442-b6e1-4207-8708-819bf1a4125a/manager/0.log"
Jul 06 14:33:33.380787 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:33.380772    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qzt79_493caa25-6613-49b7-b33d-504f939cd182/server/0.log"
Jul 06 14:33:33.451316 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:33.451275    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bl2ks_43550359-6195-4904-9914-c2be03380e58/manager/0.log"
Jul 06 14:33:33.622712 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:33.622648    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8f457c8b-wprb5_0e53dd21-9406-48bd-ab19-d561825f96e7/manager/0.log"
Jul 06 14:33:33.644184 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:33.644166    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8f457c8b-wprb5_0e53dd21-9406-48bd-ab19-d561825f96e7/copy-manifests/0.log"
Jul 06 14:33:33.670253 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:33.670232    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-nqhlh_63490b36-2a2d-43bf-85a9-85779be66eab/postgres/0.log"
Jul 06 14:33:35.305780 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:35.305748    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-5lfpk_ed74b5a8-06bd-4a90-aa95-8f59bf352de7/openshift-lws-operator/0.log"
Jul 06 14:33:35.529814 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:35.529783    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cdnsk_de50a145-08b8-4aa2-a36e-8efd7a536603/istio-proxy/0.log"
Jul 06 14:33:35.661026 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:35.661002    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6c964b95-vjh7s_67180de5-a0c7-4f3c-9a00-3a3a87d88369/kube-auth-proxy/0.log"
Jul 06 14:33:35.682477 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:35.682453    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5lts6_ae951262-860c-4a42-a6fb-fb80b36dcf06/istio-proxy/0.log"
Jul 06 14:33:35.710480 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:35.710452    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5lts6_ae951262-860c-4a42-a6fb-fb80b36dcf06/istio-proxy/1.log"
Jul 06 14:33:35.729261 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:35.729239    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-r44vg_da6028d8-6496-40de-b86e-f9e5ac13cf4f/payload-pre-processing/0.log"
Jul 06 14:33:36.974074 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:36.974044    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cdnsk_de50a145-08b8-4aa2-a36e-8efd7a536603/istio-proxy/0.log"
Jul 06 14:33:37.122266 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:37.122237    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6c964b95-vjh7s_67180de5-a0c7-4f3c-9a00-3a3a87d88369/kube-auth-proxy/0.log"
Jul 06 14:33:37.145377 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:37.145355    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5lts6_ae951262-860c-4a42-a6fb-fb80b36dcf06/istio-proxy/0.log"
Jul 06 14:33:37.169711 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:37.169684    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5lts6_ae951262-860c-4a42-a6fb-fb80b36dcf06/istio-proxy/1.log"
Jul 06 14:33:37.202315 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:37.202270    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-r44vg_da6028d8-6496-40de-b86e-f9e5ac13cf4f/payload-pre-processing/0.log"
Jul 06 14:33:41.741132 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:41.741103    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkvfk_5c87f08a-3127-4a61-996f-bc6587e6aac0/kube-multus-additional-cni-plugins/0.log"
Jul 06 14:33:41.762701 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:41.762681    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkvfk_5c87f08a-3127-4a61-996f-bc6587e6aac0/egress-router-binary-copy/0.log"
Jul 06 14:33:41.783164 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:41.783146    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkvfk_5c87f08a-3127-4a61-996f-bc6587e6aac0/cni-plugins/0.log"
Jul 06 14:33:41.804298 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:41.804256    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkvfk_5c87f08a-3127-4a61-996f-bc6587e6aac0/bond-cni-plugin/0.log"
Jul 06 14:33:41.826934 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:41.826914    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkvfk_5c87f08a-3127-4a61-996f-bc6587e6aac0/routeoverride-cni/0.log"
Jul 06 14:33:41.847640 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:41.847620    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkvfk_5c87f08a-3127-4a61-996f-bc6587e6aac0/whereabouts-cni-bincopy/0.log"
Jul 06 14:33:41.868040 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:41.868021    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkvfk_5c87f08a-3127-4a61-996f-bc6587e6aac0/whereabouts-cni/0.log"
Jul 06 14:33:42.138581 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:42.138514    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rcvp6_f746ee95-1693-446d-a812-87d631385277/kube-multus/0.log"
Jul 06 14:33:42.206299 ip-10-0-134-29 kubenswrapper[2562]: I0706 14:33:42.206260    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cxr4t_aab6a8f0-2336-4d20-996a-2ac646db3fa9/network-metrics-daemon/0.log"