Jul 09 22:06:47.237903 ip-10-0-133-135 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 22:06:47.237913 ip-10-0-133-135 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 22:06:47.237920 ip-10-0-133-135 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 22:06:47.238121 ip-10-0-133-135 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 22:06:57.259767 ip-10-0-133-135 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 22:06:57.259784 ip-10-0-133-135 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8ba7531e5d9d4ab88a4f8566a630c641 --
Jul 09 22:08:57.213348 ip-10-0-133-135 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 22:08:57.586878 ip-10-0-133-135 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 22:08:57.586878 ip-10-0-133-135 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 22:08:57.586878 ip-10-0-133-135 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 22:08:57.587379 ip-10-0-133-135 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 22:08:57.587379 ip-10-0-133-135 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 22:08:57.589413 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.589293    2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 22:08:57.592978 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.592961    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:08:57.592978 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.592977    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.592984    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.592998    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593002    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593006    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593009    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593012    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593014    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593017    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593020    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593023    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593026    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593029    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593033    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593037    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593040    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593043    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593046    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593048    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:08:57.593054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593051    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593054    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593058    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593061    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593065    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593068    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593071    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593073    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593076    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593079    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593081    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593084    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593088    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593090    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593093    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593096    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593099    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593102    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593104    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593123    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:08:57.593632 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593128    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593132    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593135    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593138    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593141    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593143    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593146    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593149    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593152    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593155    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593157    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593160    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593163    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593165    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593169    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593172    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593175    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593179    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593183    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:08:57.594472 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593186    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593190    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593193    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593196    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593199    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593201    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593206    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593209    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593212    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593214    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593217    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593220    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593223    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593226    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593228    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593231    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593234    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593236    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593239    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:08:57.594973 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593242    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593245    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593248    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593250    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593253    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593256    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593258    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593261    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593264    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593268    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593271    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593274    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593276    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593279    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593282    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593285    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593287    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593290    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593293    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593296    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:08:57.595491 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.593299    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595357    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595375    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595379    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595382    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595386    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595390    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595393    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595396    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595399    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595402    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595405    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595407    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595412    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595417    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595420    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595423    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595426    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595428    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595431    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:08:57.596044 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595436    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595439    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595441    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595444    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595447    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595450    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595453    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595456    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595458    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595461    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595464    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595467    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595470    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595480    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595483    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595485    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595490    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595494    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595498    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:08:57.596598 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595501    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595504    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595508    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595511    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595514    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595517    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595520    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595523    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595525    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595528    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595531    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595533    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595536    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595540    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595543    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595546    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595550    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595552    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595555    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595558    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:08:57.597127 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595561    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595563    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595566    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595569    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595571    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595574    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595577    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595579    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595583    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595588    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595591    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595594    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595597    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595600    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595603    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595606    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595608    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595611    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595613    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595616    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:08:57.597654 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595619    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595622    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595625    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595628    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595631    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595635    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595638    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595641    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595645    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595648    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595651    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595654    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595656    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595659    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595662    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595665    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595668    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595671    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595674    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595676    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.595679    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:08:57.598213 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596132    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596138    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596140    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596143    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596147    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596150    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596153    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596155    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596158    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596161    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596164    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596167    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596170    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596172    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596175    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596178    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596183    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596186    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596189    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596191    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596194    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:08:57.598752 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596197    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596200    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596203    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596206    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596208    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596211    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596214    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596216    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596219    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596222    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596225    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596227    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596230    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596235    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596239    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596242    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596246    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596249    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596252    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:08:57.599313 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596255    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596258    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596261    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596264    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596267    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596269    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596272    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596275    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596278    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596281    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596284    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596287    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596289    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596292    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596295    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596315    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596319    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596322    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596325    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596329    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:08:57.599814 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596332    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596335    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596339    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596342    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596345    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596348    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596351    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596354    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596357    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596361    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596364    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596367    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596373    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596376    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596379    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596382    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596385    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596388    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596390    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:08:57.600349 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596393    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596396    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596398    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596402    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596405    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596408    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596412    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596415    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596418    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596420    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596423    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596426    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596428    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596431    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596434    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596437    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596440    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596442    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596446    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.596450    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:08:57.600847 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596527    2554 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596534    2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596540    2554 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596545    2554 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596550    2554 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596555    2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596560    2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596565    2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596570    2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596573    2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596577    2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596580    2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596584    2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596587    2554 flags.go:64] FLAG: --cgroup-root=""
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596590    2554 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596594    2554 flags.go:64] FLAG: --client-ca-file=""
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596597    2554 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596601    2554 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596606    2554 flags.go:64] FLAG: --cluster-domain=""
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596609    2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596612    2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596616    2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596620    2554 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596624    2554 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 22:08:57.601437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596627    2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596630    2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596634    2554 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596637    2554 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596640    2554 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596643    2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596646    2554 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596649    2554 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596654    2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596657    2554 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596660    2554 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596663    2554 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596667    2554 flags.go:64] FLAG: --enable-server="true"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596671    2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596675    2554 flags.go:64] FLAG: --event-burst="100"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596678    2554 flags.go:64] FLAG: --event-qps="50"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596683    2554 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596686    2554 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596689    2554 flags.go:64] FLAG: --eviction-hard=""
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596694    2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596697    2554 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596700    2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596703    2554 flags.go:64] FLAG: --eviction-soft=""
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596706    2554 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596709    2554 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 22:08:57.602056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596713    2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596716    2554 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596719    2554 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596722    2554 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596725    2554 flags.go:64] FLAG: --feature-gates=""
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596729    2554 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596733    2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596736    2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596740    2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596743    2554 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596746    2554 flags.go:64] FLAG: --help="false"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596749    2554 flags.go:64] FLAG: --hostname-override="ip-10-0-133-135.ec2.internal"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596752    2554 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596756    2554 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596759    2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596762    2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596766    2554 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596769    2554 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596772    2554 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596775    2554 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596781    2554 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596784    2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596787    2554 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596792    2554 flags.go:64] FLAG: --kube-reserved=""
Jul 09 22:08:57.602751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596795    2554 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596799    2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596802    2554 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596806    2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596809    2554 flags.go:64] FLAG: --lock-file=""
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596812    2554 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596815    2554 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596819    2554 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596830    2554 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596835    2554 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596838    2554 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596841    2554 flags.go:64] FLAG: --logging-format="text"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596844    2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596848    2554 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596851    2554 flags.go:64] FLAG: --manifest-url=""
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596854    2554 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596859    2554 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596862    2554 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596866    2554 flags.go:64] FLAG: --max-pods="110"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596870    2554 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596873    2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596876    2554 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596879    2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596882    2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596885    2554 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 22:08:57.603386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596889    2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596897    2554 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596900    2554 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596905    2554 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596908    2554 flags.go:64] FLAG: --pod-cidr=""
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596911    2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596918    2554 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596921    2554 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596925    2554 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596928    2554 flags.go:64] FLAG: --port="10250"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596931    2554 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596934    2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06c0d92e87637c1d8"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596938    2554 flags.go:64] FLAG: --qos-reserved=""
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596941    2554 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596944    2554 flags.go:64] FLAG: --register-node="true"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596947    2554 flags.go:64] FLAG: --register-with-taints=""
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596951    2554 flags.go:64] FLAG: --registry-burst="10"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596954    2554 flags.go:64] FLAG: --registry-qps="5"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596958    2554 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596960    2554 flags.go:64] FLAG: --reserved-memory=""
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596964    2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596967    2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596971    2554 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596974    2554 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596977    2554 flags.go:64] FLAG: --runonce="false"
Jul 09 22:08:57.604046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596980    2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596983    2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596986    2554 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596989    2554 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596992    2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596995    2554 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.596999    2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597002    2554 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597005    2554 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597008    2554 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597011    2554 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597016    2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597019    2554 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597024    2554 flags.go:64] FLAG: --system-cgroups=""
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597027    2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597033    2554 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597036    2554 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597039    2554 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597044    2554 flags.go:64] FLAG: --tls-min-version=""
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597047    2554 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597049    2554 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597053    2554 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597056    2554 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597059    2554 flags.go:64] FLAG: --v="2"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597063    2554 flags.go:64] FLAG: --version="false"
Jul 09 22:08:57.604729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597068    2554 flags.go:64] FLAG: --vmodule=""
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597072    2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597075    2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597220    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597225    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597229    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597232    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597235    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597238    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597241    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597244    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597247    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597250    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597253    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597256    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597259    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597261    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597264    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597268    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597270    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:08:57.605450 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597274    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597277    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597279    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597282    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597285    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597287    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597290    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597293    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597296    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597298    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597301    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597303    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597306    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597313    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597316    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597318    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597321    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597325    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597329    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597332    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:08:57.605971 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597334    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597337    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597339    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597342    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597345    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597348    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597350    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597353    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597356    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597358    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597361    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597365    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597369    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597372    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597375    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597377    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597380    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597383    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597386    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:08:57.606518 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597389    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597391    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597394    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597397    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597399    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597402    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597405    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597409    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597411    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597414    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597417    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597419    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597422    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597425    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597427    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597430    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597433    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597435    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597440    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597443    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:08:57.607018 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597446    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597449    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597452    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597455    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597458    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597461    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597464    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597467    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597470    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597472    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597475    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597477    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597480    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597483    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597485    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597488    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597491    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597494    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597497    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:08:57.607549 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597500    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:08:57.608053 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597503    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:08:57.608053 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597506    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:08:57.608053 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.597509    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:08:57.608053 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.597514    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 22:08:57.608053 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.604575    2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 09 22:08:57.608053 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.604591    2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 22:08:57.608053 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.605334    2554 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 22:08:57.608053 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.605342    2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 22:08:57.608053 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605405    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:08:57.608053 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605411    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:08:57.608053 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605415    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:08:57.608053 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605419    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:08:57.608053 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605422    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:08:57.608053 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605426    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:08:57.608053 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605428    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605431    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605434    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605439    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605443    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605446    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605449    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605453    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605456    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605458    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605461    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605464    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605467    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605470    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605473    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605476    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605478    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605481    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605483    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605487    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:08:57.608535 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605490    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605492    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605495    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605500    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605503    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605506    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605508    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605512    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605515    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605517    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605520    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605523    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605526    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605528    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605531    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605534    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605536    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605539    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605542    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605545    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:08:57.609064 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605548    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605550    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605553    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605556    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605558    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605561    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605564    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605566    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605569    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605574    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605577    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605582    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605586    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605589    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605592    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605597    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605600    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605603    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605606    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:08:57.609617 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605609    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605612    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605615    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605618    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605620    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605623    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605626    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605629    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605631    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605634    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605637    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605640    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605643    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605645    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605648    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605651    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605653    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605656    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605659    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605662    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:08:57.610120 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605664    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:08:57.610640 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605667    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:08:57.610640 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605669    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:08:57.610640 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605672    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:08:57.610640 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605675    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:08:57.610640 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605678    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:08:57.610640 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605681    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:08:57.610640 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605684    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:08:57.610640 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605687    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:08:57.610640 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605690    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:08:57.610640 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605693    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:08:57.610640 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605696    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:08:57.610640 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605699    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:08:57.610640 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605702    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:08:57.610640 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.605707    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 22:08:57.610640 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605829    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605834    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605837    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605840    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605843    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605847    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605852    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605855    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605858    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605861    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605864    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605867    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605870    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605873    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605876    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605879    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605881    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605884    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605887    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605890    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:08:57.611084 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605893    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605896    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605899    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605901    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605904    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605907    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605910    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605912    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605916    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605919    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605922    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605924    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605927    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605930    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605932    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605935    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605938    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605940    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605943    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605946    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:08:57.611633 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605948    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605951    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605954    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605956    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605960    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605962    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605967    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605970    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605973    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605976    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605979    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605982    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605985    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605988    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605991    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605993    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605996    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.605999    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606001    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:08:57.612168 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606004    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606007    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606011    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606013    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606016    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606019    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606022    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606024    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606027    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606029    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606032    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606035    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606038    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606040    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606043    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606046    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606049    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606051    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606054    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606057    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:08:57.612770 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606059    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606062    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606065    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606072    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606075    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606078    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606081    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606084    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606087    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606108    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606113    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606117    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606121    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606124    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606127    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606131    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606134    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606137    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606140    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:08:57.613337 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:57.606144    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:08:57.613854 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.606149    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 22:08:57.613854 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.606263    2554 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 22:08:57.613854 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.608467    2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 22:08:57.613854 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.609947    2554 server.go:1019] "Starting client certificate rotation"
Jul 09 22:08:57.613854 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.610061    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 22:08:57.613854 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.610097    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 22:08:57.613854 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.612800    2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 22:08:57.614771 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.614745    2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 22:08:57.625354 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.625334    2554 log.go:25] "Validated CRI v1 runtime API"
Jul 09 22:08:57.627517 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.627502    2554 log.go:25] "Validated CRI v1 image API"
Jul 09 22:08:57.629114 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.629090    2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 22:08:57.632161 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.632135    2554 fs.go:135] Filesystem UUIDs: map[270f8fed-734d-44d0-85a4-290f0a5d3a71:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 fab72a53-5d4e-410b-8003-13da05961e01:/dev/nvme0n1p4]
Jul 09 22:08:57.632234 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.632158    2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 22:08:57.638843 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.638713    2554 manager.go:216] Machine: {Timestamp:2026-07-09 22:08:57.636439487 +0000 UTC m=+0.310438283 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100307 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2aa46ff2ed666dedd06c56adf990d1 SystemUUID:ec2aa46f-f2ed-666d-edd0-6c56adf990d1 BootID:8ba7531e-5d9d-4ab8-8a4f-8566a630c641 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fc:21:3f:e8:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fc:21:3f:e8:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:43:d2:72:c2:6f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 22:08:57.638843 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.638834    2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 22:08:57.638998 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.638925    2554 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 22:08:57.642342 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.642309    2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 22:08:57.642543 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.642346    2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-135.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 22:08:57.643222 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.643208    2554 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 22:08:57.643281 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.643228    2554 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 22:08:57.643281 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.643246    2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 22:08:57.643908 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.643896    2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 22:08:57.645298 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.645286    2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 22:08:57.645640 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.645621    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 22:08:57.649329 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.649313    2554 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 22:08:57.649509 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.649497    2554 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 22:08:57.649570 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.649541    2554 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 22:08:57.649570 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.649556    2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 22:08:57.649660 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.649572    2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 22:08:57.649660 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.649585    2554 kubelet.go:398] "Adding apiserver pod source"
Jul 09 22:08:57.649660 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.649603    2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 22:08:57.650039 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.650024    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 22:08:57.650102 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.650053    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 22:08:57.653719 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.653699    2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 09 22:08:57.655638 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.655618    2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 22:08:57.655706 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.655666    2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 22:08:57.656914 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.656901    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 22:08:57.656957 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.656919    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 22:08:57.656957 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.656925    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 22:08:57.656957 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.656931    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 22:08:57.656957 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.656942    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 22:08:57.656957 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.656950    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 22:08:57.657097 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.656960    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 22:08:57.657097 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.656967    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 22:08:57.657097 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.656974    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 22:08:57.657097 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.656980    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 22:08:57.657097 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.656988    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 22:08:57.657097 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.656994    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 22:08:57.658368 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.658358    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 22:08:57.658368 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.658369    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 22:08:57.661733 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.661719    2554 server.go:1268] "Started kubelet"
Jul 09 22:08:57.661884 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.661845    2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 22:08:57.661944 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.661872    2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 22:08:57.661944 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.661925    2554 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 22:08:57.666019 ip-10-0-133-135 systemd[1]: Started Kubernetes Kubelet.
Jul 09 22:08:57.667793 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.665903    2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 22:08:57.667793 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.667426    2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-135.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 22:08:57.667793 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.667479    2554 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 22:08:57.668136 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:57.668098    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 22:08:57.668247 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:57.668099    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 22:08:57.671092 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:57.671072    2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 22:08:57.674262 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.674240    2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 22:08:57.674262 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.674256    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 22:08:57.674432 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:57.674323    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-135.ec2.internal\" not found"
Jul 09 22:08:57.675039 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.675020    2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 22:08:57.675152 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.675026    2554 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 22:08:57.675152 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.675065    2554 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 22:08:57.675262 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.675157    2554 factory.go:55] Registering systemd factory
Jul 09 22:08:57.675262 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.675167    2554 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 22:08:57.675262 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.675180    2554 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 22:08:57.675262 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.675174    2554 factory.go:223] Registration of the systemd container factory successfully
Jul 09 22:08:57.675262 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:57.674146    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-135.ec2.internal.18c0be86944d0b35  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-135.ec2.internal,UID:ip-10-0-133-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-135.ec2.internal,},FirstTimestamp:2026-07-09 22:08:57.661688629 +0000 UTC m=+0.335687424,LastTimestamp:2026-07-09 22:08:57.661688629 +0000 UTC m=+0.335687424,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-135.ec2.internal,}"
Jul 09 22:08:57.675481 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.675436    2554 factory.go:153] Registering CRI-O factory
Jul 09 22:08:57.675481 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.675452    2554 factory.go:223] Registration of the crio container factory successfully
Jul 09 22:08:57.675579 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.675506    2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 22:08:57.675579 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.675535    2554 factory.go:103] Registering Raw factory
Jul 09 22:08:57.675579 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.675551    2554 manager.go:1196] Started watching for new ooms in manager
Jul 09 22:08:57.675978 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.675963    2554 manager.go:349] Starting recovery of all containers
Jul 09 22:08:57.680295 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:57.680256    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 22:08:57.680408 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:57.680268    2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 22:08:57.686869 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.686842    2554 manager.go:354] Recovery completed
Jul 09 22:08:57.688407 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:57.688371    2554 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 09 22:08:57.693202 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.693183    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:08:57.695589 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.695435    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2p9hj"
Jul 09 22:08:57.695744 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.695729    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:08:57.695796 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.695762    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:08:57.695796 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.695775    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:08:57.696453 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.696437    2554 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 22:08:57.696453 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.696451    2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 22:08:57.696604 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.696468    2554 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 22:08:57.696604 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.696451    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:08:57.697470 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.697453    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:08:57.697534 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.697481    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:08:57.697534 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.697492    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:08:57.698487 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:57.698394    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-135.ec2.internal.18c0be869654b886  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-135.ec2.internal,UID:ip-10-0-133-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-135.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-135.ec2.internal,},FirstTimestamp:2026-07-09 22:08:57.695746182 +0000 UTC m=+0.369744981,LastTimestamp:2026-07-09 22:08:57.695746182 +0000 UTC m=+0.369744981,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-135.ec2.internal,}"
Jul 09 22:08:57.698794 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.698781    2554 policy_none.go:49] "None policy: Start"
Jul 09 22:08:57.698848 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.698798    2554 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 22:08:57.698848 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.698809    2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 22:08:57.700899 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.700888    2554 policy_none.go:47] "Start"
Jul 09 22:08:57.702493 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.702470    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2p9hj"
Jul 09 22:08:57.740716 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.740697    2554 manager.go:337] "Starting Device Plugin manager"
Jul 09 22:08:57.740846 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:57.740733    2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 22:08:57.740846 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.740750    2554 server.go:87] "Starting device plugin registration server"
Jul 09 22:08:57.741061 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.741047    2554 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 22:08:57.741124 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.741069    2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 22:08:57.741246 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.741203    2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 22:08:57.741311 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.741289    2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 22:08:57.741311 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.741297    2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 22:08:57.741779 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:57.741749    2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 22:08:57.741852 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:57.741819    2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-135.ec2.internal\" not found"
Jul 09 22:08:57.843332 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.843241    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:08:57.845605 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.844702    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:08:57.845605 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.844730    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:08:57.845605 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.844740    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:08:57.845605 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.844783    2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-135.ec2.internal"
Jul 09 22:08:57.856425 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.856405    2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-135.ec2.internal"
Jul 09 22:08:57.856553 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:57.856434    2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-135.ec2.internal\": node \"ip-10-0-133-135.ec2.internal\" not found"
Jul 09 22:08:57.872758 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:57.872733    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-135.ec2.internal\" not found"
Jul 09 22:08:57.873738 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.873711    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 22:08:57.875204 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.875179    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 22:08:57.875315 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.875215    2554 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 22:08:57.875315 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.875236    2554 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 22:08:57.875315 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:57.875266    2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 22:08:57.877643 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.877614    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:08:57.977548 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:57.977478    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-135.ec2.internal\" not found"
Jul 09 22:08:57.977548 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.977516    2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-135.ec2.internal"]
Jul 09 22:08:57.977778 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.977601    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:08:57.978746 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.978728    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:08:57.978859 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.978764    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:08:57.978859 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.978776    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:08:57.981198 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.981185    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:08:57.981325 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.981308    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal"
Jul 09 22:08:57.981368 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.981352    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:08:57.982008 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.981991    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:08:57.982098 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.982024    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:08:57.982098 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.982039    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:08:57.982098 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.982062    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:08:57.982098 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.982087    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:08:57.982327 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.982102    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:08:57.984387 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.984368    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-135.ec2.internal"
Jul 09 22:08:57.984474 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.984402    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:08:57.985232 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.985218    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:08:57.985315 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.985251    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:08:57.985315 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:57.985267    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:08:58.001726 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:58.001703    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-135.ec2.internal\" not found" node="ip-10-0-133-135.ec2.internal"
Jul 09 22:08:58.006488 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:58.006468    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-135.ec2.internal\" not found" node="ip-10-0-133-135.ec2.internal"
Jul 09 22:08:58.078444 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:58.078406    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-135.ec2.internal\" not found"
Jul 09 22:08:58.078444 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:58.078446    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c91bebd301ade1d28163632064920d02-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal\" (UID: \"c91bebd301ade1d28163632064920d02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal"
Jul 09 22:08:58.078659 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:58.078478    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c91bebd301ade1d28163632064920d02-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal\" (UID: \"c91bebd301ade1d28163632064920d02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal"
Jul 09 22:08:58.078659 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:58.078502    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7850db39ed65d429ad5a6c9d967e5873-config\") pod \"kube-apiserver-proxy-ip-10-0-133-135.ec2.internal\" (UID: \"7850db39ed65d429ad5a6c9d967e5873\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-135.ec2.internal"
Jul 09 22:08:58.178675 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:58.178569    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-135.ec2.internal\" not found"
Jul 09 22:08:58.178675 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:58.178612    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c91bebd301ade1d28163632064920d02-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal\" (UID: \"c91bebd301ade1d28163632064920d02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal"
Jul 09 22:08:58.178675 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:58.178649    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7850db39ed65d429ad5a6c9d967e5873-config\") pod \"kube-apiserver-proxy-ip-10-0-133-135.ec2.internal\" (UID: \"7850db39ed65d429ad5a6c9d967e5873\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-135.ec2.internal"
Jul 09 22:08:58.178908 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:58.178703    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c91bebd301ade1d28163632064920d02-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal\" (UID: \"c91bebd301ade1d28163632064920d02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal"
Jul 09 22:08:58.178908 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:58.178720    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c91bebd301ade1d28163632064920d02-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal\" (UID: \"c91bebd301ade1d28163632064920d02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal"
Jul 09 22:08:58.178908 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:58.178740    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c91bebd301ade1d28163632064920d02-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal\" (UID: \"c91bebd301ade1d28163632064920d02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal"
Jul 09 22:08:58.178908 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:58.178788    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7850db39ed65d429ad5a6c9d967e5873-config\") pod \"kube-apiserver-proxy-ip-10-0-133-135.ec2.internal\" (UID: \"7850db39ed65d429ad5a6c9d967e5873\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-135.ec2.internal"
Jul 09 22:08:58.278735 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:58.278700    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-135.ec2.internal\" not found"
Jul 09 22:08:58.305927 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:58.305890    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal"
Jul 09 22:08:58.309273 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:58.309250    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-135.ec2.internal"
Jul 09 22:08:58.379884 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:58.379849    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-135.ec2.internal\" not found"
Jul 09 22:08:58.480312 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:58.480223    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-135.ec2.internal\" not found"
Jul 09 22:08:58.582231 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:58.582198    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-135.ec2.internal\" not found"
Jul 09 22:08:58.610523 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:58.610499    2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 22:08:58.610908 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:58.610656    2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 22:08:58.663339 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:58.663305    2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:08:58.683403 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:58.683372    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-135.ec2.internal\" not found"
Jul 09 22:08:58.707342 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:58.707307    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 22:03:57 +0000 UTC" deadline="2028-02-09 11:22:25.194498868 +0000 UTC"
Jul 09 22:08:58.707342 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:58.707335    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13909h13m26.487166806s"
Jul 09 22:08:58.783881 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:58.783806    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-135.ec2.internal\" not found"
Jul 09 22:08:58.884115 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:58.884083    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-135.ec2.internal\" not found"
Jul 09 22:08:58.984462 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:58.984428    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-135.ec2.internal\" not found"
Jul 09 22:08:59.039259 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.039196    2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:08:59.074974 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.074951    2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:08:59.079662 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:59.079614    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7850db39ed65d429ad5a6c9d967e5873.slice/crio-3d7208c3ab81ff7dcf64826ed7ea09b837570ac486bba5792ce6f8f44505afec WatchSource:0}: Error finding container 3d7208c3ab81ff7dcf64826ed7ea09b837570ac486bba5792ce6f8f44505afec: Status 404 returned error can't find the container with id 3d7208c3ab81ff7dcf64826ed7ea09b837570ac486bba5792ce6f8f44505afec
Jul 09 22:08:59.080346 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:08:59.080328    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc91bebd301ade1d28163632064920d02.slice/crio-e999a3ade4082e8fdcb4a4151f5b4eebda113989b5e62d846129cff86bd6ff66 WatchSource:0}: Error finding container e999a3ade4082e8fdcb4a4151f5b4eebda113989b5e62d846129cff86bd6ff66: Status 404 returned error can't find the container with id e999a3ade4082e8fdcb4a4151f5b4eebda113989b5e62d846129cff86bd6ff66
Jul 09 22:08:59.084027 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.084013    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:08:59.174715 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.174661    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal"
Jul 09 22:08:59.190554 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.190528    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 22:08:59.191517 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.191503    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-135.ec2.internal"
Jul 09 22:08:59.203078 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.203059    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 22:08:59.548587 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.548546    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:08:59.650796 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.650764    2554 apiserver.go:52] "Watching apiserver"
Jul 09 22:08:59.658736 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.658708    2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 22:08:59.660432 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.660395    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-dr287","openshift-image-registry/node-ca-lmtn5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal","openshift-multus/multus-kk85f","openshift-multus/network-metrics-daemon-ffzhl","openshift-network-diagnostics/network-check-target-7sgxg","kube-system/kube-apiserver-proxy-ip-10-0-133-135.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm","openshift-dns/node-resolver-lrllf","openshift-multus/multus-additional-cni-plugins-hfzth","openshift-network-operator/iptables-alerter-qfsw9","openshift-ovn-kubernetes/ovnkube-node-t7g2j","kube-system/global-pull-secret-syncer-bjslv","kube-system/konnectivity-agent-gl8zs"]
Jul 09 22:08:59.662861 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.662833    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qfsw9"
Jul 09 22:08:59.665087 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.665047    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lmtn5"
Jul 09 22:08:59.666168 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.665752    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wsjtt\""
Jul 09 22:08:59.666168 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.665861    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:08:59.666168 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.665996    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 22:08:59.666168 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.666166    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 22:08:59.667568 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.667438    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gl8zs"
Jul 09 22:08:59.667761 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.667741    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 22:08:59.667890 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.667874    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 22:08:59.668268 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.668251    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s8vdc\""
Jul 09 22:08:59.668351 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.668272    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 22:08:59.669579 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.669559    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 22:08:59.669850 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.669830    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.669941 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.669857    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lbphc\""
Jul 09 22:08:59.671172 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.671135    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 22:08:59.672537 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.672131    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.674670 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.674653    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:08:59.674760 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:59.674723    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:08:59.674956 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.674940    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 22:08:59.675536 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.675364    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 22:08:59.677057 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.676736    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p7n2t\""
Jul 09 22:08:59.677057 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.676807    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 22:08:59.677057 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.676918    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 22:08:59.680309 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.680286    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 22:08:59.680507 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.680488    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 22:08:59.680595 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.680507    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 22:08:59.680595 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.680588    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-swtc5\""
Jul 09 22:08:59.680720 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.680662    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 22:08:59.680809 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.680793    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 22:08:59.680966 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.680949    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 22:08:59.680966 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.680959    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.682925 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.682841    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 22:08:59.683642 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.683575    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lrllf"
Jul 09 22:08:59.685535 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.685515    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.685636 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.685615    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 22:08:59.685859 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.685837    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 22:08:59.685918 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.685861    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 22:08:59.686059 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686027    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 22:08:59.686151 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686135    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 22:08:59.686392 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686373    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b9cfx\""
Jul 09 22:08:59.686468 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686377    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ce766ac-353c-44b3-8c68-5c6e6b2bccc3-host\") pod \"node-ca-lmtn5\" (UID: \"8ce766ac-353c-44b3-8c68-5c6e6b2bccc3\") " pod="openshift-image-registry/node-ca-lmtn5"
Jul 09 22:08:59.686533 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686469    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-kubelet\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.686533 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686496    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-cni-netd\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.686533 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686523    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d459efc1-509f-45c0-899d-0b1a1dd1f03b-ovnkube-config\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.686712 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686550    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nw9v6\""
Jul 09 22:08:59.686712 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686548    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/545c474d-0051-4db8-8d2e-e188d6fd6583-system-cni-dir\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.686712 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686595    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w9qb\" (UniqueName: \"kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb\") pod \"network-check-target-7sgxg\" (UID: \"d9c25735-b855-4b54-aa6a-40d2769327fd\") " pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:08:59.686712 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686621    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-socket-dir\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.686712 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686648    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/545c474d-0051-4db8-8d2e-e188d6fd6583-cni-binary-copy\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.686712 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686673    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrdfm\" (UniqueName: \"kubernetes.io/projected/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-kube-api-access-zrdfm\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.687000 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686696    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-var-lib-openvswitch\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.687000 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686758    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 22:08:59.687000 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686770    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-cni-bin\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.687000 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686815    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.687000 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686844    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdt2x\" (UniqueName: \"kubernetes.io/projected/d459efc1-509f-45c0-899d-0b1a1dd1f03b-kube-api-access-tdt2x\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.687000 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686875    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/545c474d-0051-4db8-8d2e-e188d6fd6583-os-release\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.687000 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686900    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/545c474d-0051-4db8-8d2e-e188d6fd6583-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.687000 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686932    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqv29\" (UniqueName: \"kubernetes.io/projected/545c474d-0051-4db8-8d2e-e188d6fd6583-kube-api-access-mqv29\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.687000 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686956    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a556b16-7099-4306-9ac8-9bfa8d61e326-host-slash\") pod \"iptables-alerter-qfsw9\" (UID: \"4a556b16-7099-4306-9ac8-9bfa8d61e326\") " pod="openshift-network-operator/iptables-alerter-qfsw9"
Jul 09 22:08:59.687000 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.686981    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-slash\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.687000 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687002    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-etc-openvswitch\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.687592 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687025    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-run-ovn\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.687592 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687074    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d459efc1-509f-45c0-899d-0b1a1dd1f03b-env-overrides\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.687592 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687096    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-etc-selinux\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.687592 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687121    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/545c474d-0051-4db8-8d2e-e188d6fd6583-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.687592 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687177    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv2ql\" (UniqueName: \"kubernetes.io/projected/4a556b16-7099-4306-9ac8-9bfa8d61e326-kube-api-access-xv2ql\") pod \"iptables-alerter-qfsw9\" (UID: \"4a556b16-7099-4306-9ac8-9bfa8d61e326\") " pod="openshift-network-operator/iptables-alerter-qfsw9"
Jul 09 22:08:59.687592 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687208    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-device-dir\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.687592 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687231    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ce766ac-353c-44b3-8c68-5c6e6b2bccc3-serviceca\") pod \"node-ca-lmtn5\" (UID: \"8ce766ac-353c-44b3-8c68-5c6e6b2bccc3\") " pod="openshift-image-registry/node-ca-lmtn5"
Jul 09 22:08:59.687592 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687255    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hj67\" (UniqueName: \"kubernetes.io/projected/8ce766ac-353c-44b3-8c68-5c6e6b2bccc3-kube-api-access-2hj67\") pod \"node-ca-lmtn5\" (UID: \"8ce766ac-353c-44b3-8c68-5c6e6b2bccc3\") " pod="openshift-image-registry/node-ca-lmtn5"
Jul 09 22:08:59.687592 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687283    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-run-netns\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.687592 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687306    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-run-systemd\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.687592 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687343    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-run-openvswitch\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.687592 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687372    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-node-log\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.687592 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687400    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-log-socket\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.687592 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687430    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d459efc1-509f-45c0-899d-0b1a1dd1f03b-ovn-node-metrics-cert\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.687592 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687460    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/070b7889-a211-4188-860f-ba36d9e5e7a4-konnectivity-ca\") pod \"konnectivity-agent-gl8zs\" (UID: \"070b7889-a211-4188-860f-ba36d9e5e7a4\") " pod="kube-system/konnectivity-agent-gl8zs"
Jul 09 22:08:59.687592 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687489    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.688439 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687529    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d459efc1-509f-45c0-899d-0b1a1dd1f03b-ovnkube-script-lib\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.688439 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687561    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/545c474d-0051-4db8-8d2e-e188d6fd6583-cnibin\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.688439 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687595    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/545c474d-0051-4db8-8d2e-e188d6fd6583-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.688439 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687623    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:08:59.688439 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687621    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a556b16-7099-4306-9ac8-9bfa8d61e326-iptables-alerter-script\") pod \"iptables-alerter-qfsw9\" (UID: \"4a556b16-7099-4306-9ac8-9bfa8d61e326\") " pod="openshift-network-operator/iptables-alerter-qfsw9"
Jul 09 22:08:59.688439 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:59.687682    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:08:59.688439 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687708    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-sys-fs\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.688439 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687738    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/070b7889-a211-4188-860f-ba36d9e5e7a4-agent-certs\") pod \"konnectivity-agent-gl8zs\" (UID: \"070b7889-a211-4188-860f-ba36d9e5e7a4\") " pod="kube-system/konnectivity-agent-gl8zs"
Jul 09 22:08:59.688439 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687761    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-systemd-units\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.688439 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687803    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.688439 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.687825    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-registration-dir\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.689285 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.689264    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:08:59.689686 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.689667    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cc2kh\""
Jul 09 22:08:59.689916 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.689868    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 22:08:59.690343 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.690327    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.692526 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.692507    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:08:59.692638 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:59.692603    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:08:59.693164 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.693112    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bw9k2\""
Jul 09 22:08:59.693164 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.693120    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 22:08:59.699897 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.699874    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 22:08:59.723794 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.723770    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bsw99"
Jul 09 22:08:59.738908 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.738550    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bsw99"
Jul 09 22:08:59.776958 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.776931    2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 22:08:59.789109 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789067    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrdfm\" (UniqueName: \"kubernetes.io/projected/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-kube-api-access-zrdfm\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.789264 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789204    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-sysconfig\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.789264 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789240    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-tuned\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.789386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789270    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/545c474d-0051-4db8-8d2e-e188d6fd6583-cni-binary-copy\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.789386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789295    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-modprobe-d\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.789386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789318    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-var-lib-kubelet\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.789386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789340    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlt8r\" (UniqueName: \"kubernetes.io/projected/44b38e54-cee4-406a-b5fa-d93c8ca5172e-kube-api-access-jlt8r\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.789386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789367    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-cni-bin\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.789626 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789392    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.789626 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789441    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-cni-bin\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.789626 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789452    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdt2x\" (UniqueName: \"kubernetes.io/projected/d459efc1-509f-45c0-899d-0b1a1dd1f03b-kube-api-access-tdt2x\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.789626 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789460    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.789626 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789491    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/545c474d-0051-4db8-8d2e-e188d6fd6583-os-release\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.789626 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789524    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqv29\" (UniqueName: \"kubernetes.io/projected/545c474d-0051-4db8-8d2e-e188d6fd6583-kube-api-access-mqv29\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.789626 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789549    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a556b16-7099-4306-9ac8-9bfa8d61e326-host-slash\") pod \"iptables-alerter-qfsw9\" (UID: \"4a556b16-7099-4306-9ac8-9bfa8d61e326\") " pod="openshift-network-operator/iptables-alerter-qfsw9"
Jul 09 22:08:59.789626 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789577    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-system-cni-dir\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.789626 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789599    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-os-release\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.789626 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789616    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/545c474d-0051-4db8-8d2e-e188d6fd6583-os-release\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.789626 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789623    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-etc-openvswitch\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.790174 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789655    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-etc-openvswitch\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.790174 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789680    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-run-ovn\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.790174 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789703    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-host\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.790174 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789728    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-run-k8s-cni-cncf-io\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.790174 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789756    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-run-ovn\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.790174 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789762    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a556b16-7099-4306-9ac8-9bfa8d61e326-host-slash\") pod \"iptables-alerter-qfsw9\" (UID: \"4a556b16-7099-4306-9ac8-9bfa8d61e326\") " pod="openshift-network-operator/iptables-alerter-qfsw9"
Jul 09 22:08:59.790174 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789820    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-run-netns\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.790174 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789863    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-var-lib-kubelet\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.790174 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789893    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/545c474d-0051-4db8-8d2e-e188d6fd6583-cni-binary-copy\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.790174 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789899    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-hostroot\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.790174 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.789979    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-run-multus-certs\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.790174 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790011    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv2ql\" (UniqueName: \"kubernetes.io/projected/4a556b16-7099-4306-9ac8-9bfa8d61e326-kube-api-access-xv2ql\") pod \"iptables-alerter-qfsw9\" (UID: \"4a556b16-7099-4306-9ac8-9bfa8d61e326\") " pod="openshift-network-operator/iptables-alerter-qfsw9"
Jul 09 22:08:59.790174 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790103    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-dbus\") pod \"global-pull-secret-syncer-bjslv\" (UID: \"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8\") " pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:08:59.790174 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790132    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44b38e54-cee4-406a-b5fa-d93c8ca5172e-tmp\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.790174 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790157    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clm8p\" (UniqueName: \"kubernetes.io/projected/d030998d-3703-4572-b000-0af35390df60-kube-api-access-clm8p\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.790174 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790182    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61-hosts-file\") pod \"node-resolver-lrllf\" (UID: \"98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61\") " pod="openshift-dns/node-resolver-lrllf"
Jul 09 22:08:59.790919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790208    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ce766ac-353c-44b3-8c68-5c6e6b2bccc3-serviceca\") pod \"node-ca-lmtn5\" (UID: \"8ce766ac-353c-44b3-8c68-5c6e6b2bccc3\") " pod="openshift-image-registry/node-ca-lmtn5"
Jul 09 22:08:59.790919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790232    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hj67\" (UniqueName: \"kubernetes.io/projected/8ce766ac-353c-44b3-8c68-5c6e6b2bccc3-kube-api-access-2hj67\") pod \"node-ca-lmtn5\" (UID: \"8ce766ac-353c-44b3-8c68-5c6e6b2bccc3\") " pod="openshift-image-registry/node-ca-lmtn5"
Jul 09 22:08:59.790919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790323    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-run-netns\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.790919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790351    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-run-openvswitch\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.790919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790377    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-node-log\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.790919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790420    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/545c474d-0051-4db8-8d2e-e188d6fd6583-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.790919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790426    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-run-netns\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.790919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790434    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-run-openvswitch\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.790919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790447    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-run\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.790919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790471    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61-tmp-dir\") pod \"node-resolver-lrllf\" (UID: \"98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61\") " pod="openshift-dns/node-resolver-lrllf"
Jul 09 22:08:59.790919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790495    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/070b7889-a211-4188-860f-ba36d9e5e7a4-konnectivity-ca\") pod \"konnectivity-agent-gl8zs\" (UID: \"070b7889-a211-4188-860f-ba36d9e5e7a4\") " pod="kube-system/konnectivity-agent-gl8zs"
Jul 09 22:08:59.790919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790519    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-node-log\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.790919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790521    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.790919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790553    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.790919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790560    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d459efc1-509f-45c0-899d-0b1a1dd1f03b-ovnkube-script-lib\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.790919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790571    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ce766ac-353c-44b3-8c68-5c6e6b2bccc3-serviceca\") pod \"node-ca-lmtn5\" (UID: \"8ce766ac-353c-44b3-8c68-5c6e6b2bccc3\") " pod="openshift-image-registry/node-ca-lmtn5"
Jul 09 22:08:59.790919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790584    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-sys-fs\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.791751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790612    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-multus-socket-dir-parent\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.791751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790632    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-var-lib-cni-multus\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.791751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790637    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-sys-fs\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.791751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790657    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hcbl\" (UniqueName: \"kubernetes.io/projected/98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61-kube-api-access-7hcbl\") pod \"node-resolver-lrllf\" (UID: \"98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61\") " pod="openshift-dns/node-resolver-lrllf"
Jul 09 22:08:59.791751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790682    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-cni-netd\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.791751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790707    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d459efc1-509f-45c0-899d-0b1a1dd1f03b-ovnkube-config\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.791751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790730    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w9qb\" (UniqueName: \"kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb\") pod \"network-check-target-7sgxg\" (UID: \"d9c25735-b855-4b54-aa6a-40d2769327fd\") " pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:08:59.791751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790752    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-socket-dir\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.791751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790776    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs\") pod \"network-metrics-daemon-ffzhl\" (UID: \"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd\") " pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:08:59.791751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790779    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-cni-netd\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.791751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790801    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-kubelet-config\") pod \"global-pull-secret-syncer-bjslv\" (UID: \"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8\") " pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:08:59.791751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790826    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-sysctl-conf\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.791751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790846    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-lib-modules\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.791751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790872    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-cnibin\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.791751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790906    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-var-lib-cni-bin\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.791751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790933    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-var-lib-openvswitch\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.791751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790957    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/545c474d-0051-4db8-8d2e-e188d6fd6583-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.792469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.790982    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-etc-selinux\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.792469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791006    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-kubernetes\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.792469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791015    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/070b7889-a211-4188-860f-ba36d9e5e7a4-konnectivity-ca\") pod \"konnectivity-agent-gl8zs\" (UID: \"070b7889-a211-4188-860f-ba36d9e5e7a4\") " pod="kube-system/konnectivity-agent-gl8zs"
Jul 09 22:08:59.792469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791065    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/545c474d-0051-4db8-8d2e-e188d6fd6583-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.792469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791079    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-systemd\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.792469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791107    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-multus-conf-dir\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.792469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791133    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-slash\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.792469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791157    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d459efc1-509f-45c0-899d-0b1a1dd1f03b-env-overrides\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.792469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791162    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-var-lib-openvswitch\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.792469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791182    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-sysctl-d\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.792469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791204    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d459efc1-509f-45c0-899d-0b1a1dd1f03b-ovnkube-script-lib\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.792469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791209    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/545c474d-0051-4db8-8d2e-e188d6fd6583-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.792469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791241    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-device-dir\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.792469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791266    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvdht\" (UniqueName: \"kubernetes.io/projected/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-kube-api-access-fvdht\") pod \"network-metrics-daemon-ffzhl\" (UID: \"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd\") " pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:08:59.792469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791288    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-multus-cni-dir\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.792469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791293    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/545c474d-0051-4db8-8d2e-e188d6fd6583-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.792469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791308    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d030998d-3703-4572-b000-0af35390df60-multus-daemon-config\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.793094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791266    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-slash\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.793094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791332    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-run-systemd\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.793094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791352    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-etc-selinux\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.793094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791358    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-log-socket\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.793094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791181    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-socket-dir\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.793094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791374    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-device-dir\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.793094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791391    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d459efc1-509f-45c0-899d-0b1a1dd1f03b-ovn-node-metrics-cert\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.793094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791413    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-run-systemd\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.793094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791445    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-log-socket\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.793094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791454    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/545c474d-0051-4db8-8d2e-e188d6fd6583-cnibin\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.793094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791455    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d459efc1-509f-45c0-899d-0b1a1dd1f03b-ovnkube-config\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.793094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791481    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret\") pod \"global-pull-secret-syncer-bjslv\" (UID: \"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8\") " pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:08:59.793094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791504    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/545c474d-0051-4db8-8d2e-e188d6fd6583-cnibin\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.793094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791536    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a556b16-7099-4306-9ac8-9bfa8d61e326-iptables-alerter-script\") pod \"iptables-alerter-qfsw9\" (UID: \"4a556b16-7099-4306-9ac8-9bfa8d61e326\") " pod="openshift-network-operator/iptables-alerter-qfsw9"
Jul 09 22:08:59.793094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791568    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-sys\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.793094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791589    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d459efc1-509f-45c0-899d-0b1a1dd1f03b-env-overrides\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.793094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791640    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-etc-kubernetes\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.793699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791669    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/070b7889-a211-4188-860f-ba36d9e5e7a4-agent-certs\") pod \"konnectivity-agent-gl8zs\" (UID: \"070b7889-a211-4188-860f-ba36d9e5e7a4\") " pod="kube-system/konnectivity-agent-gl8zs"
Jul 09 22:08:59.793699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791692    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-systemd-units\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.793699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791684    2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 22:08:59.793699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791719    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.793699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791743    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-registration-dir\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.793699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791768    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d030998d-3703-4572-b000-0af35390df60-cni-binary-copy\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.793699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791792    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ce766ac-353c-44b3-8c68-5c6e6b2bccc3-host\") pod \"node-ca-lmtn5\" (UID: \"8ce766ac-353c-44b3-8c68-5c6e6b2bccc3\") " pod="openshift-image-registry/node-ca-lmtn5"
Jul 09 22:08:59.793699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791814    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-kubelet\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.793699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791825    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/545c474d-0051-4db8-8d2e-e188d6fd6583-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.793699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791838    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/545c474d-0051-4db8-8d2e-e188d6fd6583-system-cni-dir\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.793699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791880    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-registration-dir\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.793699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791917    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-systemd-units\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.793699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791932    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/545c474d-0051-4db8-8d2e-e188d6fd6583-system-cni-dir\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.793699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791944    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d459efc1-509f-45c0-899d-0b1a1dd1f03b-host-kubelet\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.793699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791959    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.793699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.791972    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ce766ac-353c-44b3-8c68-5c6e6b2bccc3-host\") pod \"node-ca-lmtn5\" (UID: \"8ce766ac-353c-44b3-8c68-5c6e6b2bccc3\") " pod="openshift-image-registry/node-ca-lmtn5"
Jul 09 22:08:59.793699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.792076    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a556b16-7099-4306-9ac8-9bfa8d61e326-iptables-alerter-script\") pod \"iptables-alerter-qfsw9\" (UID: \"4a556b16-7099-4306-9ac8-9bfa8d61e326\") " pod="openshift-network-operator/iptables-alerter-qfsw9"
Jul 09 22:08:59.794897 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.794877    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d459efc1-509f-45c0-899d-0b1a1dd1f03b-ovn-node-metrics-cert\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.795046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.795019    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/070b7889-a211-4188-860f-ba36d9e5e7a4-agent-certs\") pod \"konnectivity-agent-gl8zs\" (UID: \"070b7889-a211-4188-860f-ba36d9e5e7a4\") " pod="kube-system/konnectivity-agent-gl8zs"
Jul 09 22:08:59.812231 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.812023    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrdfm\" (UniqueName: \"kubernetes.io/projected/4dca5eeb-4fd7-4034-9bfd-dde5b088c127-kube-api-access-zrdfm\") pod \"aws-ebs-csi-driver-node-4b9xm\" (UID: \"4dca5eeb-4fd7-4034-9bfd-dde5b088c127\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:08:59.812231 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.812137    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdt2x\" (UniqueName: \"kubernetes.io/projected/d459efc1-509f-45c0-899d-0b1a1dd1f03b-kube-api-access-tdt2x\") pod \"ovnkube-node-t7g2j\" (UID: \"d459efc1-509f-45c0-899d-0b1a1dd1f03b\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:08:59.814447 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:59.814422    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:08:59.814447 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:59.814448    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:08:59.814624 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:59.814461    2554 projected.go:196] Error preparing data for projected volume kube-api-access-4w9qb for pod openshift-network-diagnostics/network-check-target-7sgxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:08:59.814624 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:59.814542    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb podName:d9c25735-b855-4b54-aa6a-40d2769327fd nodeName:}" failed. No retries permitted until 2026-07-09 22:09:00.314520282 +0000 UTC m=+2.988519064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4w9qb" (UniqueName: "kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb") pod "network-check-target-7sgxg" (UID: "d9c25735-b855-4b54-aa6a-40d2769327fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:08:59.814721 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.814700    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv2ql\" (UniqueName: \"kubernetes.io/projected/4a556b16-7099-4306-9ac8-9bfa8d61e326-kube-api-access-xv2ql\") pod \"iptables-alerter-qfsw9\" (UID: \"4a556b16-7099-4306-9ac8-9bfa8d61e326\") " pod="openshift-network-operator/iptables-alerter-qfsw9"
Jul 09 22:08:59.814922 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.814906    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqv29\" (UniqueName: \"kubernetes.io/projected/545c474d-0051-4db8-8d2e-e188d6fd6583-kube-api-access-mqv29\") pod \"multus-additional-cni-plugins-hfzth\" (UID: \"545c474d-0051-4db8-8d2e-e188d6fd6583\") " pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:08:59.816616 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.816594    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hj67\" (UniqueName: \"kubernetes.io/projected/8ce766ac-353c-44b3-8c68-5c6e6b2bccc3-kube-api-access-2hj67\") pod \"node-ca-lmtn5\" (UID: \"8ce766ac-353c-44b3-8c68-5c6e6b2bccc3\") " pod="openshift-image-registry/node-ca-lmtn5"
Jul 09 22:08:59.880650 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.880593    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-135.ec2.internal" event={"ID":"7850db39ed65d429ad5a6c9d967e5873","Type":"ContainerStarted","Data":"3d7208c3ab81ff7dcf64826ed7ea09b837570ac486bba5792ce6f8f44505afec"}
Jul 09 22:08:59.881880 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.881824    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal" event={"ID":"c91bebd301ade1d28163632064920d02","Type":"ContainerStarted","Data":"e999a3ade4082e8fdcb4a4151f5b4eebda113989b5e62d846129cff86bd6ff66"}
Jul 09 22:08:59.892828 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.892798    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs\") pod \"network-metrics-daemon-ffzhl\" (UID: \"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd\") " pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:08:59.892957 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.892834    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-kubelet-config\") pod \"global-pull-secret-syncer-bjslv\" (UID: \"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8\") " pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:08:59.892957 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.892856    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-sysctl-conf\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.893086 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:59.892962    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:08:59.893086 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.892994    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-sysctl-conf\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.893086 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893050    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-lib-modules\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.893086 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:59.893055    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs podName:de9caaf7-9880-4c95-bd81-ab0a8e6be1cd nodeName:}" failed. No retries permitted until 2026-07-09 22:09:00.393021173 +0000 UTC m=+3.067019953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs") pod "network-metrics-daemon-ffzhl" (UID: "de9caaf7-9880-4c95-bd81-ab0a8e6be1cd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:08:59.893277 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.892999    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-kubelet-config\") pod \"global-pull-secret-syncer-bjslv\" (UID: \"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8\") " pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:08:59.893277 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893184    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-lib-modules\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.893277 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893216    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-cnibin\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.893277 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893240    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-var-lib-cni-bin\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.893277 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893267    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-kubernetes\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.893504 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893290    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-systemd\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.893504 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893293    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-cnibin\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.893504 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893313    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-multus-conf-dir\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.893504 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893336    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-sysctl-d\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.893504 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893346    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-kubernetes\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.893504 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893365    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvdht\" (UniqueName: \"kubernetes.io/projected/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-kube-api-access-fvdht\") pod \"network-metrics-daemon-ffzhl\" (UID: \"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd\") " pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:08:59.893504 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893382    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-var-lib-cni-bin\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.893504 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893390    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-multus-cni-dir\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.893504 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893414    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d030998d-3703-4572-b000-0af35390df60-multus-daemon-config\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.893504 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893442    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret\") pod \"global-pull-secret-syncer-bjslv\" (UID: \"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8\") " pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:08:59.893504 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893469    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-sys\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.893504 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893486    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-sysctl-d\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.893504 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893491    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-etc-kubernetes\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893518    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d030998d-3703-4572-b000-0af35390df60-cni-binary-copy\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893530    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-systemd\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893546    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-sysconfig\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893568    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-tuned\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893591    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-modprobe-d\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893617    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-var-lib-kubelet\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:59.893641    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:08:59.893697    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret podName:fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8 nodeName:}" failed. No retries permitted until 2026-07-09 22:09:00.39368101 +0000 UTC m=+3.067679793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret") pod "global-pull-secret-syncer-bjslv" (UID: "fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893810    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-sysconfig\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893860    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-etc-kubernetes\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893570    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-multus-conf-dir\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893944    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-multus-cni-dir\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893973    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-modprobe-d\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893998    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-sys\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894026    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-var-lib-kubelet\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.893641    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlt8r\" (UniqueName: \"kubernetes.io/projected/44b38e54-cee4-406a-b5fa-d93c8ca5172e-kube-api-access-jlt8r\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894105    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-system-cni-dir\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.894176 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894131    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-os-release\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894155    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-host\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894181    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-run-k8s-cni-cncf-io\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894203    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-run-netns\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894230    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-var-lib-kubelet\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894251    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-hostroot\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894274    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-run-multus-certs\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894299    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-dbus\") pod \"global-pull-secret-syncer-bjslv\" (UID: \"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8\") " pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894323    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44b38e54-cee4-406a-b5fa-d93c8ca5172e-tmp\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894345    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clm8p\" (UniqueName: \"kubernetes.io/projected/d030998d-3703-4572-b000-0af35390df60-kube-api-access-clm8p\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894369    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61-hosts-file\") pod \"node-resolver-lrllf\" (UID: \"98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61\") " pod="openshift-dns/node-resolver-lrllf"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894403    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-run\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894426    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61-tmp-dir\") pod \"node-resolver-lrllf\" (UID: \"98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61\") " pod="openshift-dns/node-resolver-lrllf"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894437    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d030998d-3703-4572-b000-0af35390df60-cni-binary-copy\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894454    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-multus-socket-dir-parent\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894478    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-var-lib-cni-multus\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894504    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hcbl\" (UniqueName: \"kubernetes.io/projected/98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61-kube-api-access-7hcbl\") pod \"node-resolver-lrllf\" (UID: \"98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61\") " pod="openshift-dns/node-resolver-lrllf"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894619    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d030998d-3703-4572-b000-0af35390df60-multus-daemon-config\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894703    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-run-multus-certs\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895891 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894746    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61-hosts-file\") pod \"node-resolver-lrllf\" (UID: \"98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61\") " pod="openshift-dns/node-resolver-lrllf"
Jul 09 22:08:59.895891 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894754    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-system-cni-dir\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895891 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894803    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-os-release\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895891 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894842    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-run\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.895891 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894888    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-run-netns\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895891 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894885    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-var-lib-cni-multus\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895891 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894896    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-dbus\") pod \"global-pull-secret-syncer-bjslv\" (UID: \"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8\") " pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:08:59.895891 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894935    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-hostroot\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895891 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894947    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-multus-socket-dir-parent\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895891 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.894969    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-run-k8s-cni-cncf-io\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895891 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.895005    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d030998d-3703-4572-b000-0af35390df60-host-var-lib-kubelet\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.895891 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.895063    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/44b38e54-cee4-406a-b5fa-d93c8ca5172e-host\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.895891 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.895074    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61-tmp-dir\") pod \"node-resolver-lrllf\" (UID: \"98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61\") " pod="openshift-dns/node-resolver-lrllf"
Jul 09 22:08:59.897292 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.897259    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44b38e54-cee4-406a-b5fa-d93c8ca5172e-tmp\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.897419 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.897398    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/44b38e54-cee4-406a-b5fa-d93c8ca5172e-etc-tuned\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.911593 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.911566    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlt8r\" (UniqueName: \"kubernetes.io/projected/44b38e54-cee4-406a-b5fa-d93c8ca5172e-kube-api-access-jlt8r\") pod \"tuned-dr287\" (UID: \"44b38e54-cee4-406a-b5fa-d93c8ca5172e\") " pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:08:59.912305 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.912254    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvdht\" (UniqueName: \"kubernetes.io/projected/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-kube-api-access-fvdht\") pod \"network-metrics-daemon-ffzhl\" (UID: \"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd\") " pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:08:59.912403 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.912377    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hcbl\" (UniqueName: \"kubernetes.io/projected/98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61-kube-api-access-7hcbl\") pod \"node-resolver-lrllf\" (UID: \"98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61\") " pod="openshift-dns/node-resolver-lrllf"
Jul 09 22:08:59.912483 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.912433    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clm8p\" (UniqueName: \"kubernetes.io/projected/d030998d-3703-4572-b000-0af35390df60-kube-api-access-clm8p\") pod \"multus-kk85f\" (UID: \"d030998d-3703-4572-b000-0af35390df60\") " pod="openshift-multus/multus-kk85f"
Jul 09 22:08:59.977401 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.977366    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qfsw9"
Jul 09 22:08:59.991196 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:08:59.991164    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lmtn5"
Jul 09 22:09:00.000828 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:00.000806    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm"
Jul 09 22:09:00.008510 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:00.008487    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gl8zs"
Jul 09 22:09:00.015397 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:00.015375    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:09:00.023023 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:00.022997    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hfzth"
Jul 09 22:09:00.029779 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:00.029760    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lrllf"
Jul 09 22:09:00.037488 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:00.037466    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dr287"
Jul 09 22:09:00.042225 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:00.042198    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kk85f"
Jul 09 22:09:00.398104 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:00.398063    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret\") pod \"global-pull-secret-syncer-bjslv\" (UID: \"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8\") " pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:00.398295 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:00.398143    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w9qb\" (UniqueName: \"kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb\") pod \"network-check-target-7sgxg\" (UID: \"d9c25735-b855-4b54-aa6a-40d2769327fd\") " pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:00.398295 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:00.398175    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs\") pod \"network-metrics-daemon-ffzhl\" (UID: \"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd\") " pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:00.398295 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:00.398241    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:09:00.398295 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:00.398282    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:09:00.398464 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:00.398303    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:09:00.398464 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:00.398317    2554 projected.go:196] Error preparing data for projected volume kube-api-access-4w9qb for pod openshift-network-diagnostics/network-check-target-7sgxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:09:00.398464 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:00.398321    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret podName:fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8 nodeName:}" failed. No retries permitted until 2026-07-09 22:09:01.398300002 +0000 UTC m=+4.072298802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret") pod "global-pull-secret-syncer-bjslv" (UID: "fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:09:00.398464 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:00.398352    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb podName:d9c25735-b855-4b54-aa6a-40d2769327fd nodeName:}" failed. No retries permitted until 2026-07-09 22:09:01.398341905 +0000 UTC m=+4.072340689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4w9qb" (UniqueName: "kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb") pod "network-check-target-7sgxg" (UID: "d9c25735-b855-4b54-aa6a-40d2769327fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:09:00.398464 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:00.398285    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:09:00.398464 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:00.398386    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs podName:de9caaf7-9880-4c95-bd81-ab0a8e6be1cd nodeName:}" failed. No retries permitted until 2026-07-09 22:09:01.398377861 +0000 UTC m=+4.072376646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs") pod "network-metrics-daemon-ffzhl" (UID: "de9caaf7-9880-4c95-bd81-ab0a8e6be1cd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:09:00.743301 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:00.743175    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 22:03:59 +0000 UTC" deadline="2027-12-05 10:08:36.674964242 +0000 UTC"
Jul 09 22:09:00.743301 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:00.743244    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12323h59m35.931724182s"
Jul 09 22:09:00.876086 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:00.876050    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:00.876258 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:00.876194    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:09:00.965048 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:09:00.964976    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod070b7889_a211_4188_860f_ba36d9e5e7a4.slice/crio-5e81b80465d4042021e52dde8bfd956a5a22c01e2ba47a2ed1a4980ab840dfee WatchSource:0}: Error finding container 5e81b80465d4042021e52dde8bfd956a5a22c01e2ba47a2ed1a4980ab840dfee: Status 404 returned error can't find the container with id 5e81b80465d4042021e52dde8bfd956a5a22c01e2ba47a2ed1a4980ab840dfee
Jul 09 22:09:00.966577 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:09:00.966551    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98bd9c1a_f8b0_4dfc_96da_9bf0dd354b61.slice/crio-3fdbae0afffcc0f8356e6a3bccc7a3af418efaa045aa01cb849849cf5873c152 WatchSource:0}: Error finding container 3fdbae0afffcc0f8356e6a3bccc7a3af418efaa045aa01cb849849cf5873c152: Status 404 returned error can't find the container with id 3fdbae0afffcc0f8356e6a3bccc7a3af418efaa045aa01cb849849cf5873c152
Jul 09 22:09:00.970013 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:09:00.969987    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd459efc1_509f_45c0_899d_0b1a1dd1f03b.slice/crio-831f5a6b8f8055feb0c6332dd5079a3de4c787cc0f8f1f28ac2aa4da9f605081 WatchSource:0}: Error finding container 831f5a6b8f8055feb0c6332dd5079a3de4c787cc0f8f1f28ac2aa4da9f605081: Status 404 returned error can't find the container with id 831f5a6b8f8055feb0c6332dd5079a3de4c787cc0f8f1f28ac2aa4da9f605081
Jul 09 22:09:00.970800 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:09:00.970740    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545c474d_0051_4db8_8d2e_e188d6fd6583.slice/crio-db6d7fcc5f229388c7c58bfcc49793779c4da97035ebc25ed15f07bf0f2b065d WatchSource:0}: Error finding container db6d7fcc5f229388c7c58bfcc49793779c4da97035ebc25ed15f07bf0f2b065d: Status 404 returned error can't find the container with id db6d7fcc5f229388c7c58bfcc49793779c4da97035ebc25ed15f07bf0f2b065d
Jul 09 22:09:00.972579 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:09:00.972267    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b38e54_cee4_406a_b5fa_d93c8ca5172e.slice/crio-4cf97a8387646f1d590556e8df15e3711ffc4959f0869bdb2bb7e55c62b76a7f WatchSource:0}: Error finding container 4cf97a8387646f1d590556e8df15e3711ffc4959f0869bdb2bb7e55c62b76a7f: Status 404 returned error can't find the container with id 4cf97a8387646f1d590556e8df15e3711ffc4959f0869bdb2bb7e55c62b76a7f
Jul 09 22:09:00.974439 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:09:00.973689    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd030998d_3703_4572_b000_0af35390df60.slice/crio-2fe0f2317b5618916601b54b4fe6fd6d5ea0ea5aa744217ef304b4fdf594d3bf WatchSource:0}: Error finding container 2fe0f2317b5618916601b54b4fe6fd6d5ea0ea5aa744217ef304b4fdf594d3bf: Status 404 returned error can't find the container with id 2fe0f2317b5618916601b54b4fe6fd6d5ea0ea5aa744217ef304b4fdf594d3bf
Jul 09 22:09:00.974606 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:09:00.974553    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dca5eeb_4fd7_4034_9bfd_dde5b088c127.slice/crio-a6e2549f4f0b1a4a0e418e5ebcb23ae29425bb2958f753f98923d490090ce970 WatchSource:0}: Error finding container a6e2549f4f0b1a4a0e418e5ebcb23ae29425bb2958f753f98923d490090ce970: Status 404 returned error can't find the container with id a6e2549f4f0b1a4a0e418e5ebcb23ae29425bb2958f753f98923d490090ce970
Jul 09 22:09:00.976169 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:09:00.975999    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a556b16_7099_4306_9ac8_9bfa8d61e326.slice/crio-a3e676e0f2d300b9f30e87933065397573a88dd912acf725e6d4348c39589268 WatchSource:0}: Error finding container a3e676e0f2d300b9f30e87933065397573a88dd912acf725e6d4348c39589268: Status 404 returned error can't find the container with id a3e676e0f2d300b9f30e87933065397573a88dd912acf725e6d4348c39589268
Jul 09 22:09:00.977113 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:09:00.976760    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce766ac_353c_44b3_8c68_5c6e6b2bccc3.slice/crio-d203b22470425141f2b121e28a0f5543cae0a5b2e31fc037e2bd82aa35a44655 WatchSource:0}: Error finding container d203b22470425141f2b121e28a0f5543cae0a5b2e31fc037e2bd82aa35a44655: Status 404 returned error can't find the container with id d203b22470425141f2b121e28a0f5543cae0a5b2e31fc037e2bd82aa35a44655
Jul 09 22:09:01.405740 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.405157    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret\") pod \"global-pull-secret-syncer-bjslv\" (UID: \"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8\") " pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:01.405740 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:01.405308    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:09:01.405740 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.405492    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w9qb\" (UniqueName: \"kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb\") pod \"network-check-target-7sgxg\" (UID: \"d9c25735-b855-4b54-aa6a-40d2769327fd\") " pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:01.405740 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.405519    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs\") pod \"network-metrics-daemon-ffzhl\" (UID: \"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd\") " pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:01.405740 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:01.405541    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret podName:fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8 nodeName:}" failed. No retries permitted until 2026-07-09 22:09:03.405521927 +0000 UTC m=+6.079520720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret") pod "global-pull-secret-syncer-bjslv" (UID: "fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:09:01.405740 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:01.405591    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:09:01.405740 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:01.405648    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs podName:de9caaf7-9880-4c95-bd81-ab0a8e6be1cd nodeName:}" failed. No retries permitted until 2026-07-09 22:09:03.405636853 +0000 UTC m=+6.079635647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs") pod "network-metrics-daemon-ffzhl" (UID: "de9caaf7-9880-4c95-bd81-ab0a8e6be1cd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:09:01.405740 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:01.405678    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:09:01.405740 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:01.405702    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:09:01.405740 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:01.405719    2554 projected.go:196] Error preparing data for projected volume kube-api-access-4w9qb for pod openshift-network-diagnostics/network-check-target-7sgxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:09:01.406370 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:01.405770    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb podName:d9c25735-b855-4b54-aa6a-40d2769327fd nodeName:}" failed. No retries permitted until 2026-07-09 22:09:03.405754295 +0000 UTC m=+6.079753095 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4w9qb" (UniqueName: "kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb") pod "network-check-target-7sgxg" (UID: "d9c25735-b855-4b54-aa6a-40d2769327fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:09:01.743772 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.743678    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 22:03:59 +0000 UTC" deadline="2027-12-29 03:23:02.121370878 +0000 UTC"
Jul 09 22:09:01.743772 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.743711    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12893h14m0.377664584s"
Jul 09 22:09:01.878885 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.878853    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:01.879091 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:01.878996    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:09:01.879430 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.879410    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:01.879532 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:01.879513    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:09:01.898561 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.898526    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dr287" event={"ID":"44b38e54-cee4-406a-b5fa-d93c8ca5172e","Type":"ContainerStarted","Data":"4cf97a8387646f1d590556e8df15e3711ffc4959f0869bdb2bb7e55c62b76a7f"}
Jul 09 22:09:01.905387 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.905307    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hfzth" event={"ID":"545c474d-0051-4db8-8d2e-e188d6fd6583","Type":"ContainerStarted","Data":"db6d7fcc5f229388c7c58bfcc49793779c4da97035ebc25ed15f07bf0f2b065d"}
Jul 09 22:09:01.908852 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.908745    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j" event={"ID":"d459efc1-509f-45c0-899d-0b1a1dd1f03b","Type":"ContainerStarted","Data":"831f5a6b8f8055feb0c6332dd5079a3de4c787cc0f8f1f28ac2aa4da9f605081"}
Jul 09 22:09:01.914284 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.914232    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qfsw9" event={"ID":"4a556b16-7099-4306-9ac8-9bfa8d61e326","Type":"ContainerStarted","Data":"a3e676e0f2d300b9f30e87933065397573a88dd912acf725e6d4348c39589268"}
Jul 09 22:09:01.920613 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.920587    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lrllf" event={"ID":"98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61","Type":"ContainerStarted","Data":"3fdbae0afffcc0f8356e6a3bccc7a3af418efaa045aa01cb849849cf5873c152"}
Jul 09 22:09:01.923641 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.923614    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gl8zs" event={"ID":"070b7889-a211-4188-860f-ba36d9e5e7a4","Type":"ContainerStarted","Data":"5e81b80465d4042021e52dde8bfd956a5a22c01e2ba47a2ed1a4980ab840dfee"}
Jul 09 22:09:01.938204 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.938173    2554 generic.go:356] "Generic (PLEG): container finished" podID="c91bebd301ade1d28163632064920d02" containerID="256f4f81ef855e737175b4cb817f6b4f220628aa05aab01fc086a922469b153e" exitCode=0
Jul 09 22:09:01.938349 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.938270    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal" event={"ID":"c91bebd301ade1d28163632064920d02","Type":"ContainerDied","Data":"256f4f81ef855e737175b4cb817f6b4f220628aa05aab01fc086a922469b153e"}
Jul 09 22:09:01.945310 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.945277    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-135.ec2.internal" event={"ID":"7850db39ed65d429ad5a6c9d967e5873","Type":"ContainerStarted","Data":"cea244471a4a685cd47cfaf582a92928e2a0170103f4077879e9ec8b9398cb32"}
Jul 09 22:09:01.958717 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.958686    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lmtn5" event={"ID":"8ce766ac-353c-44b3-8c68-5c6e6b2bccc3","Type":"ContainerStarted","Data":"d203b22470425141f2b121e28a0f5543cae0a5b2e31fc037e2bd82aa35a44655"}
Jul 09 22:09:01.967928 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.967852    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm" event={"ID":"4dca5eeb-4fd7-4034-9bfd-dde5b088c127","Type":"ContainerStarted","Data":"a6e2549f4f0b1a4a0e418e5ebcb23ae29425bb2958f753f98923d490090ce970"}
Jul 09 22:09:01.972167 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.971318    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-135.ec2.internal" podStartSLOduration=2.971297538 podStartE2EDuration="2.971297538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:08:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:09:01.970890648 +0000 UTC m=+4.644889510" watchObservedRunningTime="2026-07-09 22:09:01.971297538 +0000 UTC m=+4.645296341"
Jul 09 22:09:01.981046 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:01.980994    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kk85f" event={"ID":"d030998d-3703-4572-b000-0af35390df60","Type":"ContainerStarted","Data":"2fe0f2317b5618916601b54b4fe6fd6d5ea0ea5aa744217ef304b4fdf594d3bf"}
Jul 09 22:09:02.876920 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:02.876416    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:02.876920 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:02.876556    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:09:03.021387 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:03.021353    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal" event={"ID":"c91bebd301ade1d28163632064920d02","Type":"ContainerStarted","Data":"1f01fb3be31235fd20b0fc31205c776192d4c06aa95f297656d7615108ba0331"}
Jul 09 22:09:03.423485 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:03.423442    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret\") pod \"global-pull-secret-syncer-bjslv\" (UID: \"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8\") " pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:03.423675 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:03.423536    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w9qb\" (UniqueName: \"kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb\") pod \"network-check-target-7sgxg\" (UID: \"d9c25735-b855-4b54-aa6a-40d2769327fd\") " pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:03.423675 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:03.423563    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs\") pod \"network-metrics-daemon-ffzhl\" (UID: \"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd\") " pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:03.423790 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:03.423682    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:09:03.423790 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:03.423744    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs podName:de9caaf7-9880-4c95-bd81-ab0a8e6be1cd nodeName:}" failed. No retries permitted until 2026-07-09 22:09:07.423726018 +0000 UTC m=+10.097724813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs") pod "network-metrics-daemon-ffzhl" (UID: "de9caaf7-9880-4c95-bd81-ab0a8e6be1cd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:09:03.424178 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:03.424161    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:09:03.424252 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:03.424214    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret podName:fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8 nodeName:}" failed. No retries permitted until 2026-07-09 22:09:07.424199024 +0000 UTC m=+10.098197806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret") pod "global-pull-secret-syncer-bjslv" (UID: "fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:09:03.424309 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:03.424290    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:09:03.424309 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:03.424307    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:09:03.424419 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:03.424318    2554 projected.go:196] Error preparing data for projected volume kube-api-access-4w9qb for pod openshift-network-diagnostics/network-check-target-7sgxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:09:03.424419 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:03.424350    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb podName:d9c25735-b855-4b54-aa6a-40d2769327fd nodeName:}" failed. No retries permitted until 2026-07-09 22:09:07.424339616 +0000 UTC m=+10.098338399 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4w9qb" (UniqueName: "kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb") pod "network-check-target-7sgxg" (UID: "d9c25735-b855-4b54-aa6a-40d2769327fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:09:03.876350 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:03.876270    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:03.876519 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:03.876416    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:09:03.876800 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:03.876781    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:03.876898 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:03.876878    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:09:04.876380 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:04.876344    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:04.876838 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:04.876492    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:09:05.875998 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:05.875919    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:05.876153 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:05.876102    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:09:05.876506 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:05.876485    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:05.876903 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:05.876582    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:09:06.876122 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:06.876079    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:06.876297 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:06.876226    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:09:07.456405 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:07.456366    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret\") pod \"global-pull-secret-syncer-bjslv\" (UID: \"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8\") " pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:07.457065 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:07.456452    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w9qb\" (UniqueName: \"kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb\") pod \"network-check-target-7sgxg\" (UID: \"d9c25735-b855-4b54-aa6a-40d2769327fd\") " pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:07.457065 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:07.456489    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs\") pod \"network-metrics-daemon-ffzhl\" (UID: \"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd\") " pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:07.457065 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:07.456593    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:09:07.457065 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:07.456621    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:09:07.457065 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:07.456623    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:09:07.457065 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:07.456650    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:09:07.457065 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:07.456658    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs podName:de9caaf7-9880-4c95-bd81-ab0a8e6be1cd nodeName:}" failed. No retries permitted until 2026-07-09 22:09:15.456640006 +0000 UTC m=+18.130638786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs") pod "network-metrics-daemon-ffzhl" (UID: "de9caaf7-9880-4c95-bd81-ab0a8e6be1cd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:09:07.457065 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:07.456664    2554 projected.go:196] Error preparing data for projected volume kube-api-access-4w9qb for pod openshift-network-diagnostics/network-check-target-7sgxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:09:07.457065 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:07.456678    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret podName:fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8 nodeName:}" failed. No retries permitted until 2026-07-09 22:09:15.456668035 +0000 UTC m=+18.130666818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret") pod "global-pull-secret-syncer-bjslv" (UID: "fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:09:07.457065 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:07.456721    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb podName:d9c25735-b855-4b54-aa6a-40d2769327fd nodeName:}" failed. No retries permitted until 2026-07-09 22:09:15.45670201 +0000 UTC m=+18.130700799 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4w9qb" (UniqueName: "kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb") pod "network-check-target-7sgxg" (UID: "d9c25735-b855-4b54-aa6a-40d2769327fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:09:07.876995 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:07.876387    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:07.876995 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:07.876524    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:09:07.876995 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:07.876877    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:07.876995 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:07.876967    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:09:08.875777 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:08.875699    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:08.876231 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:08.875821    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:09:09.876307 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:09.876081    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:09.876307 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:09.876227    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:09:09.876307 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:09.876303    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:09.876957 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:09.876433    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:09:10.875645 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:10.875607    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:10.875818 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:10.875735    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:09:11.875740 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:11.875706    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:11.875740 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:11.875739    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:11.876256 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:11.875844    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:09:11.876256 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:11.875984    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:09:12.875615 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:12.875578    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:12.875774 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:12.875681    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:09:13.876134 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:13.876102    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:13.876616 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:13.876102    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:13.876616 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:13.876252    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:09:13.876616 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:13.876286    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:09:14.876097 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:14.876064    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:14.876312 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:14.876174    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:09:15.519704 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:15.519662    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w9qb\" (UniqueName: \"kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb\") pod \"network-check-target-7sgxg\" (UID: \"d9c25735-b855-4b54-aa6a-40d2769327fd\") " pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:15.519704 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:15.519708    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs\") pod \"network-metrics-daemon-ffzhl\" (UID: \"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd\") " pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:15.519944 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:15.519742    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret\") pod \"global-pull-secret-syncer-bjslv\" (UID: \"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8\") " pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:15.519944 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:15.519829    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:09:15.519944 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:15.519850    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:09:15.519944 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:15.519872    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:09:15.519944 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:15.519882    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret podName:fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8 nodeName:}" failed. No retries permitted until 2026-07-09 22:09:31.519869032 +0000 UTC m=+34.193867811 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret") pod "global-pull-secret-syncer-bjslv" (UID: "fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:09:15.519944 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:15.519884    2554 projected.go:196] Error preparing data for projected volume kube-api-access-4w9qb for pod openshift-network-diagnostics/network-check-target-7sgxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:09:15.519944 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:15.519830    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:09:15.519944 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:15.519937    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb podName:d9c25735-b855-4b54-aa6a-40d2769327fd nodeName:}" failed. No retries permitted until 2026-07-09 22:09:31.519921239 +0000 UTC m=+34.193920021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4w9qb" (UniqueName: "kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb") pod "network-check-target-7sgxg" (UID: "d9c25735-b855-4b54-aa6a-40d2769327fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:09:15.520259 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:15.519975    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs podName:de9caaf7-9880-4c95-bd81-ab0a8e6be1cd nodeName:}" failed. No retries permitted until 2026-07-09 22:09:31.519960537 +0000 UTC m=+34.193959336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs") pod "network-metrics-daemon-ffzhl" (UID: "de9caaf7-9880-4c95-bd81-ab0a8e6be1cd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:09:15.876050 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:15.875950    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:15.876206 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:15.876110    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:09:15.876206 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:15.876119    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:15.876336 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:15.876206    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:09:16.876283 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:16.876243    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:16.876477 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:16.876379    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:09:17.876313 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:17.876278    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:17.876483 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:17.876397    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:09:17.876483 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:17.876451    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:17.876891 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:17.876552    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:09:18.875730 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:18.875699    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:18.875892 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:18.875810    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:09:19.876549 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:19.876198    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:19.877250 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:19.876272    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:19.877250 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:19.876678    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:09:19.877250 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:19.876716    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:09:20.055809 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.055785    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lmtn5" event={"ID":"8ce766ac-353c-44b3-8c68-5c6e6b2bccc3","Type":"ContainerStarted","Data":"6537ba5b3c4a38c9746a8de5f946923f72224487f3ecf5b592c54c30e444ec00"}
Jul 09 22:09:20.057170 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.057142    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm" event={"ID":"4dca5eeb-4fd7-4034-9bfd-dde5b088c127","Type":"ContainerStarted","Data":"9cc41b9b1d1f7ef638156cb69e247b8a8187bdc50c8f4f587ccdf850e409ab9c"}
Jul 09 22:09:20.058502 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.058481    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kk85f" event={"ID":"d030998d-3703-4572-b000-0af35390df60","Type":"ContainerStarted","Data":"0676098fc4c763ba3af7a78d7e05e84cf378a7af86654df7ce0c4e169bedaca1"}
Jul 09 22:09:20.059751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.059732    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dr287" event={"ID":"44b38e54-cee4-406a-b5fa-d93c8ca5172e","Type":"ContainerStarted","Data":"8b2db28ba76efd1edd33918f28d6472221ac649539cbdb33839b60d7e4bfa873"}
Jul 09 22:09:20.061168 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.061144    2554 generic.go:356] "Generic (PLEG): container finished" podID="545c474d-0051-4db8-8d2e-e188d6fd6583" containerID="b3a221a2a26ff1bca08d2f913feb775e7cf9ed2d73209030274a9365109b7bee" exitCode=0
Jul 09 22:09:20.061260 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.061225    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hfzth" event={"ID":"545c474d-0051-4db8-8d2e-e188d6fd6583","Type":"ContainerDied","Data":"b3a221a2a26ff1bca08d2f913feb775e7cf9ed2d73209030274a9365109b7bee"}
Jul 09 22:09:20.063702 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.063682    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j" event={"ID":"d459efc1-509f-45c0-899d-0b1a1dd1f03b","Type":"ContainerStarted","Data":"8d11526800d4e9891c8faa79d29a0e1dfce62b76dbf1e6b5961f6aa0907648ac"}
Jul 09 22:09:20.063805 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.063752    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j" event={"ID":"d459efc1-509f-45c0-899d-0b1a1dd1f03b","Type":"ContainerStarted","Data":"4e80cfbbf055c31adc538bd0a0a02f90771e742471f1ff52125d669ce6726d14"}
Jul 09 22:09:20.063805 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.063802    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j" event={"ID":"d459efc1-509f-45c0-899d-0b1a1dd1f03b","Type":"ContainerStarted","Data":"507f376e51c47f0e758f35b0706123323bb013a15d7a6cd43b977bab24332a4a"}
Jul 09 22:09:20.063921 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.063850    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j" event={"ID":"d459efc1-509f-45c0-899d-0b1a1dd1f03b","Type":"ContainerStarted","Data":"66b845d003829ed610c842e6fafe33fa94cb11fd3044be56b7033a5f4a9fdd29"}
Jul 09 22:09:20.063921 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.063888    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j" event={"ID":"d459efc1-509f-45c0-899d-0b1a1dd1f03b","Type":"ContainerStarted","Data":"19bbf181cc61f0ba2fa8440185667feaac61c3807d96aac8b7d9e3a88971783e"}
Jul 09 22:09:20.065020 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.064998    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lrllf" event={"ID":"98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61","Type":"ContainerStarted","Data":"edffa5040728ef4edac568db36eb02597499b90a3287928da5b1736c6d185a0c"}
Jul 09 22:09:20.066310 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.066289    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gl8zs" event={"ID":"070b7889-a211-4188-860f-ba36d9e5e7a4","Type":"ContainerStarted","Data":"7adf932da3c9e2bf79fc008d3c9d89f046e3a1e7b4a4b4aabd96b14bb1861524"}
Jul 09 22:09:20.087925 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.087887    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-135.ec2.internal" podStartSLOduration=21.087874874 podStartE2EDuration="21.087874874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:08:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:09:03.04089673 +0000 UTC m=+5.714895548" watchObservedRunningTime="2026-07-09 22:09:20.087874874 +0000 UTC m=+22.761873676"
Jul 09 22:09:20.116251 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.116200    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dr287" podStartSLOduration=3.606885997 podStartE2EDuration="22.116183288s" totalImagesPullingTime="18.509297291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:09:20.115763721 +0000 UTC m=+22.789762523" watchObservedRunningTime="2026-07-09 22:09:20.116183288 +0000 UTC m=+22.790182089"
Jul 09 22:09:20.139810 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.139767    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kk85f" podStartSLOduration=3.575189655 podStartE2EDuration="22.139752709s" totalImagesPullingTime="18.564563054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:09:20.139200812 +0000 UTC m=+22.813199614" watchObservedRunningTime="2026-07-09 22:09:20.139752709 +0000 UTC m=+22.813751511"
Jul 09 22:09:20.159770 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.159709    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lmtn5" podStartSLOduration=4.658343812 podStartE2EDuration="23.159697557s" totalImagesPullingTime="18.501353745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:09:20.159469203 +0000 UTC m=+22.833468005" watchObservedRunningTime="2026-07-09 22:09:20.159697557 +0000 UTC m=+22.833696359"
Jul 09 22:09:20.205136 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.205079    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gl8zs" podStartSLOduration=9.194620222 podStartE2EDuration="23.205060274s" totalImagesPullingTime="14.010440052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:09:20.204390883 +0000 UTC m=+22.878389686" watchObservedRunningTime="2026-07-09 22:09:20.205060274 +0000 UTC m=+22.879059079"
Jul 09 22:09:20.205719 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.205684    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lrllf" podStartSLOduration=3.696224059 podStartE2EDuration="22.205675587s" totalImagesPullingTime="18.509451528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:09:20.184093805 +0000 UTC m=+22.858092607" watchObservedRunningTime="2026-07-09 22:09:20.205675587 +0000 UTC m=+22.879674413"
Jul 09 22:09:20.321684 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.321610    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:20.413175 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.413150    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:20.800391 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.800360    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:20.876226 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.876196    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:20.876390 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:20.876295    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:09:20.898510 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:20.898485    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:21.072911 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:21.072877    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j" event={"ID":"d459efc1-509f-45c0-899d-0b1a1dd1f03b","Type":"ContainerStarted","Data":"3001b7805bba02a43f659896400437555868e28b18c1876a66e919f745ed82dd"}
Jul 09 22:09:21.074550 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:21.074497    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qfsw9" event={"ID":"4a556b16-7099-4306-9ac8-9bfa8d61e326","Type":"ContainerStarted","Data":"faa576121075a0691b47224510c0d49b47205da6a4598f0c14555fbda6912f94"}
Jul 09 22:09:21.091062 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:21.091000    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qfsw9" podStartSLOduration=5.588182627 podStartE2EDuration="24.090984519s" totalImagesPullingTime="18.502801892s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:09:21.090568778 +0000 UTC m=+23.764567578" watchObservedRunningTime="2026-07-09 22:09:21.090984519 +0000 UTC m=+23.764983322"
Jul 09 22:09:21.171894 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:21.171866    2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 22:09:21.221490 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:21.221465    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:21.331511 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:21.331445    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:21.475702 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:21.475674    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:21.757909 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:21.757755    2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T22:09:21.17188907Z","UUID":"1a1dbad4-2d29-47f6-a42b-9c09f67352cc","Handler":null,"Name":"","Endpoint":""}
Jul 09 22:09:21.759469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:21.759445    2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 22:09:21.759604 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:21.759494    2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 22:09:21.876364 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:21.876333    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:21.876567 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:21.876469    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:09:21.876567 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:21.876523    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:21.876704 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:21.876650    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:09:22.080309 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:22.080222    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm" event={"ID":"4dca5eeb-4fd7-4034-9bfd-dde5b088c127","Type":"ContainerStarted","Data":"179fca6de4b3047de141e118e0b863b694df3aa434ae375490cb70ff1bd17e63"}
Jul 09 22:09:22.876534 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:22.876294    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:22.876836 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:22.876573    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:09:23.084818 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:23.084785    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm" event={"ID":"4dca5eeb-4fd7-4034-9bfd-dde5b088c127","Type":"ContainerStarted","Data":"280e758651cd8cb48189108c49bbba92aa912c3d91ea1340ceef931fd00724ef"}
Jul 09 22:09:23.087994 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:23.087968    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j" event={"ID":"d459efc1-509f-45c0-899d-0b1a1dd1f03b","Type":"ContainerStarted","Data":"5d2d3cacb8b02534e55f8c321d51dffb46970323cdc41b93347fc0ca41e9ec4b"}
Jul 09 22:09:23.127664 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:23.127574    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4b9xm" podStartSLOduration=3.854031095 podStartE2EDuration="25.12756069s" totalImagesPullingTime="21.273529595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:08:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:09:23.126801916 +0000 UTC m=+25.800800736" watchObservedRunningTime="2026-07-09 22:09:23.12756069 +0000 UTC m=+25.801559492"
Jul 09 22:09:23.875571 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:23.875539    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:23.875571 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:23.875555    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:23.875837 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:23.875702    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:09:23.875897 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:23.875828    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:09:24.876289 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:24.876257    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:24.876853 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:24.876372    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:09:24.942992 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:24.942957    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gl8zs"
Jul 09 22:09:24.943600 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:24.943576    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gl8zs"
Jul 09 22:09:25.046836 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:25.046802    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:25.092790 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:25.092764    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gl8zs"
Jul 09 22:09:25.093333 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:25.093313    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gl8zs"
Jul 09 22:09:25.213242 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:25.213158    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:25.333931 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:25.333900    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:25.879327 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:25.879097    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:25.880076 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:25.879175    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:25.880076 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:25.879490    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:09:25.880076 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:25.879639    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:09:26.096883 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:26.096846    2554 generic.go:356] "Generic (PLEG): container finished" podID="545c474d-0051-4db8-8d2e-e188d6fd6583" containerID="cdd91a050e0198fd7a2abcf7faedca946bb799e438a3d7f509ecca2dd7446cff" exitCode=0
Jul 09 22:09:26.097028 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:26.096905    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hfzth" event={"ID":"545c474d-0051-4db8-8d2e-e188d6fd6583","Type":"ContainerDied","Data":"cdd91a050e0198fd7a2abcf7faedca946bb799e438a3d7f509ecca2dd7446cff"}
Jul 09 22:09:26.100565 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:26.100536    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j" event={"ID":"d459efc1-509f-45c0-899d-0b1a1dd1f03b","Type":"ContainerStarted","Data":"b21c01c50972e66618271a6e40920ca1829388eaf4a5632d53eafa191d8525d4"}
Jul 09 22:09:26.876169 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:26.876139    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:26.876462 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:26.876245    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:09:27.099209 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:27.099171    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:27.103081 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:27.103053    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:09:27.103217 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:27.103118    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:09:27.103217 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:27.103153    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:09:27.117897 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:27.117871    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:09:27.118163 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:27.118143    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:09:27.187307 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:27.187254    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j" podStartSLOduration=11.61979509 podStartE2EDuration="30.1872374s" totalImagesPullingTime="18.56744231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:09:26.196879654 +0000 UTC m=+28.870878456" watchObservedRunningTime="2026-07-09 22:09:27.1872374 +0000 UTC m=+29.861236202"
Jul 09 22:09:27.227663 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:27.225920    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:27.879422 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:27.879390    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:27.879574 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:27.879516    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:09:27.879574 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:27.879548    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:27.879741 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:27.879659    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:09:28.108885 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:28.108852    2554 generic.go:356] "Generic (PLEG): container finished" podID="545c474d-0051-4db8-8d2e-e188d6fd6583" containerID="00ec77f8a09a59d14f17e6a9151f3b777d3de5a799b8ddb867261289f21d3774" exitCode=0
Jul 09 22:09:28.109346 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:28.108916    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hfzth" event={"ID":"545c474d-0051-4db8-8d2e-e188d6fd6583","Type":"ContainerDied","Data":"00ec77f8a09a59d14f17e6a9151f3b777d3de5a799b8ddb867261289f21d3774"}
Jul 09 22:09:28.132937 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:28.132862    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bjslv"]
Jul 09 22:09:28.133087 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:28.132964    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:28.133087 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:28.133072    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:09:28.137292 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:28.137254    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ffzhl"]
Jul 09 22:09:28.137428 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:28.137371    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:28.137648 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:28.137620    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:09:28.137884 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:28.137865    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7sgxg"]
Jul 09 22:09:28.137971 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:28.137959    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:28.138071 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:28.138050    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:09:29.875523 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:29.875487    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:29.876157 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:29.875492    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:29.876157 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:29.875603    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:09:29.876157 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:29.875492    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:29.876157 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:29.875660    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:09:29.876157 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:29.875757    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:09:30.116086 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:30.116056    2554 generic.go:356] "Generic (PLEG): container finished" podID="545c474d-0051-4db8-8d2e-e188d6fd6583" containerID="78db9aa16d061fac28769cb604a39c410f727743ec104b520ac6b91178b379c4" exitCode=0
Jul 09 22:09:30.116242 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:30.116108    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hfzth" event={"ID":"545c474d-0051-4db8-8d2e-e188d6fd6583","Type":"ContainerDied","Data":"78db9aa16d061fac28769cb604a39c410f727743ec104b520ac6b91178b379c4"}
Jul 09 22:09:31.536000 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:31.535912    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w9qb\" (UniqueName: \"kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb\") pod \"network-check-target-7sgxg\" (UID: \"d9c25735-b855-4b54-aa6a-40d2769327fd\") " pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:31.536000 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:31.535962    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs\") pod \"network-metrics-daemon-ffzhl\" (UID: \"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd\") " pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:31.536526 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:31.536098    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:09:31.536526 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:31.536106    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret\") pod \"global-pull-secret-syncer-bjslv\" (UID: \"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8\") " pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:31.536526 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:31.536127    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:09:31.536526 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:31.536148    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:09:31.536526 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:31.536162    2554 projected.go:196] Error preparing data for projected volume kube-api-access-4w9qb for pod openshift-network-diagnostics/network-check-target-7sgxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:09:31.536526 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:31.536165    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs podName:de9caaf7-9880-4c95-bd81-ab0a8e6be1cd nodeName:}" failed. No retries permitted until 2026-07-09 22:10:03.536141221 +0000 UTC m=+66.210140005 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs") pod "network-metrics-daemon-ffzhl" (UID: "de9caaf7-9880-4c95-bd81-ab0a8e6be1cd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:09:31.536526 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:31.536211    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb podName:d9c25735-b855-4b54-aa6a-40d2769327fd nodeName:}" failed. No retries permitted until 2026-07-09 22:10:03.536194582 +0000 UTC m=+66.210193379 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4w9qb" (UniqueName: "kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb") pod "network-check-target-7sgxg" (UID: "d9c25735-b855-4b54-aa6a-40d2769327fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:09:31.536526 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:31.536227    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:09:31.536526 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:31.536283    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret podName:fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8 nodeName:}" failed. No retries permitted until 2026-07-09 22:10:03.536267668 +0000 UTC m=+66.210266461 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret") pod "global-pull-secret-syncer-bjslv" (UID: "fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:09:31.797305 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:31.797228    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:31.876022 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:31.875983    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:31.876022 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:31.876016    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:31.876022 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:31.875987    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:31.876353 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:31.876148    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:09:31.876353 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:31.876286    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjslv" podUID="fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8"
Jul 09 22:09:31.876474 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:31.876365    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7sgxg" podUID="d9c25735-b855-4b54-aa6a-40d2769327fd"
Jul 09 22:09:31.904785 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:31.904756    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:33.064863 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.064834    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-135.ec2.internal" event="NodeReady"
Jul 09 22:09:33.065391 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.065100    2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 22:09:33.165420 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.165370    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bcbkx"]
Jul 09 22:09:33.170516 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.170491    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5s9gq"]
Jul 09 22:09:33.170654 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.170634    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bcbkx"
Jul 09 22:09:33.173847 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.173827    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:09:33.174427 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.174405    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rkrl7\""
Jul 09 22:09:33.174558 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.174494    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 22:09:33.174558 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.174516    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 22:09:33.174883 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.174861    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 22:09:33.176956 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.176929    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 22:09:33.177063 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.176991    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 22:09:33.177902 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.177884    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-77st2\""
Jul 09 22:09:33.191538 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.191508    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bcbkx"]
Jul 09 22:09:33.201652 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.201623    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5s9gq"]
Jul 09 22:09:33.250753 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.250678    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7290a5ae-4fe0-445e-a11f-8133ff8187b3-config-volume\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:09:33.250753 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.250713    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:09:33.250753 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.250743    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr2v9\" (UniqueName: \"kubernetes.io/projected/848e09e1-8367-4db5-8f25-6378d3eb7bc8-kube-api-access-gr2v9\") pod \"ingress-canary-bcbkx\" (UID: \"848e09e1-8367-4db5-8f25-6378d3eb7bc8\") " pod="openshift-ingress-canary/ingress-canary-bcbkx"
Jul 09 22:09:33.250973 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.250837    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/848e09e1-8367-4db5-8f25-6378d3eb7bc8-cert\") pod \"ingress-canary-bcbkx\" (UID: \"848e09e1-8367-4db5-8f25-6378d3eb7bc8\") " pod="openshift-ingress-canary/ingress-canary-bcbkx"
Jul 09 22:09:33.250973 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.250880    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7290a5ae-4fe0-445e-a11f-8133ff8187b3-tmp-dir\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:09:33.250973 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.250907    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8949\" (UniqueName: \"kubernetes.io/projected/7290a5ae-4fe0-445e-a11f-8133ff8187b3-kube-api-access-g8949\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:09:33.352047 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.352007    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2v9\" (UniqueName: \"kubernetes.io/projected/848e09e1-8367-4db5-8f25-6378d3eb7bc8-kube-api-access-gr2v9\") pod \"ingress-canary-bcbkx\" (UID: \"848e09e1-8367-4db5-8f25-6378d3eb7bc8\") " pod="openshift-ingress-canary/ingress-canary-bcbkx"
Jul 09 22:09:33.352226 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.352090    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/848e09e1-8367-4db5-8f25-6378d3eb7bc8-cert\") pod \"ingress-canary-bcbkx\" (UID: \"848e09e1-8367-4db5-8f25-6378d3eb7bc8\") " pod="openshift-ingress-canary/ingress-canary-bcbkx"
Jul 09 22:09:33.352226 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.352118    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7290a5ae-4fe0-445e-a11f-8133ff8187b3-tmp-dir\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:09:33.352226 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.352137    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8949\" (UniqueName: \"kubernetes.io/projected/7290a5ae-4fe0-445e-a11f-8133ff8187b3-kube-api-access-g8949\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:09:33.352226 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.352198    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7290a5ae-4fe0-445e-a11f-8133ff8187b3-config-volume\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:09:33.352226 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.352221    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:09:33.352551 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:33.352304    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:09:33.352551 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:33.352360    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls podName:7290a5ae-4fe0-445e-a11f-8133ff8187b3 nodeName:}" failed. No retries permitted until 2026-07-09 22:09:33.852341895 +0000 UTC m=+36.526340678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls") pod "dns-default-5s9gq" (UID: "7290a5ae-4fe0-445e-a11f-8133ff8187b3") : secret "dns-default-metrics-tls" not found
Jul 09 22:09:33.352551 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.352538    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7290a5ae-4fe0-445e-a11f-8133ff8187b3-tmp-dir\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:09:33.353065 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.353024    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7290a5ae-4fe0-445e-a11f-8133ff8187b3-config-volume\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:09:33.356797 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.356776    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/848e09e1-8367-4db5-8f25-6378d3eb7bc8-cert\") pod \"ingress-canary-bcbkx\" (UID: \"848e09e1-8367-4db5-8f25-6378d3eb7bc8\") " pod="openshift-ingress-canary/ingress-canary-bcbkx"
Jul 09 22:09:33.366266 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.366238    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8949\" (UniqueName: \"kubernetes.io/projected/7290a5ae-4fe0-445e-a11f-8133ff8187b3-kube-api-access-g8949\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:09:33.367649 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.367624    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr2v9\" (UniqueName: \"kubernetes.io/projected/848e09e1-8367-4db5-8f25-6378d3eb7bc8-kube-api-access-gr2v9\") pod \"ingress-canary-bcbkx\" (UID: \"848e09e1-8367-4db5-8f25-6378d3eb7bc8\") " pod="openshift-ingress-canary/ingress-canary-bcbkx"
Jul 09 22:09:33.402810 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.402779    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:33.482617 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.482579    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bcbkx"
Jul 09 22:09:33.505475 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.505401    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:33.856853 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.856815    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:09:33.857051 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:33.856976    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:09:33.857130 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:33.857060    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls podName:7290a5ae-4fe0-445e-a11f-8133ff8187b3 nodeName:}" failed. No retries permitted until 2026-07-09 22:09:34.857024259 +0000 UTC m=+37.531023039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls") pod "dns-default-5s9gq" (UID: "7290a5ae-4fe0-445e-a11f-8133ff8187b3") : secret "dns-default-metrics-tls" not found
Jul 09 22:09:33.876259 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.876227    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:09:33.876467 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.876275    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:09:33.876467 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.876227    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:09:33.884393 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.883946    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 22:09:33.884393 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.883971    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 22:09:33.884393 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.883985    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 22:09:33.884393 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.884256    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k7bfs\""
Jul 09 22:09:33.884393 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.884194    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zm9fl\""
Jul 09 22:09:33.884393 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:33.884194    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 22:09:34.746051 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:34.746016    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bcbkx"]
Jul 09 22:09:34.751223 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:09:34.751190    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod848e09e1_8367_4db5_8f25_6378d3eb7bc8.slice/crio-4ebf1a71c3acd135e9f14186820b23e2fdb137b7e2c15013636871b3fa3e1f2d WatchSource:0}: Error finding container 4ebf1a71c3acd135e9f14186820b23e2fdb137b7e2c15013636871b3fa3e1f2d: Status 404 returned error can't find the container with id 4ebf1a71c3acd135e9f14186820b23e2fdb137b7e2c15013636871b3fa3e1f2d
Jul 09 22:09:34.793102 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:34.793066    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:34.866262 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:34.866234    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:09:34.866393 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:34.866375    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:09:34.866451 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:34.866441    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls podName:7290a5ae-4fe0-445e-a11f-8133ff8187b3 nodeName:}" failed. No retries permitted until 2026-07-09 22:09:36.866425448 +0000 UTC m=+39.540424231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls") pod "dns-default-5s9gq" (UID: "7290a5ae-4fe0-445e-a11f-8133ff8187b3") : secret "dns-default-metrics-tls" not found
Jul 09 22:09:35.035444 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:35.035409    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:35.130515 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:35.130422    2554 generic.go:356] "Generic (PLEG): container finished" podID="545c474d-0051-4db8-8d2e-e188d6fd6583" containerID="47fa87a83f7cf8fdc043a68dae596e2f19be72f7ba6c9041760bcd212627fc1e" exitCode=0
Jul 09 22:09:35.130659 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:35.130512    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hfzth" event={"ID":"545c474d-0051-4db8-8d2e-e188d6fd6583","Type":"ContainerDied","Data":"47fa87a83f7cf8fdc043a68dae596e2f19be72f7ba6c9041760bcd212627fc1e"}
Jul 09 22:09:35.131616 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:35.131598    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bcbkx" event={"ID":"848e09e1-8367-4db5-8f25-6378d3eb7bc8","Type":"ContainerStarted","Data":"4ebf1a71c3acd135e9f14186820b23e2fdb137b7e2c15013636871b3fa3e1f2d"}
Jul 09 22:09:36.138010 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:36.137973    2554 generic.go:356] "Generic (PLEG): container finished" podID="545c474d-0051-4db8-8d2e-e188d6fd6583" containerID="9eab62d64b1b03d6dfbea0374f29ef90e6fdcc5ea5e3c4a5357243f9bfa48b9e" exitCode=0
Jul 09 22:09:36.138526 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:36.138054    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hfzth" event={"ID":"545c474d-0051-4db8-8d2e-e188d6fd6583","Type":"ContainerDied","Data":"9eab62d64b1b03d6dfbea0374f29ef90e6fdcc5ea5e3c4a5357243f9bfa48b9e"}
Jul 09 22:09:36.886780 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:36.886593    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:09:36.886780 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:36.886771    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:09:36.887071 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:36.886853    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls podName:7290a5ae-4fe0-445e-a11f-8133ff8187b3 nodeName:}" failed. No retries permitted until 2026-07-09 22:09:40.886831333 +0000 UTC m=+43.560830126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls") pod "dns-default-5s9gq" (UID: "7290a5ae-4fe0-445e-a11f-8133ff8187b3") : secret "dns-default-metrics-tls" not found
Jul 09 22:09:37.143257 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:37.143169    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hfzth" event={"ID":"545c474d-0051-4db8-8d2e-e188d6fd6583","Type":"ContainerStarted","Data":"722f7a187f73ed63ca3a68ec40b46ad68260a2e5a519922fe617af4f0966c142"}
Jul 09 22:09:37.171484 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:37.171371    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hfzth" podStartSLOduration=8.152779939 podStartE2EDuration="39.171354641s" totalImagesPullingTime="31.018574702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:08:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:09:37.171050477 +0000 UTC m=+39.845049271" watchObservedRunningTime="2026-07-09 22:09:37.171354641 +0000 UTC m=+39.845353469"
Jul 09 22:09:37.295842 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:37.295813    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:37.366418 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:37.366386    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:37.669623 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:37.669591    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:37.737748 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:37.737669    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:38.147117 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:38.147078    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bcbkx" event={"ID":"848e09e1-8367-4db5-8f25-6378d3eb7bc8","Type":"ContainerStarted","Data":"debc789710ce7f99f6cfd9973be4f41da1f59233f8088065973f459dcf4736a0"}
Jul 09 22:09:38.164843 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:38.164793    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bcbkx" podStartSLOduration=2.444890071 podStartE2EDuration="5.164777747s" totalImagesPullingTime="2.719887676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:09:38.163514713 +0000 UTC m=+40.837513540" watchObservedRunningTime="2026-07-09 22:09:38.164777747 +0000 UTC m=+40.838776549"
Jul 09 22:09:40.912366 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:40.912331    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:09:40.912746 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:40.912467    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:09:40.912746 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:40.912519    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls podName:7290a5ae-4fe0-445e-a11f-8133ff8187b3 nodeName:}" failed. No retries permitted until 2026-07-09 22:09:48.912506603 +0000 UTC m=+51.586505383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls") pod "dns-default-5s9gq" (UID: "7290a5ae-4fe0-445e-a11f-8133ff8187b3") : secret "dns-default-metrics-tls" not found
Jul 09 22:09:41.995650 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:41.995617    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:42.112934 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:42.112907    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:48.966738 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:48.966698    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:09:48.967246 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:48.966809    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:09:48.967246 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:09:48.966862    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls podName:7290a5ae-4fe0-445e-a11f-8133ff8187b3 nodeName:}" failed. No retries permitted until 2026-07-09 22:10:04.966848652 +0000 UTC m=+67.640847432 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls") pod "dns-default-5s9gq" (UID: "7290a5ae-4fe0-445e-a11f-8133ff8187b3") : secret "dns-default-metrics-tls" not found
Jul 09 22:09:52.725942 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:52.725910    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:52.825919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:52.825897    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:59.128138 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:59.128111    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7g2j"
Jul 09 22:09:59.261022 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:59.260993    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:09:59.332593 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:09:59.332560    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:10:03.572899 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:03.572844    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w9qb\" (UniqueName: \"kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb\") pod \"network-check-target-7sgxg\" (UID: \"d9c25735-b855-4b54-aa6a-40d2769327fd\") " pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:10:03.572899 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:03.572897    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs\") pod \"network-metrics-daemon-ffzhl\" (UID: \"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd\") " pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:10:03.573484 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:03.572929    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret\") pod \"global-pull-secret-syncer-bjslv\" (UID: \"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8\") " pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:10:03.575860 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:03.575829    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 22:10:03.576009 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:03.575902    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 22:10:03.576009 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:03.575918    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 22:10:03.583890 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:10:03.583869    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 22:10:03.583956 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:10:03.583944    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs podName:de9caaf7-9880-4c95-bd81-ab0a8e6be1cd nodeName:}" failed. No retries permitted until 2026-07-09 22:11:07.583922967 +0000 UTC m=+130.257921770 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs") pod "network-metrics-daemon-ffzhl" (UID: "de9caaf7-9880-4c95-bd81-ab0a8e6be1cd") : secret "metrics-daemon-secret" not found
Jul 09 22:10:03.586409 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:03.586385    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 22:10:03.587429 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:03.587406    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8-original-pull-secret\") pod \"global-pull-secret-syncer-bjslv\" (UID: \"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8\") " pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:10:03.596317 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:03.596300    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w9qb\" (UniqueName: \"kubernetes.io/projected/d9c25735-b855-4b54-aa6a-40d2769327fd-kube-api-access-4w9qb\") pod \"network-check-target-7sgxg\" (UID: \"d9c25735-b855-4b54-aa6a-40d2769327fd\") " pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:10:03.602101 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:03.602082    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjslv"
Jul 09 22:10:03.720916 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:03.720889    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bjslv"]
Jul 09 22:10:03.723923 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:10:03.723892    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdeb3831_73cd_4aa5_8c33_6ef51d2b58b8.slice/crio-30378eeaaf693b2982b78f724bdac1831488e6166a379d400657b03417956c0a WatchSource:0}: Error finding container 30378eeaaf693b2982b78f724bdac1831488e6166a379d400657b03417956c0a: Status 404 returned error can't find the container with id 30378eeaaf693b2982b78f724bdac1831488e6166a379d400657b03417956c0a
Jul 09 22:10:03.897647 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:03.897618    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k7bfs\""
Jul 09 22:10:03.905859 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:03.905835    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:10:04.030273 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:04.030241    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7sgxg"]
Jul 09 22:10:04.034270 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:10:04.034247    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c25735_b855_4b54_aa6a_40d2769327fd.slice/crio-1e6320bc59b8b3065a1f2d1265bd5a56228d82418cef34c9e22214053c579871 WatchSource:0}: Error finding container 1e6320bc59b8b3065a1f2d1265bd5a56228d82418cef34c9e22214053c579871: Status 404 returned error can't find the container with id 1e6320bc59b8b3065a1f2d1265bd5a56228d82418cef34c9e22214053c579871
Jul 09 22:10:04.206289 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:04.206201    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bjslv" event={"ID":"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8","Type":"ContainerStarted","Data":"30378eeaaf693b2982b78f724bdac1831488e6166a379d400657b03417956c0a"}
Jul 09 22:10:04.207243 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:04.207220    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7sgxg" event={"ID":"d9c25735-b855-4b54-aa6a-40d2769327fd","Type":"ContainerStarted","Data":"1e6320bc59b8b3065a1f2d1265bd5a56228d82418cef34c9e22214053c579871"}
Jul 09 22:10:04.982205 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:04.982165    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:10:04.982669 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:10:04.982330    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:10:04.982669 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:10:04.982412    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls podName:7290a5ae-4fe0-445e-a11f-8133ff8187b3 nodeName:}" failed. No retries permitted until 2026-07-09 22:10:36.982390564 +0000 UTC m=+99.656389355 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls") pod "dns-default-5s9gq" (UID: "7290a5ae-4fe0-445e-a11f-8133ff8187b3") : secret "dns-default-metrics-tls" not found
Jul 09 22:10:09.220900 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:09.220865    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bjslv" event={"ID":"fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8","Type":"ContainerStarted","Data":"61d694df0a0b195860cbe4c9a796a3ee7863ad3b982dd28a215f9d02feaeb542"}
Jul 09 22:10:09.222305 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:09.222277    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7sgxg" event={"ID":"d9c25735-b855-4b54-aa6a-40d2769327fd","Type":"ContainerStarted","Data":"41425b20c4004931fc659cdd3731336145a3eff036e6d3f9389ec20340179fd2"}
Jul 09 22:10:09.222421 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:09.222361    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:10:09.238396 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:09.238347    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bjslv" podStartSLOduration=66.372193303 podStartE2EDuration="1m11.238335466s" totalImagesPullingTime="4.866142163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:10:09.237746386 +0000 UTC m=+71.911745189" watchObservedRunningTime="2026-07-09 22:10:09.238335466 +0000 UTC m=+71.912334267"
Jul 09 22:10:09.255975 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:09.255939    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7sgxg" podStartSLOduration=66.703386563 podStartE2EDuration="1m11.255926866s" totalImagesPullingTime="4.552540303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:10:09.255840445 +0000 UTC m=+71.929839267" watchObservedRunningTime="2026-07-09 22:10:09.255926866 +0000 UTC m=+71.929925645"
Jul 09 22:10:37.003514 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:37.003471    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:10:37.004016 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:10:37.003605    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:10:37.004016 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:10:37.003665    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls podName:7290a5ae-4fe0-445e-a11f-8133ff8187b3 nodeName:}" failed. No retries permitted until 2026-07-09 22:11:41.00365231 +0000 UTC m=+163.677651090 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls") pod "dns-default-5s9gq" (UID: "7290a5ae-4fe0-445e-a11f-8133ff8187b3") : secret "dns-default-metrics-tls" not found
Jul 09 22:10:40.227186 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:10:40.227148    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7sgxg"
Jul 09 22:11:00.850050 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.849999    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"]
Jul 09 22:11:00.851826 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.851806    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"]
Jul 09 22:11:00.851960 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.851941    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"
Jul 09 22:11:00.853628 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.853610    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:00.854011 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.853993    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 22:11:00.854376 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.854357    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 22:11:00.854376 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.854367    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 09 22:11:00.854511 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.854392    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 22:11:00.855658 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.855642    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 09 22:11:00.856209 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.856194    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 09 22:11:00.856629 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.856605    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 09 22:11:00.856808 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.856783    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 09 22:11:00.862483 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.862460    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"]
Jul 09 22:11:00.865767 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.865746    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"]
Jul 09 22:11:00.958956 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.958921    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9451194e-a7fc-4093-8772-e382c24b66c4-hub\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:00.958956 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.958959    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9451194e-a7fc-4093-8772-e382c24b66c4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:00.959197 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.958977    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f126916-3aa9-475b-99ca-8f04d767dcd1-tmp\") pod \"klusterlet-addon-workmgr-5f66d6cf8c-x44c2\" (UID: \"2f126916-3aa9-475b-99ca-8f04d767dcd1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"
Jul 09 22:11:00.959197 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.959010    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9451194e-a7fc-4093-8772-e382c24b66c4-ca\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:00.959197 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.959083    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsd4p\" (UniqueName: \"kubernetes.io/projected/2f126916-3aa9-475b-99ca-8f04d767dcd1-kube-api-access-fsd4p\") pod \"klusterlet-addon-workmgr-5f66d6cf8c-x44c2\" (UID: \"2f126916-3aa9-475b-99ca-8f04d767dcd1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"
Jul 09 22:11:00.959197 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.959120    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9451194e-a7fc-4093-8772-e382c24b66c4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:00.959197 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.959148    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw65t\" (UniqueName: \"kubernetes.io/projected/9451194e-a7fc-4093-8772-e382c24b66c4-kube-api-access-sw65t\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:00.959197 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.959180    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9451194e-a7fc-4093-8772-e382c24b66c4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:00.959420 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:00.959206    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2f126916-3aa9-475b-99ca-8f04d767dcd1-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f66d6cf8c-x44c2\" (UID: \"2f126916-3aa9-475b-99ca-8f04d767dcd1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"
Jul 09 22:11:01.059992 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.059951    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9451194e-a7fc-4093-8772-e382c24b66c4-hub\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:01.060193 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.059999    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9451194e-a7fc-4093-8772-e382c24b66c4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:01.060193 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.060023    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f126916-3aa9-475b-99ca-8f04d767dcd1-tmp\") pod \"klusterlet-addon-workmgr-5f66d6cf8c-x44c2\" (UID: \"2f126916-3aa9-475b-99ca-8f04d767dcd1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"
Jul 09 22:11:01.060193 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.060086    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9451194e-a7fc-4093-8772-e382c24b66c4-ca\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:01.060193 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.060112    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsd4p\" (UniqueName: \"kubernetes.io/projected/2f126916-3aa9-475b-99ca-8f04d767dcd1-kube-api-access-fsd4p\") pod \"klusterlet-addon-workmgr-5f66d6cf8c-x44c2\" (UID: \"2f126916-3aa9-475b-99ca-8f04d767dcd1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"
Jul 09 22:11:01.060193 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.060136    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9451194e-a7fc-4093-8772-e382c24b66c4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:01.060193 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.060164    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw65t\" (UniqueName: \"kubernetes.io/projected/9451194e-a7fc-4093-8772-e382c24b66c4-kube-api-access-sw65t\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:01.060193 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.060190    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9451194e-a7fc-4093-8772-e382c24b66c4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:01.060561 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.060227    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2f126916-3aa9-475b-99ca-8f04d767dcd1-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f66d6cf8c-x44c2\" (UID: \"2f126916-3aa9-475b-99ca-8f04d767dcd1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"
Jul 09 22:11:01.060561 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.060394    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f126916-3aa9-475b-99ca-8f04d767dcd1-tmp\") pod \"klusterlet-addon-workmgr-5f66d6cf8c-x44c2\" (UID: \"2f126916-3aa9-475b-99ca-8f04d767dcd1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"
Jul 09 22:11:01.061133 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.061095    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9451194e-a7fc-4093-8772-e382c24b66c4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:01.062622 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.062597    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9451194e-a7fc-4093-8772-e382c24b66c4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:01.062622 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.062607    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9451194e-a7fc-4093-8772-e382c24b66c4-hub\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:01.063022 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.062998    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9451194e-a7fc-4093-8772-e382c24b66c4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:01.063207 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.063186    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9451194e-a7fc-4093-8772-e382c24b66c4-ca\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:01.063207 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.063200    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2f126916-3aa9-475b-99ca-8f04d767dcd1-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f66d6cf8c-x44c2\" (UID: \"2f126916-3aa9-475b-99ca-8f04d767dcd1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"
Jul 09 22:11:01.072296 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.072274    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsd4p\" (UniqueName: \"kubernetes.io/projected/2f126916-3aa9-475b-99ca-8f04d767dcd1-kube-api-access-fsd4p\") pod \"klusterlet-addon-workmgr-5f66d6cf8c-x44c2\" (UID: \"2f126916-3aa9-475b-99ca-8f04d767dcd1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"
Jul 09 22:11:01.073830 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.073805    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw65t\" (UniqueName: \"kubernetes.io/projected/9451194e-a7fc-4093-8772-e382c24b66c4-kube-api-access-sw65t\") pod \"cluster-proxy-proxy-agent-858b65648c-q7wtl\" (UID: \"9451194e-a7fc-4093-8772-e382c24b66c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:01.165764 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.165684    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"
Jul 09 22:11:01.185348 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.185325    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:11:01.294433 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.294396    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"]
Jul 09 22:11:01.297880 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:11:01.297859    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f126916_3aa9_475b_99ca_8f04d767dcd1.slice/crio-8bd747ff7e1537f6025a8f2b4eb051fe5e3309b87293c044724d227c3a66e42b WatchSource:0}: Error finding container 8bd747ff7e1537f6025a8f2b4eb051fe5e3309b87293c044724d227c3a66e42b: Status 404 returned error can't find the container with id 8bd747ff7e1537f6025a8f2b4eb051fe5e3309b87293c044724d227c3a66e42b
Jul 09 22:11:01.312068 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.311974    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"]
Jul 09 22:11:01.314304 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:11:01.314282    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9451194e_a7fc_4093_8772_e382c24b66c4.slice/crio-69d04a8c1f58adea5a51aaa94010df5e290ad92d497a57c9ec54647038b4a08f WatchSource:0}: Error finding container 69d04a8c1f58adea5a51aaa94010df5e290ad92d497a57c9ec54647038b4a08f: Status 404 returned error can't find the container with id 69d04a8c1f58adea5a51aaa94010df5e290ad92d497a57c9ec54647038b4a08f
Jul 09 22:11:01.344831 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.344806    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl" event={"ID":"9451194e-a7fc-4093-8772-e382c24b66c4","Type":"ContainerStarted","Data":"69d04a8c1f58adea5a51aaa94010df5e290ad92d497a57c9ec54647038b4a08f"}
Jul 09 22:11:01.345791 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:01.345771    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2" event={"ID":"2f126916-3aa9-475b-99ca-8f04d767dcd1","Type":"ContainerStarted","Data":"8bd747ff7e1537f6025a8f2b4eb051fe5e3309b87293c044724d227c3a66e42b"}
Jul 09 22:11:07.364394 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:07.364362    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2" event={"ID":"2f126916-3aa9-475b-99ca-8f04d767dcd1","Type":"ContainerStarted","Data":"3786a3e62c41c6f4ef02ef3c1a382f05d614940cf95667d8d35503fc5aad5c74"}
Jul 09 22:11:07.364914 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:07.364558    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"
Jul 09 22:11:07.366270 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:07.366250    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"
Jul 09 22:11:07.366588 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:07.366565    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl" event={"ID":"9451194e-a7fc-4093-8772-e382c24b66c4","Type":"ContainerStarted","Data":"30d7736d9bccffebb9852b28bd3b62c04a7d9bc7f4e849e6b1e509c98af28f3f"}
Jul 09 22:11:07.366643 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:07.366594    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl" event={"ID":"9451194e-a7fc-4093-8772-e382c24b66c4","Type":"ContainerStarted","Data":"f2f55ee2d63485d14a9e33a9d1bb904e4e0150d426b27c89cc085b86765a4aca"}
Jul 09 22:11:07.366643 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:07.366605    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl" event={"ID":"9451194e-a7fc-4093-8772-e382c24b66c4","Type":"ContainerStarted","Data":"a93a74e614f36257925c0a8fab6bdf03fc9f6bf5f9d9222cbeb2e526c30b91b1"}
Jul 09 22:11:07.379591 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:07.379548    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2" podStartSLOduration=2.215958879 podStartE2EDuration="7.379536572s" totalImagesPullingTime="5.163577693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:11:07.378905981 +0000 UTC m=+130.052904785" watchObservedRunningTime="2026-07-09 22:11:07.379536572 +0000 UTC m=+130.053535374"
Jul 09 22:11:07.396636 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:07.396586    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl" podStartSLOduration=2.249379094 podStartE2EDuration="7.396573957s" totalImagesPullingTime="5.147194863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:11:07.395893009 +0000 UTC m=+130.069891814" watchObservedRunningTime="2026-07-09 22:11:07.396573957 +0000 UTC m=+130.070572755"
Jul 09 22:11:07.611929 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:07.611899    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs\") pod \"network-metrics-daemon-ffzhl\" (UID: \"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd\") " pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:11:07.612081 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:11:07.612009    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 22:11:07.612081 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:11:07.612078    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs podName:de9caaf7-9880-4c95-bd81-ab0a8e6be1cd nodeName:}" failed. No retries permitted until 2026-07-09 22:13:09.612062613 +0000 UTC m=+252.286061397 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs") pod "network-metrics-daemon-ffzhl" (UID: "de9caaf7-9880-4c95-bd81-ab0a8e6be1cd") : secret "metrics-daemon-secret" not found
Jul 09 22:11:36.187844 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:11:36.187801    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5s9gq" podUID="7290a5ae-4fe0-445e-a11f-8133ff8187b3"
Jul 09 22:11:36.448790 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:36.448715    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:11:36.888344 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:11:36.888292    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:11:41.044280 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:41.044233    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:11:41.044666 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:11:41.044383    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:11:41.044666 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:11:41.044453    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls podName:7290a5ae-4fe0-445e-a11f-8133ff8187b3 nodeName:}" failed. No retries permitted until 2026-07-09 22:13:43.044435067 +0000 UTC m=+285.718433847 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls") pod "dns-default-5s9gq" (UID: "7290a5ae-4fe0-445e-a11f-8133ff8187b3") : secret "dns-default-metrics-tls" not found
Jul 09 22:11:48.876257 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:48.876222    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:11:59.065301 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:11:59.065262    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:12:54.451693 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:12:54.451656    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:12:56.295047 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:12:56.295001    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:12:56.396274 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:12:56.396238    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:12:58.475599 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:12:58.475570    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:12:58.564659 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:12:58.564632    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:01.195320 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.195261    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:01.294616 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.294582    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:01.831271 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.831242    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k5db4"]
Jul 09 22:13:01.833184 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.833161    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:01.836801 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.836780    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 22:13:01.836900 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.836839    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 22:13:01.837569 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.837553    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 22:13:01.837665 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.837584    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lm8tn\""
Jul 09 22:13:01.841648 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.841632    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 22:13:01.855015 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.854986    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k5db4"]
Jul 09 22:13:01.864024 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.863991    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:01.888440 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.888404    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:01.888627 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.888462    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-data-volume\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:01.888627 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.888510    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:01.888627 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.888532    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xnb9\" (UniqueName: \"kubernetes.io/projected/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-api-access-2xnb9\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:01.888627 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.888586    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-crio-socket\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:01.989584 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.989547    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:01.989584 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.989584    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xnb9\" (UniqueName: \"kubernetes.io/projected/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-api-access-2xnb9\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:01.989783 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.989609    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-crio-socket\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:01.989783 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.989648    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:01.989783 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.989679    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-data-volume\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:01.989783 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.989722    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-crio-socket\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:01.989783 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:01.989732    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:13:01.990002 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:01.989787    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:13:01.990002 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:01.989835    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls podName:c3e37b9f-0808-4c6c-8819-4f24ae43ce45 nodeName:}" failed. No retries permitted until 2026-07-09 22:13:02.489814544 +0000 UTC m=+245.163813324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k5db4" (UID: "c3e37b9f-0808-4c6c-8819-4f24ae43ce45") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:13:01.990002 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:01.989853    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm podName:c3e37b9f-0808-4c6c-8819-4f24ae43ce45 nodeName:}" failed. No retries permitted until 2026-07-09 22:13:02.489845358 +0000 UTC m=+245.163844138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k5db4" (UID: "c3e37b9f-0808-4c6c-8819-4f24ae43ce45") : configmap "kube-rbac-proxy" not found
Jul 09 22:13:01.990002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:01.989972    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-data-volume\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:02.001484 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:02.001449    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xnb9\" (UniqueName: \"kubernetes.io/projected/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-api-access-2xnb9\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:02.133574 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:02.133538    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:02.234653 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:02.234622    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:02.296372 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:02.296334    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:02.493582 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:02.493488    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:02.493582 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:02.493552    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:02.493776 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:02.493608    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:13:02.493776 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:02.493649    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:13:02.493776 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:02.493669    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm podName:c3e37b9f-0808-4c6c-8819-4f24ae43ce45 nodeName:}" failed. No retries permitted until 2026-07-09 22:13:03.493652275 +0000 UTC m=+246.167651056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k5db4" (UID: "c3e37b9f-0808-4c6c-8819-4f24ae43ce45") : configmap "kube-rbac-proxy" not found
Jul 09 22:13:02.493776 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:02.493693    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls podName:c3e37b9f-0808-4c6c-8819-4f24ae43ce45 nodeName:}" failed. No retries permitted until 2026-07-09 22:13:03.493679142 +0000 UTC m=+246.167677923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k5db4" (UID: "c3e37b9f-0808-4c6c-8819-4f24ae43ce45") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:13:02.837768 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:02.837683    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:03.021975 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:03.021946    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:03.500991 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:03.500941    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:03.500991 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:03.501010    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:03.501586 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:03.501110    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:13:03.501586 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:03.501160    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:13:03.501586 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:03.501207    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm podName:c3e37b9f-0808-4c6c-8819-4f24ae43ce45 nodeName:}" failed. No retries permitted until 2026-07-09 22:13:05.501184467 +0000 UTC m=+248.175183270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k5db4" (UID: "c3e37b9f-0808-4c6c-8819-4f24ae43ce45") : configmap "kube-rbac-proxy" not found
Jul 09 22:13:03.501586 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:03.501229    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls podName:c3e37b9f-0808-4c6c-8819-4f24ae43ce45 nodeName:}" failed. No retries permitted until 2026-07-09 22:13:05.501219545 +0000 UTC m=+248.175218327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k5db4" (UID: "c3e37b9f-0808-4c6c-8819-4f24ae43ce45") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:13:03.993827 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:03.993798    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lrllf_98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61/dns-node-resolver/0.log"
Jul 09 22:13:04.477182 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:04.477148    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:04.579308 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:04.579277    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:04.996829 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:04.996801    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lmtn5_8ce766ac-353c-44b3-8c68-5c6e6b2bccc3/node-ca/0.log"
Jul 09 22:13:05.516653 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:05.516616    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:05.516863 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:05.516670    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:05.516863 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:05.516762    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:13:05.516863 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:05.516817    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls podName:c3e37b9f-0808-4c6c-8819-4f24ae43ce45 nodeName:}" failed. No retries permitted until 2026-07-09 22:13:09.516802945 +0000 UTC m=+252.190801725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k5db4" (UID: "c3e37b9f-0808-4c6c-8819-4f24ae43ce45") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:13:05.516863 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:05.516761    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:13:05.517060 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:05.516916    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm podName:c3e37b9f-0808-4c6c-8819-4f24ae43ce45 nodeName:}" failed. No retries permitted until 2026-07-09 22:13:09.51689436 +0000 UTC m=+252.190893169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k5db4" (UID: "c3e37b9f-0808-4c6c-8819-4f24ae43ce45") : configmap "kube-rbac-proxy" not found
Jul 09 22:13:05.593520 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:05.593491    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bcbkx_848e09e1-8367-4db5-8f25-6378d3eb7bc8/serve-healthcheck-canary/0.log"
Jul 09 22:13:05.690280 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:05.690241    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:05.999184 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:05.999154    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:06.150838 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:06.150804    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:06.278625 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:06.278542    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:06.379093 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:06.379058    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:06.480047 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:06.479993    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:06.679427 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:06.679385    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:06.707309 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:06.707276    2554 generic.go:356] "Generic (PLEG): container finished" podID="2f126916-3aa9-475b-99ca-8f04d767dcd1" containerID="3786a3e62c41c6f4ef02ef3c1a382f05d614940cf95667d8d35503fc5aad5c74" exitCode=1
Jul 09 22:13:06.707453 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:06.707337    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2" event={"ID":"2f126916-3aa9-475b-99ca-8f04d767dcd1","Type":"ContainerDied","Data":"3786a3e62c41c6f4ef02ef3c1a382f05d614940cf95667d8d35503fc5aad5c74"}
Jul 09 22:13:06.707651 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:06.707637    2554 scope.go:117] "RemoveContainer" containerID="3786a3e62c41c6f4ef02ef3c1a382f05d614940cf95667d8d35503fc5aad5c74"
Jul 09 22:13:07.365233 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:07.365196    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"
Jul 09 22:13:07.479077 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:07.479017    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:07.712195 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:07.712115    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2" event={"ID":"2f126916-3aa9-475b-99ca-8f04d767dcd1","Type":"ContainerStarted","Data":"e82d18eb296986efebfbf7110b20c653c80f7c4bcf9240e39078f479c19db4ab"}
Jul 09 22:13:07.712634 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:07.712290    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"
Jul 09 22:13:07.712977 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:07.712960    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f66d6cf8c-x44c2"
Jul 09 22:13:08.068180 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:08.068086    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:08.276210 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:08.276171    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:08.610857 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:08.610805    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:08.711666 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:08.711631    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:08.871738 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:08.871639    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:09.292226 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:09.292137    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:09.548077 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:09.547970    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:09.548077 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:09.548064    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:09.548302 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:09.548144    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:13:09.548302 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:09.548217    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls podName:c3e37b9f-0808-4c6c-8819-4f24ae43ce45 nodeName:}" failed. No retries permitted until 2026-07-09 22:13:17.548201444 +0000 UTC m=+260.222200224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k5db4" (UID: "c3e37b9f-0808-4c6c-8819-4f24ae43ce45") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:13:09.548302 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:09.548146    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:13:09.548302 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:09.548297    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm podName:c3e37b9f-0808-4c6c-8819-4f24ae43ce45 nodeName:}" failed. No retries permitted until 2026-07-09 22:13:17.548278359 +0000 UTC m=+260.222277163 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k5db4" (UID: "c3e37b9f-0808-4c6c-8819-4f24ae43ce45") : configmap "kube-rbac-proxy" not found
Jul 09 22:13:09.649007 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:09.648973    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs\") pod \"network-metrics-daemon-ffzhl\" (UID: \"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd\") " pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:13:09.649185 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:09.649164    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 22:13:09.649264 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:09.649244    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs podName:de9caaf7-9880-4c95-bd81-ab0a8e6be1cd nodeName:}" failed. No retries permitted until 2026-07-09 22:15:11.649223509 +0000 UTC m=+374.323222289 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs") pod "network-metrics-daemon-ffzhl" (UID: "de9caaf7-9880-4c95-bd81-ab0a8e6be1cd") : secret "metrics-daemon-secret" not found
Jul 09 22:13:09.876300 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:09.876257    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:09.976392 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:09.976352    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:10.030839 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:10.030814    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:10.462645 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:10.462612    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:10.663095 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:10.663008    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:10.862590 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:10.862562    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:11.069863 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:11.069778    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:12.069247 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:12.069203    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:12.123553 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:12.123521    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:12.469805 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:12.469769    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:12.663779 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:12.663742    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:12.861470 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:12.861429    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:13.308468 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:13.308382    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:13.868354 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:13.868315    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:14.351400 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:14.351370    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:14.464501 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:14.464474    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:14.666708 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:14.666626    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:14.871992 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:14.871963    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:15.263612 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:15.263580    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:16.067128 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:16.067092    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:16.278023 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:16.277989    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:16.465075 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:16.465026    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:16.663990 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:16.663957    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:17.017082 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:17.017025    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:17.603853 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:17.603803    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:17.604251 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:17.603887    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:17.604454 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:17.604437    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:17.606208 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:17.606191    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3e37b9f-0808-4c6c-8819-4f24ae43ce45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5db4\" (UID: \"c3e37b9f-0808-4c6c-8819-4f24ae43ce45\") " pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:17.742214 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:17.742185    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k5db4"
Jul 09 22:13:17.869502 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:17.869417    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k5db4"]
Jul 09 22:13:17.872406 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:13:17.872378    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e37b9f_0808_4c6c_8819_4f24ae43ce45.slice/crio-19b0eb7239bdde1004b848f86a6c7ff4cd1c0a3e1fc5952f546ee4df32ee16e2 WatchSource:0}: Error finding container 19b0eb7239bdde1004b848f86a6c7ff4cd1c0a3e1fc5952f546ee4df32ee16e2: Status 404 returned error can't find the container with id 19b0eb7239bdde1004b848f86a6c7ff4cd1c0a3e1fc5952f546ee4df32ee16e2
Jul 09 22:13:18.745960 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:18.745922    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k5db4" event={"ID":"c3e37b9f-0808-4c6c-8819-4f24ae43ce45","Type":"ContainerStarted","Data":"19b0eb7239bdde1004b848f86a6c7ff4cd1c0a3e1fc5952f546ee4df32ee16e2"}
Jul 09 22:13:20.780535 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:20.780499    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:20.833212 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:20.833171    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:21.756930 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:21.756897    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k5db4" event={"ID":"c3e37b9f-0808-4c6c-8819-4f24ae43ce45","Type":"ContainerStarted","Data":"b2ecf1c9ad27e2b3260da4cf6866bb3c9b9c57f19883b695bafb3197f1214f2e"}
Jul 09 22:13:22.742290 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:22.742257    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:22.848490 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:22.848458    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:23.065621 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.065541    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:23.111019 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.110988    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-22clr"]
Jul 09 22:13:23.113128 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.113084    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-22clr"
Jul 09 22:13:23.116543 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.116524    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-h8r9p\""
Jul 09 22:13:23.116543 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.116542    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 22:13:23.116714 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.116568    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 22:13:23.124303 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.124283    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-22clr"]
Jul 09 22:13:23.235395 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.235363    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:23.245134 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.245092    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krtrr\" (UniqueName: \"kubernetes.io/projected/8533bddc-6dd5-49ee-ab8e-990178daec0f-kube-api-access-krtrr\") pod \"downloads-685bfb5f64-22clr\" (UID: \"8533bddc-6dd5-49ee-ab8e-990178daec0f\") " pod="openshift-console/downloads-685bfb5f64-22clr"
Jul 09 22:13:23.335956 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.335857    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:23.345842 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.345799    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krtrr\" (UniqueName: \"kubernetes.io/projected/8533bddc-6dd5-49ee-ab8e-990178daec0f-kube-api-access-krtrr\") pod \"downloads-685bfb5f64-22clr\" (UID: \"8533bddc-6dd5-49ee-ab8e-990178daec0f\") " pod="openshift-console/downloads-685bfb5f64-22clr"
Jul 09 22:13:23.354196 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.354170    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krtrr\" (UniqueName: \"kubernetes.io/projected/8533bddc-6dd5-49ee-ab8e-990178daec0f-kube-api-access-krtrr\") pod \"downloads-685bfb5f64-22clr\" (UID: \"8533bddc-6dd5-49ee-ab8e-990178daec0f\") " pod="openshift-console/downloads-685bfb5f64-22clr"
Jul 09 22:13:23.422477 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.422436    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-22clr"
Jul 09 22:13:23.435896 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.435864    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:23.536185 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.536143    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:23.563697 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.563658    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-22clr"]
Jul 09 22:13:23.567292 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:13:23.567262    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8533bddc_6dd5_49ee_ab8e_990178daec0f.slice/crio-fefeeee16ac27bce8ab10015eb13dbac0cb6a1480cd57b34685f7d1a2f3b3a28 WatchSource:0}: Error finding container fefeeee16ac27bce8ab10015eb13dbac0cb6a1480cd57b34685f7d1a2f3b3a28: Status 404 returned error can't find the container with id fefeeee16ac27bce8ab10015eb13dbac0cb6a1480cd57b34685f7d1a2f3b3a28
Jul 09 22:13:23.764807 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.764761    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-22clr" event={"ID":"8533bddc-6dd5-49ee-ab8e-990178daec0f","Type":"ContainerStarted","Data":"fefeeee16ac27bce8ab10015eb13dbac0cb6a1480cd57b34685f7d1a2f3b3a28"}
Jul 09 22:13:23.766881 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:23.766853    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k5db4" event={"ID":"c3e37b9f-0808-4c6c-8819-4f24ae43ce45","Type":"ContainerStarted","Data":"ba6999887708fb3748e5f934a4b2c7ab83e606e5e5f40787865204150c66839a"}
Jul 09 22:13:24.436021 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:24.435980    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:24.629572 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:24.629537    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:24.853519 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:24.853491    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:24.911992 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:24.911957    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:25.103875 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:25.103791    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:25.774733 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:25.774643    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k5db4" event={"ID":"c3e37b9f-0808-4c6c-8819-4f24ae43ce45","Type":"ContainerStarted","Data":"3d77d2e151ed56bc378b798b358554b9f5a63a2125c7cf055e164db3591014e8"}
Jul 09 22:13:25.795675 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:25.795621    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k5db4" podStartSLOduration=17.351637174 podStartE2EDuration="24.795604028s" totalImagesPullingTime="7.443966854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:13:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:13:25.794014374 +0000 UTC m=+268.468013176" watchObservedRunningTime="2026-07-09 22:13:25.795604028 +0000 UTC m=+268.469602830"
Jul 09 22:13:29.449854 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:29.449810    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:29.528171 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:29.528135    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:30.622754 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:30.622704    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:30.682781 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:30.682736    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:31.090669 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.090587    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8468c6dd9b-p22mn"]
Jul 09 22:13:31.093812 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.093792    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.097117 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.096855    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 22:13:31.097117 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.096874    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 22:13:31.097117 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.096931    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 22:13:31.097774 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.097756    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mpx8s\""
Jul 09 22:13:31.097960 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.097920    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 22:13:31.098108 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.097983    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 22:13:31.103656 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.103633    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8468c6dd9b-p22mn"]
Jul 09 22:13:31.208462 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.208421    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43750f79-5ce8-4bba-8169-518b765226d7-console-oauth-config\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.208642 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.208463    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gft7\" (UniqueName: \"kubernetes.io/projected/43750f79-5ce8-4bba-8169-518b765226d7-kube-api-access-9gft7\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.208642 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.208518    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-service-ca\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.208642 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.208550    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-oauth-serving-cert\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.208801 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.208615    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43750f79-5ce8-4bba-8169-518b765226d7-console-serving-cert\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.208801 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.208701    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-console-config\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.309366 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.309334    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-console-config\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.309549 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.309384    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43750f79-5ce8-4bba-8169-518b765226d7-console-oauth-config\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.309549 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.309404    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gft7\" (UniqueName: \"kubernetes.io/projected/43750f79-5ce8-4bba-8169-518b765226d7-kube-api-access-9gft7\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.309549 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.309438    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-service-ca\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.309549 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.309459    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-oauth-serving-cert\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.309549 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.309479    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43750f79-5ce8-4bba-8169-518b765226d7-console-serving-cert\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.310169 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.310144    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-service-ca\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.310169 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.310164    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-oauth-serving-cert\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.310317 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.310215    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-console-config\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.311789 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.311770    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43750f79-5ce8-4bba-8169-518b765226d7-console-oauth-config\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.311886 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.311869    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43750f79-5ce8-4bba-8169-518b765226d7-console-serving-cert\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.317726 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.317708    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gft7\" (UniqueName: \"kubernetes.io/projected/43750f79-5ce8-4bba-8169-518b765226d7-kube-api-access-9gft7\") pod \"console-8468c6dd9b-p22mn\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") " pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.405868 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.405833    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:31.540442 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.540410    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8468c6dd9b-p22mn"]
Jul 09 22:13:31.542911 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:13:31.542879    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43750f79_5ce8_4bba_8169_518b765226d7.slice/crio-244fe7a990586f1da891cfe0202eb39f5b1d62cfa204ac18fe8ed8e1d812f312 WatchSource:0}: Error finding container 244fe7a990586f1da891cfe0202eb39f5b1d62cfa204ac18fe8ed8e1d812f312: Status 404 returned error can't find the container with id 244fe7a990586f1da891cfe0202eb39f5b1d62cfa204ac18fe8ed8e1d812f312
Jul 09 22:13:31.763723 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.763642    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:31.798893 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.798860    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8468c6dd9b-p22mn" event={"ID":"43750f79-5ce8-4bba-8169-518b765226d7","Type":"ContainerStarted","Data":"244fe7a990586f1da891cfe0202eb39f5b1d62cfa204ac18fe8ed8e1d812f312"}
Jul 09 22:13:31.863440 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.863410    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:31.945246 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:31.945185    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:32.175121 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:32.175074    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:35.964863 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:35.964812    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:36.038649 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:36.038605    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:36.133757 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:36.133723    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:36.455325 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:36.455292    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:38.343784 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:38.343752    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:39.047789 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:39.047753    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:39.102533 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:39.102504    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:39.449731 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:39.449692    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5s9gq" podUID="7290a5ae-4fe0-445e-a11f-8133ff8187b3"
Jul 09 22:13:39.827525 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:39.827446    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:13:40.103723 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.103680    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:40.313489 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.313456    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:40.379564 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.379495    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pqxrk"]
Jul 09 22:13:40.383780 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.383758    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.386063 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.386022    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 22:13:40.386182 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.386073    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 22:13:40.386336 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.386272    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 22:13:40.387306 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.387190    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 22:13:40.387306 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.387205    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mb9sv\""
Jul 09 22:13:40.387306 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.387225    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 22:13:40.387306 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.387258    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 22:13:40.414845 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.414813    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:40.485541 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.485506    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbab2393-0bcd-4cb1-a727-f07df4240ff1-metrics-client-ca\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.485980 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.485546    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fbab2393-0bcd-4cb1-a727-f07df4240ff1-node-exporter-accelerators-collector-config\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.485980 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.485602    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbab2393-0bcd-4cb1-a727-f07df4240ff1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.485980 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.485635    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fbab2393-0bcd-4cb1-a727-f07df4240ff1-node-exporter-wtmp\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.485980 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.485671    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8674\" (UniqueName: \"kubernetes.io/projected/fbab2393-0bcd-4cb1-a727-f07df4240ff1-kube-api-access-s8674\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.485980 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.485698    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbab2393-0bcd-4cb1-a727-f07df4240ff1-sys\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.485980 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.485746    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fbab2393-0bcd-4cb1-a727-f07df4240ff1-node-exporter-textfile\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.485980 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.485782    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fbab2393-0bcd-4cb1-a727-f07df4240ff1-node-exporter-tls\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.485980 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.485811    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fbab2393-0bcd-4cb1-a727-f07df4240ff1-root\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.503322 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.503265    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:40.587170 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.587133    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8674\" (UniqueName: \"kubernetes.io/projected/fbab2393-0bcd-4cb1-a727-f07df4240ff1-kube-api-access-s8674\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.587341 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.587182    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbab2393-0bcd-4cb1-a727-f07df4240ff1-sys\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.587341 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.587217    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fbab2393-0bcd-4cb1-a727-f07df4240ff1-node-exporter-textfile\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.587341 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.587249    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fbab2393-0bcd-4cb1-a727-f07df4240ff1-node-exporter-tls\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.587341 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.587276    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fbab2393-0bcd-4cb1-a727-f07df4240ff1-root\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.587341 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.587310    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbab2393-0bcd-4cb1-a727-f07df4240ff1-metrics-client-ca\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.587341 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.587314    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbab2393-0bcd-4cb1-a727-f07df4240ff1-sys\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.587341 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.587331    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fbab2393-0bcd-4cb1-a727-f07df4240ff1-node-exporter-accelerators-collector-config\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.587685 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.587382    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fbab2393-0bcd-4cb1-a727-f07df4240ff1-root\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.587685 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.587400    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbab2393-0bcd-4cb1-a727-f07df4240ff1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.587685 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.587437    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fbab2393-0bcd-4cb1-a727-f07df4240ff1-node-exporter-wtmp\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.587685 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.587573    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fbab2393-0bcd-4cb1-a727-f07df4240ff1-node-exporter-wtmp\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.587685 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.587607    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fbab2393-0bcd-4cb1-a727-f07df4240ff1-node-exporter-textfile\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.587928 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.587898    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbab2393-0bcd-4cb1-a727-f07df4240ff1-metrics-client-ca\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.587928 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.587908    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fbab2393-0bcd-4cb1-a727-f07df4240ff1-node-exporter-accelerators-collector-config\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.590262 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.590216    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbab2393-0bcd-4cb1-a727-f07df4240ff1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.590381 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.590299    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fbab2393-0bcd-4cb1-a727-f07df4240ff1-node-exporter-tls\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.595025 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.595001    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8674\" (UniqueName: \"kubernetes.io/projected/fbab2393-0bcd-4cb1-a727-f07df4240ff1-kube-api-access-s8674\") pod \"node-exporter-pqxrk\" (UID: \"fbab2393-0bcd-4cb1-a727-f07df4240ff1\") " pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.606090 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.606059    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:40.695045 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.694947    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pqxrk"
Jul 09 22:13:40.704118 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:40.704088    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:41.324324 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:41.324293    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:41.448424 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:41.448394    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:41.531292 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:41.531260    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:41.632631 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:41.632515    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:41.843284 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:13:41.843263    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbab2393_0bcd_4cb1_a727_f07df4240ff1.slice/crio-5e91c42127cb810689374af3291a0c8f9e3fdad3a667ecfcec6a2026c7647a04 WatchSource:0}: Error finding container 5e91c42127cb810689374af3291a0c8f9e3fdad3a667ecfcec6a2026c7647a04: Status 404 returned error can't find the container with id 5e91c42127cb810689374af3291a0c8f9e3fdad3a667ecfcec6a2026c7647a04
Jul 09 22:13:41.853402 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:41.853374    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:42.269665 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:42.269572    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:42.331212 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:42.331171    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:42.840619 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:42.840553    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-22clr" event={"ID":"8533bddc-6dd5-49ee-ab8e-990178daec0f","Type":"ContainerStarted","Data":"683be6b92376b05b5755059de30ed36f8e758196b2e45726f95248b252f97ccd"}
Jul 09 22:13:42.840619 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:42.840726    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-22clr"
Jul 09 22:13:42.843174 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:42.843145    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pqxrk" event={"ID":"fbab2393-0bcd-4cb1-a727-f07df4240ff1","Type":"ContainerStarted","Data":"5e91c42127cb810689374af3291a0c8f9e3fdad3a667ecfcec6a2026c7647a04"}
Jul 09 22:13:42.845077 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:42.845025    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8468c6dd9b-p22mn" event={"ID":"43750f79-5ce8-4bba-8169-518b765226d7","Type":"ContainerStarted","Data":"75edb9d93c86731d23cfeef0270724d55a81747579ef5e70edc169a9d09a07f2"}
Jul 09 22:13:42.855778 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:42.855648    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-22clr"
Jul 09 22:13:42.857440 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:42.857338    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-22clr" podStartSLOduration=1.529489688 podStartE2EDuration="19.857322207s" totalImagesPullingTime="18.327832519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:13:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:13:42.856682091 +0000 UTC m=+285.530680923" watchObservedRunningTime="2026-07-09 22:13:42.857322207 +0000 UTC m=+285.531321013"
Jul 09 22:13:43.105543 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:43.105517    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:13:43.108355 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:43.108334    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7290a5ae-4fe0-445e-a11f-8133ff8187b3-metrics-tls\") pod \"dns-default-5s9gq\" (UID: \"7290a5ae-4fe0-445e-a11f-8133ff8187b3\") " pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:13:43.130283 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:43.130254    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-77st2\""
Jul 09 22:13:43.138908 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:43.138884    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:13:43.287265 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:43.287234    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:43.312386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:43.312330    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8468c6dd9b-p22mn" podStartSLOduration=2.015408696 podStartE2EDuration="12.312306618s" totalImagesPullingTime="10.296897922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:13:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:13:42.889059245 +0000 UTC m=+285.563058048" watchObservedRunningTime="2026-07-09 22:13:43.312306618 +0000 UTC m=+285.986305422"
Jul 09 22:13:43.312588 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:43.312566    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5s9gq"]
Jul 09 22:13:43.325275 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:13:43.325246    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7290a5ae_4fe0_445e_a11f_8133ff8187b3.slice/crio-c576b3de7c0db35caa457883de98573a745fb0ceda5513d21ff0c602b085552e WatchSource:0}: Error finding container c576b3de7c0db35caa457883de98573a745fb0ceda5513d21ff0c602b085552e: Status 404 returned error can't find the container with id c576b3de7c0db35caa457883de98573a745fb0ceda5513d21ff0c602b085552e
Jul 09 22:13:43.376535 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:43.376495    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:43.850577 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:43.850529    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5s9gq" event={"ID":"7290a5ae-4fe0-445e-a11f-8133ff8187b3","Type":"ContainerStarted","Data":"c576b3de7c0db35caa457883de98573a745fb0ceda5513d21ff0c602b085552e"}
Jul 09 22:13:43.855152 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:43.853427    2554 generic.go:356] "Generic (PLEG): container finished" podID="fbab2393-0bcd-4cb1-a727-f07df4240ff1" containerID="34f6c2bbd818dd1a1aea75c77ee44bcda076308937184675c8a8f96944e5b65d" exitCode=0
Jul 09 22:13:43.855152 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:43.853476    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pqxrk" event={"ID":"fbab2393-0bcd-4cb1-a727-f07df4240ff1","Type":"ContainerDied","Data":"34f6c2bbd818dd1a1aea75c77ee44bcda076308937184675c8a8f96944e5b65d"}
Jul 09 22:13:44.518150 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.518051    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:44.669684 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.669647    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-c4ff5757-rm994"]
Jul 09 22:13:44.692370 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.692340    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c4ff5757-rm994"]
Jul 09 22:13:44.692540 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.692450    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.695347 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.695265    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 22:13:44.696136 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.696111    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 22:13:44.696352 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.696164    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 22:13:44.696352 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.696216    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vmh9k\""
Jul 09 22:13:44.697578 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.697108    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8k2fpe89jueff\""
Jul 09 22:13:44.702883 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.698849    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 22:13:44.719252 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.719223    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-secret-metrics-server-tls\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.719390 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.719310    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-client-ca-bundle\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.719507 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.719413    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mph82\" (UniqueName: \"kubernetes.io/projected/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-kube-api-access-mph82\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.719507 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.719452    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-secret-metrics-server-client-certs\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.719619 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.719530    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-metrics-server-audit-profiles\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.719619 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.719568    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.719619 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.719594    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-audit-log\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.820768 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.820683    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-secret-metrics-server-tls\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.820937 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.820764    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-client-ca-bundle\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.820937 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.820807    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mph82\" (UniqueName: \"kubernetes.io/projected/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-kube-api-access-mph82\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.820937 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.820850    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-secret-metrics-server-client-certs\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.820937 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.820877    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-metrics-server-audit-profiles\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.820937 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.820900    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.820937 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.820919    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-audit-log\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.821382 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.821351    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-audit-log\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.822365 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.822318    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-metrics-server-audit-profiles\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.822649 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.822629    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.824734 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.824709    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-secret-metrics-server-client-certs\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.825003 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.824891    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-client-ca-bundle\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.825442 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.825418    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-secret-metrics-server-tls\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.831486 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.831462    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mph82\" (UniqueName: \"kubernetes.io/projected/0d4b3db8-8daf-4bd6-a938-a68a47da69b4-kube-api-access-mph82\") pod \"metrics-server-c4ff5757-rm994\" (UID: \"0d4b3db8-8daf-4bd6-a938-a68a47da69b4\") " pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:44.862327 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.862243    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pqxrk" event={"ID":"fbab2393-0bcd-4cb1-a727-f07df4240ff1","Type":"ContainerStarted","Data":"1ed78bd74370f2ccea4a5a61627f00d8c1e280653b7003d295e5f16390946fdc"}
Jul 09 22:13:44.862745 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.862340    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pqxrk" event={"ID":"fbab2393-0bcd-4cb1-a727-f07df4240ff1","Type":"ContainerStarted","Data":"d247062fc8ba130a06c778f4e2a31f27b2a47aa5197b0bd7f3d57fe4489c4c84"}
Jul 09 22:13:44.882389 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:44.881263    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pqxrk" podStartSLOduration=3.543097197 podStartE2EDuration="4.881243297s" totalImagesPullingTime="1.248801437s" totalInitContainerRuntime="89.344663ms" isStatefulPod=true podCreationTimestamp="2026-07-09 22:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:13:44.880679143 +0000 UTC m=+287.554677968" watchObservedRunningTime="2026-07-09 22:13:44.881243297 +0000 UTC m=+287.555242082"
Jul 09 22:13:45.012908 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.012867    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:13:45.125522 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.125384    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:45.225297 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.225246    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:45.325005 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.324906    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:45.408994 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.408919    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c4ff5757-rm994"]
Jul 09 22:13:45.412054 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:13:45.412006    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4b3db8_8daf_4bd6_a938_a68a47da69b4.slice/crio-fbce50c17f7bcf1886c951ad50df5b4f2292a2b408b47d588e2b081a64cd0652 WatchSource:0}: Error finding container fbce50c17f7bcf1886c951ad50df5b4f2292a2b408b47d588e2b081a64cd0652: Status 404 returned error can't find the container with id fbce50c17f7bcf1886c951ad50df5b4f2292a2b408b47d588e2b081a64cd0652
Jul 09 22:13:45.471424 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.471393    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8468c6dd9b-p22mn"]
Jul 09 22:13:45.502721 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.502694    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84c4c4ccd4-hcrcc"]
Jul 09 22:13:45.516403 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.516372    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.517599 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.517575    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c4c4ccd4-hcrcc"]
Jul 09 22:13:45.523310 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.523286    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 22:13:45.524950 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.524918    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-trusted-ca-bundle\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.525083 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.524975    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-console-config\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.525083 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.525028    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/578300c5-347b-4279-ab76-0a091a21fdde-console-serving-cert\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.525308 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.525096    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-service-ca\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.525308 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.525130    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcvqd\" (UniqueName: \"kubernetes.io/projected/578300c5-347b-4279-ab76-0a091a21fdde-kube-api-access-zcvqd\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.525308 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.525168    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/578300c5-347b-4279-ab76-0a091a21fdde-console-oauth-config\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.525308 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.525221    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-oauth-serving-cert\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.625628 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.625594    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/578300c5-347b-4279-ab76-0a091a21fdde-console-serving-cert\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.625760 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.625645    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-service-ca\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.625760 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.625674    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcvqd\" (UniqueName: \"kubernetes.io/projected/578300c5-347b-4279-ab76-0a091a21fdde-kube-api-access-zcvqd\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.625760 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.625708    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/578300c5-347b-4279-ab76-0a091a21fdde-console-oauth-config\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.625760 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.625743    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-oauth-serving-cert\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.625963 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.625802    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-trusted-ca-bundle\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.625963 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.625830    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-console-config\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.626735 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.626568    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-console-config\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.628319 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.627537    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-oauth-serving-cert\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.628319 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.627728    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-service-ca\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.628319 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.628281    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-trusted-ca-bundle\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.630249 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.630227    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/578300c5-347b-4279-ab76-0a091a21fdde-console-oauth-config\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.631189 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.631150    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/578300c5-347b-4279-ab76-0a091a21fdde-console-serving-cert\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.636381 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.636331    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcvqd\" (UniqueName: \"kubernetes.io/projected/578300c5-347b-4279-ab76-0a091a21fdde-kube-api-access-zcvqd\") pod \"console-84c4c4ccd4-hcrcc\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") " pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.828290 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.828261    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:45.868119 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.868083    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c4ff5757-rm994" event={"ID":"0d4b3db8-8daf-4bd6-a938-a68a47da69b4","Type":"ContainerStarted","Data":"fbce50c17f7bcf1886c951ad50df5b4f2292a2b408b47d588e2b081a64cd0652"}
Jul 09 22:13:45.870421 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.870341    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5s9gq" event={"ID":"7290a5ae-4fe0-445e-a11f-8133ff8187b3","Type":"ContainerStarted","Data":"37b3ce6a7e2c0662e73856b81fb7dc82ed7dabf919dac170dbf657af28146953"}
Jul 09 22:13:45.870421 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.870396    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5s9gq" event={"ID":"7290a5ae-4fe0-445e-a11f-8133ff8187b3","Type":"ContainerStarted","Data":"2575b2b15791d23a3bbd3440c2bdd1b7b053c9b5a3de2e29f1d7dbc6e66042bc"}
Jul 09 22:13:45.999744 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:45.999707    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c4c4ccd4-hcrcc"]
Jul 09 22:13:46.004865 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:13:46.004833    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod578300c5_347b_4279_ab76_0a091a21fdde.slice/crio-09c6fb44323ba37e1905cd98582506027eae291574ad14ef9b3d2ef056010034 WatchSource:0}: Error finding container 09c6fb44323ba37e1905cd98582506027eae291574ad14ef9b3d2ef056010034: Status 404 returned error can't find the container with id 09c6fb44323ba37e1905cd98582506027eae291574ad14ef9b3d2ef056010034
Jul 09 22:13:46.327714 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:46.327529    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:46.435221 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:46.435183    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:46.527640 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:46.527600    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:46.614743 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:46.614656    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:46.877841 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:46.877647    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c4c4ccd4-hcrcc" event={"ID":"578300c5-347b-4279-ab76-0a091a21fdde","Type":"ContainerStarted","Data":"4a1cd0f335deda6c16375c566350c087c171209df772c402863565c90a30c562"}
Jul 09 22:13:46.877841 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:46.877705    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c4c4ccd4-hcrcc" event={"ID":"578300c5-347b-4279-ab76-0a091a21fdde","Type":"ContainerStarted","Data":"09c6fb44323ba37e1905cd98582506027eae291574ad14ef9b3d2ef056010034"}
Jul 09 22:13:46.878379 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:46.878060    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:13:46.897632 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:46.897575    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5s9gq" podStartSLOduration=251.658858522 podStartE2EDuration="4m13.897555456s" totalImagesPullingTime="2.238696934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:13:46.895109064 +0000 UTC m=+289.569107894" watchObservedRunningTime="2026-07-09 22:13:46.897555456 +0000 UTC m=+289.571554258"
Jul 09 22:13:47.856181 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:47.856133    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:47.883503 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:47.883459    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c4ff5757-rm994" event={"ID":"0d4b3db8-8daf-4bd6-a938-a68a47da69b4","Type":"ContainerStarted","Data":"f2ffa0901e7cc0900d9ec202b13106a89463dff1d4466bf9c921777c57296225"}
Jul 09 22:13:47.901309 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:47.901211    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84c4c4ccd4-hcrcc" podStartSLOduration=2.901192476 podStartE2EDuration="2.901192476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:13:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:13:46.916793622 +0000 UTC m=+289.590792427" watchObservedRunningTime="2026-07-09 22:13:47.901192476 +0000 UTC m=+290.575191280"
Jul 09 22:13:47.902508 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:47.902469    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-c4ff5757-rm994" podStartSLOduration=1.823077857 podStartE2EDuration="3.902454921s" totalImagesPullingTime="2.079377064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:13:47.901071189 +0000 UTC m=+290.575070016" watchObservedRunningTime="2026-07-09 22:13:47.902454921 +0000 UTC m=+290.576453723"
Jul 09 22:13:47.954418 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:47.954377    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:48.667230 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:48.667195    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:48.763913 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:48.763877    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:51.406749 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:51.406716    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:13:51.877202 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:13:51.877164    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ffzhl" podUID="de9caaf7-9880-4c95-bd81-ab0a8e6be1cd"
Jul 09 22:13:52.062951 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:52.062921    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:52.115028 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:52.114994    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:55.609911 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:55.609875    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:55.665249 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:55.665216    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:55.828646 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:55.828612    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:55.828788 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:55.828666    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:55.833412 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:55.833395    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:55.914412 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:55.914343    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:13:56.078047 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:56.077987    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:56.179080 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:56.178985    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:56.233129 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:56.233101    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:56.886141 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:56.886116    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5s9gq"
Jul 09 22:13:57.697652 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:57.697625    2554 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 22:13:57.920555 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:57.920413    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:58.141557 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:58.021312    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:13:59.404675 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:13:59.404640    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:14:00.225638 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:00.225600    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:14:00.350527 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:00.350496    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:14:03.876171 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:03.876135    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:14:05.013652 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:05.013618    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:14:05.014052 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:05.013692    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:14:05.778453 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:05.778416    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:14:05.841050 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:05.841006    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:14:07.002521 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:07.002491    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:14:07.102707 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:07.102668    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:14:08.367709 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:08.367673    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:14:08.430927 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:08.430896    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:14:10.496075 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.496004    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8468c6dd9b-p22mn" podUID="43750f79-5ce8-4bba-8169-518b765226d7" containerName="console" containerID="cri-o://75edb9d93c86731d23cfeef0270724d55a81747579ef5e70edc169a9d09a07f2" gracePeriod=15
Jul 09 22:14:10.738666 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.738645    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:14:10.832863 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.832832    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gft7\" (UniqueName: \"kubernetes.io/projected/43750f79-5ce8-4bba-8169-518b765226d7-kube-api-access-9gft7\") pod \"43750f79-5ce8-4bba-8169-518b765226d7\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") "
Jul 09 22:14:10.832863 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.832871    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43750f79-5ce8-4bba-8169-518b765226d7-console-oauth-config\") pod \"43750f79-5ce8-4bba-8169-518b765226d7\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") "
Jul 09 22:14:10.833084 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.832890    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43750f79-5ce8-4bba-8169-518b765226d7-console-serving-cert\") pod \"43750f79-5ce8-4bba-8169-518b765226d7\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") "
Jul 09 22:14:10.833084 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.832937    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-oauth-serving-cert\") pod \"43750f79-5ce8-4bba-8169-518b765226d7\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") "
Jul 09 22:14:10.833084 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.832966    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-service-ca\") pod \"43750f79-5ce8-4bba-8169-518b765226d7\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") "
Jul 09 22:14:10.833084 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.833006    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-console-config\") pod \"43750f79-5ce8-4bba-8169-518b765226d7\" (UID: \"43750f79-5ce8-4bba-8169-518b765226d7\") "
Jul 09 22:14:10.833448 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.833421    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-service-ca" (OuterVolumeSpecName: "service-ca") pod "43750f79-5ce8-4bba-8169-518b765226d7" (UID: "43750f79-5ce8-4bba-8169-518b765226d7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:14:10.833542 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.833414    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-console-config" (OuterVolumeSpecName: "console-config") pod "43750f79-5ce8-4bba-8169-518b765226d7" (UID: "43750f79-5ce8-4bba-8169-518b765226d7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:14:10.833603 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.833531    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "43750f79-5ce8-4bba-8169-518b765226d7" (UID: "43750f79-5ce8-4bba-8169-518b765226d7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:14:10.835188 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.835160    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43750f79-5ce8-4bba-8169-518b765226d7-kube-api-access-9gft7" (OuterVolumeSpecName: "kube-api-access-9gft7") pod "43750f79-5ce8-4bba-8169-518b765226d7" (UID: "43750f79-5ce8-4bba-8169-518b765226d7"). InnerVolumeSpecName "kube-api-access-9gft7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:14:10.835188 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.835172    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43750f79-5ce8-4bba-8169-518b765226d7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "43750f79-5ce8-4bba-8169-518b765226d7" (UID: "43750f79-5ce8-4bba-8169-518b765226d7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:14:10.835316 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.835186    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43750f79-5ce8-4bba-8169-518b765226d7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "43750f79-5ce8-4bba-8169-518b765226d7" (UID: "43750f79-5ce8-4bba-8169-518b765226d7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:14:10.933598 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.933528    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-console-config\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:14:10.933598 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.933553    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gft7\" (UniqueName: \"kubernetes.io/projected/43750f79-5ce8-4bba-8169-518b765226d7-kube-api-access-9gft7\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:14:10.933598 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.933564    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43750f79-5ce8-4bba-8169-518b765226d7-console-oauth-config\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:14:10.933598 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.933572    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43750f79-5ce8-4bba-8169-518b765226d7-console-serving-cert\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:14:10.933598 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.933582    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-oauth-serving-cert\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:14:10.933598 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.933590    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43750f79-5ce8-4bba-8169-518b765226d7-service-ca\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:14:10.962963 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.962934    2554 generic.go:356] "Generic (PLEG): container finished" podID="43750f79-5ce8-4bba-8169-518b765226d7" containerID="75edb9d93c86731d23cfeef0270724d55a81747579ef5e70edc169a9d09a07f2" exitCode=0
Jul 09 22:14:10.963110 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.962986    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8468c6dd9b-p22mn"
Jul 09 22:14:10.963110 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.963025    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8468c6dd9b-p22mn" event={"ID":"43750f79-5ce8-4bba-8169-518b765226d7","Type":"ContainerDied","Data":"75edb9d93c86731d23cfeef0270724d55a81747579ef5e70edc169a9d09a07f2"}
Jul 09 22:14:10.963110 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.963086    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8468c6dd9b-p22mn" event={"ID":"43750f79-5ce8-4bba-8169-518b765226d7","Type":"ContainerDied","Data":"244fe7a990586f1da891cfe0202eb39f5b1d62cfa204ac18fe8ed8e1d812f312"}
Jul 09 22:14:10.963110 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.963106    2554 scope.go:117] "RemoveContainer" containerID="75edb9d93c86731d23cfeef0270724d55a81747579ef5e70edc169a9d09a07f2"
Jul 09 22:14:10.971244 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.971230    2554 scope.go:117] "RemoveContainer" containerID="75edb9d93c86731d23cfeef0270724d55a81747579ef5e70edc169a9d09a07f2"
Jul 09 22:14:10.971470 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:14:10.971451    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75edb9d93c86731d23cfeef0270724d55a81747579ef5e70edc169a9d09a07f2\": container with ID starting with 75edb9d93c86731d23cfeef0270724d55a81747579ef5e70edc169a9d09a07f2 not found: ID does not exist" containerID="75edb9d93c86731d23cfeef0270724d55a81747579ef5e70edc169a9d09a07f2"
Jul 09 22:14:10.971514 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.971478    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75edb9d93c86731d23cfeef0270724d55a81747579ef5e70edc169a9d09a07f2"} err="failed to get container status \"75edb9d93c86731d23cfeef0270724d55a81747579ef5e70edc169a9d09a07f2\": rpc error: code = NotFound desc = could not find container \"75edb9d93c86731d23cfeef0270724d55a81747579ef5e70edc169a9d09a07f2\": container with ID starting with 75edb9d93c86731d23cfeef0270724d55a81747579ef5e70edc169a9d09a07f2 not found: ID does not exist"
Jul 09 22:14:10.987718 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.987698    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8468c6dd9b-p22mn"]
Jul 09 22:14:10.995220 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:10.995202    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8468c6dd9b-p22mn"]
Jul 09 22:14:11.187354 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:11.187270    2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl" podUID="9451194e-a7fc-4093-8772-e382c24b66c4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 09 22:14:11.879651 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:11.879624    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43750f79-5ce8-4bba-8169-518b765226d7" path="/var/lib/kubelet/pods/43750f79-5ce8-4bba-8169-518b765226d7/volumes"
Jul 09 22:14:13.824396 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:13.824355    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:14:13.925333 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:13.925284    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:14:14.026379 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:14.026346    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:14:20.783590 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:20.783555    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:14:20.841186 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:20.841155    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:14:21.186559 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:21.186518    2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl" podUID="9451194e-a7fc-4093-8772-e382c24b66c4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 09 22:14:25.018907 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:25.018863    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:14:25.022835 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:25.022808    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-c4ff5757-rm994"
Jul 09 22:14:31.186941 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:31.186905    2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl" podUID="9451194e-a7fc-4093-8772-e382c24b66c4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 09 22:14:31.187444 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:31.186977    2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl"
Jul 09 22:14:31.187444 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:31.187418    2554 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"30d7736d9bccffebb9852b28bd3b62c04a7d9bc7f4e849e6b1e509c98af28f3f"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 09 22:14:31.187539 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:31.187450    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl" podUID="9451194e-a7fc-4093-8772-e382c24b66c4" containerName="service-proxy" containerID="cri-o://30d7736d9bccffebb9852b28bd3b62c04a7d9bc7f4e849e6b1e509c98af28f3f" gracePeriod=30
Jul 09 22:14:32.039343 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:32.039302    2554 generic.go:356] "Generic (PLEG): container finished" podID="9451194e-a7fc-4093-8772-e382c24b66c4" containerID="30d7736d9bccffebb9852b28bd3b62c04a7d9bc7f4e849e6b1e509c98af28f3f" exitCode=2
Jul 09 22:14:32.039560 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:32.039378    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl" event={"ID":"9451194e-a7fc-4093-8772-e382c24b66c4","Type":"ContainerDied","Data":"30d7736d9bccffebb9852b28bd3b62c04a7d9bc7f4e849e6b1e509c98af28f3f"}
Jul 09 22:14:32.039560 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:32.039422    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858b65648c-q7wtl" event={"ID":"9451194e-a7fc-4093-8772-e382c24b66c4","Type":"ContainerStarted","Data":"57451bd555aebf86bb739ab4b236e1dc2600e65759e9b15109516622d5a59b66"}
Jul 09 22:14:57.048580 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:57.048475    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:14:57.105670 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:57.105636    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:14:59.602872 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:59.602830    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:14:59.938679 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:14:59.938598    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:08.679943 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:08.679911    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:08.737275 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:08.737243    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:10.386480 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:10.386449    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:10.439015 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:10.438986    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:10.525265 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:10.525234    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:10.581255 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:10.581230    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:11.143749 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:11.143718    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:11.244914 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:11.244884    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:11.698158 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:11.698130    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs\") pod \"network-metrics-daemon-ffzhl\" (UID: \"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd\") " pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:15:11.700370 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:11.700351    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9caaf7-9880-4c95-bd81-ab0a8e6be1cd-metrics-certs\") pod \"network-metrics-daemon-ffzhl\" (UID: \"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd\") " pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:15:11.979743 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:11.979659    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zm9fl\""
Jul 09 22:15:11.986973 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:11.986957    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffzhl"
Jul 09 22:15:12.106159 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:12.106129    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ffzhl"]
Jul 09 22:15:12.109401 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:15:12.109374    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9caaf7_9880_4c95_bd81_ab0a8e6be1cd.slice/crio-08b492bd6a7aa8606859c8466fdc9a2f7907b09f277d4b2231650b429a6c5c2f WatchSource:0}: Error finding container 08b492bd6a7aa8606859c8466fdc9a2f7907b09f277d4b2231650b429a6c5c2f: Status 404 returned error can't find the container with id 08b492bd6a7aa8606859c8466fdc9a2f7907b09f277d4b2231650b429a6c5c2f
Jul 09 22:15:12.111578 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:12.111562    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:15:12.171941 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:12.171908    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ffzhl" event={"ID":"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd","Type":"ContainerStarted","Data":"08b492bd6a7aa8606859c8466fdc9a2f7907b09f277d4b2231650b429a6c5c2f"}
Jul 09 22:15:14.182051 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:14.182000    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ffzhl" event={"ID":"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd","Type":"ContainerStarted","Data":"9f2becdd47841b3ff0f7ecbab0e930ba4460c53fcc9d8dcfb450bb774ab3671d"}
Jul 09 22:15:14.182693 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:14.182109    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ffzhl" event={"ID":"de9caaf7-9880-4c95-bd81-ab0a8e6be1cd","Type":"ContainerStarted","Data":"cd3adf1f12bf8793134836d13080a07709fc3fd968f8e56be416495e692266b9"}
Jul 09 22:15:14.199952 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:14.199904    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ffzhl" podStartSLOduration=375.176902889 podStartE2EDuration="6m16.199883959s" totalImagesPullingTime="1.02298107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:15:14.19966448 +0000 UTC m=+376.873663283" watchObservedRunningTime="2026-07-09 22:15:14.199883959 +0000 UTC m=+376.873882763"
Jul 09 22:15:14.296048 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:14.296014    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:14.396287 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:14.396257    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:14.871152 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:14.871117    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:14.989242 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:14.989211    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:20.004918 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:20.004878    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:20.603474 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:20.603437    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:20.660111 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:20.660077    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:26.808423 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:26.808394    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:26.866277 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:26.866244    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:31.147860 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:31.147828    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84c4c4ccd4-hcrcc"]
Jul 09 22:15:31.250052 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:31.249995    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:31.298520 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:31.298490    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:31.356850 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:31.356817    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:35.796753 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:35.796718    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:35.904190 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:35.904147    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:36.001490 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:36.001457    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:40.198554 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:40.198520    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:52.982899 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:52.982858    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:53.099051 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:53.099011    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:15:56.167432 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.167376    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-84c4c4ccd4-hcrcc" podUID="578300c5-347b-4279-ab76-0a091a21fdde" containerName="console" containerID="cri-o://4a1cd0f335deda6c16375c566350c087c171209df772c402863565c90a30c562" gracePeriod=15
Jul 09 22:15:56.326783 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.326752    2554 generic.go:356] "Generic (PLEG): container finished" podID="578300c5-347b-4279-ab76-0a091a21fdde" containerID="4a1cd0f335deda6c16375c566350c087c171209df772c402863565c90a30c562" exitCode=0
Jul 09 22:15:56.326926 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.326827    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c4c4ccd4-hcrcc" event={"ID":"578300c5-347b-4279-ab76-0a091a21fdde","Type":"ContainerDied","Data":"4a1cd0f335deda6c16375c566350c087c171209df772c402863565c90a30c562"}
Jul 09 22:15:56.396866 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.396844    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:15:56.523099 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.522988    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcvqd\" (UniqueName: \"kubernetes.io/projected/578300c5-347b-4279-ab76-0a091a21fdde-kube-api-access-zcvqd\") pod \"578300c5-347b-4279-ab76-0a091a21fdde\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") "
Jul 09 22:15:56.523099 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.523054    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/578300c5-347b-4279-ab76-0a091a21fdde-console-serving-cert\") pod \"578300c5-347b-4279-ab76-0a091a21fdde\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") "
Jul 09 22:15:56.523099 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.523077    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/578300c5-347b-4279-ab76-0a091a21fdde-console-oauth-config\") pod \"578300c5-347b-4279-ab76-0a091a21fdde\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") "
Jul 09 22:15:56.523367 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.523130    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-oauth-serving-cert\") pod \"578300c5-347b-4279-ab76-0a091a21fdde\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") "
Jul 09 22:15:56.523367 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.523163    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-trusted-ca-bundle\") pod \"578300c5-347b-4279-ab76-0a091a21fdde\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") "
Jul 09 22:15:56.523367 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.523204    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-console-config\") pod \"578300c5-347b-4279-ab76-0a091a21fdde\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") "
Jul 09 22:15:56.523367 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.523225    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-service-ca\") pod \"578300c5-347b-4279-ab76-0a091a21fdde\" (UID: \"578300c5-347b-4279-ab76-0a091a21fdde\") "
Jul 09 22:15:56.523630 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.523526    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "578300c5-347b-4279-ab76-0a091a21fdde" (UID: "578300c5-347b-4279-ab76-0a091a21fdde"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:15:56.523695 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.523628    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-console-config" (OuterVolumeSpecName: "console-config") pod "578300c5-347b-4279-ab76-0a091a21fdde" (UID: "578300c5-347b-4279-ab76-0a091a21fdde"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:15:56.523695 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.523640    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "578300c5-347b-4279-ab76-0a091a21fdde" (UID: "578300c5-347b-4279-ab76-0a091a21fdde"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:15:56.523695 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.523672    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-service-ca" (OuterVolumeSpecName: "service-ca") pod "578300c5-347b-4279-ab76-0a091a21fdde" (UID: "578300c5-347b-4279-ab76-0a091a21fdde"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:15:56.525273 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.525249    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/578300c5-347b-4279-ab76-0a091a21fdde-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "578300c5-347b-4279-ab76-0a091a21fdde" (UID: "578300c5-347b-4279-ab76-0a091a21fdde"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:15:56.525273 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.525266    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/578300c5-347b-4279-ab76-0a091a21fdde-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "578300c5-347b-4279-ab76-0a091a21fdde" (UID: "578300c5-347b-4279-ab76-0a091a21fdde"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:15:56.525273 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.525249    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/578300c5-347b-4279-ab76-0a091a21fdde-kube-api-access-zcvqd" (OuterVolumeSpecName: "kube-api-access-zcvqd") pod "578300c5-347b-4279-ab76-0a091a21fdde" (UID: "578300c5-347b-4279-ab76-0a091a21fdde"). InnerVolumeSpecName "kube-api-access-zcvqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:15:56.624391 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.624355    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-oauth-serving-cert\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:15:56.624391 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.624384    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-trusted-ca-bundle\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:15:56.624391 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.624394    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-console-config\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:15:56.624608 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.624403    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/578300c5-347b-4279-ab76-0a091a21fdde-service-ca\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:15:56.624608 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.624411    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcvqd\" (UniqueName: \"kubernetes.io/projected/578300c5-347b-4279-ab76-0a091a21fdde-kube-api-access-zcvqd\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:15:56.624608 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.624421    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/578300c5-347b-4279-ab76-0a091a21fdde-console-serving-cert\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:15:56.624608 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:56.624428    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/578300c5-347b-4279-ab76-0a091a21fdde-console-oauth-config\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:15:57.331262 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:57.331231    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c4c4ccd4-hcrcc" event={"ID":"578300c5-347b-4279-ab76-0a091a21fdde","Type":"ContainerDied","Data":"09c6fb44323ba37e1905cd98582506027eae291574ad14ef9b3d2ef056010034"}
Jul 09 22:15:57.331262 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:57.331258    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c4c4ccd4-hcrcc"
Jul 09 22:15:57.331751 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:57.331291    2554 scope.go:117] "RemoveContainer" containerID="4a1cd0f335deda6c16375c566350c087c171209df772c402863565c90a30c562"
Jul 09 22:15:57.350980 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:57.350951    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84c4c4ccd4-hcrcc"]
Jul 09 22:15:57.354801 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:57.354778    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84c4c4ccd4-hcrcc"]
Jul 09 22:15:57.884006 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:15:57.883975    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="578300c5-347b-4279-ab76-0a091a21fdde" path="/var/lib/kubelet/pods/578300c5-347b-4279-ab76-0a091a21fdde/volumes"
Jul 09 22:16:04.825932 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:04.825895    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:16:16.330526 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:16.330489    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:16:16.436266 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:16.436226    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:16:17.115603 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.115571    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7"]
Jul 09 22:16:17.115987 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.115968    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43750f79-5ce8-4bba-8169-518b765226d7" containerName="console"
Jul 09 22:16:17.116061 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.115993    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="43750f79-5ce8-4bba-8169-518b765226d7" containerName="console"
Jul 09 22:16:17.116061 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.116011    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="578300c5-347b-4279-ab76-0a091a21fdde" containerName="console"
Jul 09 22:16:17.116061 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.116020    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="578300c5-347b-4279-ab76-0a091a21fdde" containerName="console"
Jul 09 22:16:17.116153 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.116108    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="43750f79-5ce8-4bba-8169-518b765226d7" containerName="console"
Jul 09 22:16:17.116153 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.116120    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="578300c5-347b-4279-ab76-0a091a21fdde" containerName="console"
Jul 09 22:16:17.118976 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.118957    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7"
Jul 09 22:16:17.122372 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.122352    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k6lr8\""
Jul 09 22:16:17.123392 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.123374    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 22:16:17.126697 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.126680    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 22:16:17.138247 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.138223    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7"]
Jul 09 22:16:17.165162 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.165137    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxwjf\" (UniqueName: \"kubernetes.io/projected/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-kube-api-access-nxwjf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7\" (UID: \"868464a1-b16f-4c53-9d3d-4c2fc8b811d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7"
Jul 09 22:16:17.165271 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.165186    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7\" (UID: \"868464a1-b16f-4c53-9d3d-4c2fc8b811d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7"
Jul 09 22:16:17.165271 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.165208    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7\" (UID: \"868464a1-b16f-4c53-9d3d-4c2fc8b811d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7"
Jul 09 22:16:17.265798 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.265766    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7\" (UID: \"868464a1-b16f-4c53-9d3d-4c2fc8b811d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7"
Jul 09 22:16:17.265798 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.265799    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7\" (UID: \"868464a1-b16f-4c53-9d3d-4c2fc8b811d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7"
Jul 09 22:16:17.266016 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.265840    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxwjf\" (UniqueName: \"kubernetes.io/projected/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-kube-api-access-nxwjf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7\" (UID: \"868464a1-b16f-4c53-9d3d-4c2fc8b811d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7"
Jul 09 22:16:17.266219 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.266198    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7\" (UID: \"868464a1-b16f-4c53-9d3d-4c2fc8b811d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7"
Jul 09 22:16:17.266278 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.266254    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7\" (UID: \"868464a1-b16f-4c53-9d3d-4c2fc8b811d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7"
Jul 09 22:16:17.275166 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.275141    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxwjf\" (UniqueName: \"kubernetes.io/projected/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-kube-api-access-nxwjf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7\" (UID: \"868464a1-b16f-4c53-9d3d-4c2fc8b811d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7"
Jul 09 22:16:17.426840 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.426745    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7"
Jul 09 22:16:17.549294 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:17.549256    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7"]
Jul 09 22:16:17.552567 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:16:17.552532    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868464a1_b16f_4c53_9d3d_4c2fc8b811d6.slice/crio-7d5a0d0e4411e2da2c57c4c7763ef130a715ef34c6cb087c4199ba4e4dd5e2e3 WatchSource:0}: Error finding container 7d5a0d0e4411e2da2c57c4c7763ef130a715ef34c6cb087c4199ba4e4dd5e2e3: Status 404 returned error can't find the container with id 7d5a0d0e4411e2da2c57c4c7763ef130a715ef34c6cb087c4199ba4e4dd5e2e3
Jul 09 22:16:18.404490 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:18.404442    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7" event={"ID":"868464a1-b16f-4c53-9d3d-4c2fc8b811d6","Type":"ContainerStarted","Data":"7d5a0d0e4411e2da2c57c4c7763ef130a715ef34c6cb087c4199ba4e4dd5e2e3"}
Jul 09 22:16:26.431801 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:26.431768    2554 generic.go:356] "Generic (PLEG): container finished" podID="868464a1-b16f-4c53-9d3d-4c2fc8b811d6" containerID="55e7b8e3713b25089ffae787ff8fd2d85699ad7189ce01e03831966b7f3e5f0f" exitCode=0
Jul 09 22:16:26.432328 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:26.431808    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7" event={"ID":"868464a1-b16f-4c53-9d3d-4c2fc8b811d6","Type":"ContainerDied","Data":"55e7b8e3713b25089ffae787ff8fd2d85699ad7189ce01e03831966b7f3e5f0f"}
Jul 09 22:16:28.683340 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:16:28.683303    2554 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868464a1_b16f_4c53_9d3d_4c2fc8b811d6.slice/crio-conmon-8270bfc3541417d8ba536767dfa8ad1c547a1bc219a01367b70c47305395cdb3.scope\": RecentStats: unable to find data in memory cache]"
Jul 09 22:16:29.445314 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:29.445279    2554 generic.go:356] "Generic (PLEG): container finished" podID="868464a1-b16f-4c53-9d3d-4c2fc8b811d6" containerID="8270bfc3541417d8ba536767dfa8ad1c547a1bc219a01367b70c47305395cdb3" exitCode=0
Jul 09 22:16:29.445515 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:29.445364    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7" event={"ID":"868464a1-b16f-4c53-9d3d-4c2fc8b811d6","Type":"ContainerDied","Data":"8270bfc3541417d8ba536767dfa8ad1c547a1bc219a01367b70c47305395cdb3"}
Jul 09 22:16:39.482025 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:39.481946    2554 generic.go:356] "Generic (PLEG): container finished" podID="868464a1-b16f-4c53-9d3d-4c2fc8b811d6" containerID="c3813f073439a7ebc0817d25e9a1d700c59545a47c6c4d247989deaae630d904" exitCode=0
Jul 09 22:16:39.482392 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:39.482052    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7" event={"ID":"868464a1-b16f-4c53-9d3d-4c2fc8b811d6","Type":"ContainerDied","Data":"c3813f073439a7ebc0817d25e9a1d700c59545a47c6c4d247989deaae630d904"}
Jul 09 22:16:40.627618 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:40.627586    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7"
Jul 09 22:16:40.726738 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:40.726702    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxwjf\" (UniqueName: \"kubernetes.io/projected/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-kube-api-access-nxwjf\") pod \"868464a1-b16f-4c53-9d3d-4c2fc8b811d6\" (UID: \"868464a1-b16f-4c53-9d3d-4c2fc8b811d6\") "
Jul 09 22:16:40.726917 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:40.726756    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-bundle\") pod \"868464a1-b16f-4c53-9d3d-4c2fc8b811d6\" (UID: \"868464a1-b16f-4c53-9d3d-4c2fc8b811d6\") "
Jul 09 22:16:40.726917 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:40.726786    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-util\") pod \"868464a1-b16f-4c53-9d3d-4c2fc8b811d6\" (UID: \"868464a1-b16f-4c53-9d3d-4c2fc8b811d6\") "
Jul 09 22:16:40.727489 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:40.727467    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-bundle" (OuterVolumeSpecName: "bundle") pod "868464a1-b16f-4c53-9d3d-4c2fc8b811d6" (UID: "868464a1-b16f-4c53-9d3d-4c2fc8b811d6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:16:40.728904 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:40.728887    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-kube-api-access-nxwjf" (OuterVolumeSpecName: "kube-api-access-nxwjf") pod "868464a1-b16f-4c53-9d3d-4c2fc8b811d6" (UID: "868464a1-b16f-4c53-9d3d-4c2fc8b811d6"). InnerVolumeSpecName "kube-api-access-nxwjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:16:40.732646 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:40.732621    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-util" (OuterVolumeSpecName: "util") pod "868464a1-b16f-4c53-9d3d-4c2fc8b811d6" (UID: "868464a1-b16f-4c53-9d3d-4c2fc8b811d6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:16:40.827509 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:40.827420    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxwjf\" (UniqueName: \"kubernetes.io/projected/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-kube-api-access-nxwjf\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:16:40.827509 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:40.827451    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-bundle\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:16:40.827509 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:40.827460    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/868464a1-b16f-4c53-9d3d-4c2fc8b811d6-util\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:16:41.491744 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:41.491705    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7" event={"ID":"868464a1-b16f-4c53-9d3d-4c2fc8b811d6","Type":"ContainerDied","Data":"7d5a0d0e4411e2da2c57c4c7763ef130a715ef34c6cb087c4199ba4e4dd5e2e3"}
Jul 09 22:16:41.491744 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:41.491740    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jclv7"
Jul 09 22:16:41.491948 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:41.491756    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d5a0d0e4411e2da2c57c4c7763ef130a715ef34c6cb087c4199ba4e4dd5e2e3"
Jul 09 22:16:43.183748 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:43.183715    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:16:44.092326 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:44.092297    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:16:45.122223 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.122194    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l466b"]
Jul 09 22:16:45.122660 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.122463    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="868464a1-b16f-4c53-9d3d-4c2fc8b811d6" containerName="util"
Jul 09 22:16:45.122660 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.122476    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="868464a1-b16f-4c53-9d3d-4c2fc8b811d6" containerName="util"
Jul 09 22:16:45.122660 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.122487    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="868464a1-b16f-4c53-9d3d-4c2fc8b811d6" containerName="pull"
Jul 09 22:16:45.122660 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.122493    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="868464a1-b16f-4c53-9d3d-4c2fc8b811d6" containerName="pull"
Jul 09 22:16:45.122660 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.122506    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="868464a1-b16f-4c53-9d3d-4c2fc8b811d6" containerName="extract"
Jul 09 22:16:45.122660 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.122512    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="868464a1-b16f-4c53-9d3d-4c2fc8b811d6" containerName="extract"
Jul 09 22:16:45.122660 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.122559    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="868464a1-b16f-4c53-9d3d-4c2fc8b811d6" containerName="extract"
Jul 09 22:16:45.124346 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.124330    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l466b"
Jul 09 22:16:45.128782 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.128756    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:16:45.128984 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.128970    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 09 22:16:45.129165 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.129149    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6b9wp\""
Jul 09 22:16:45.142239 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.142217    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l466b"]
Jul 09 22:16:45.157996 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.157975    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7705cbd-4912-4a7c-9e24-2420db193d4e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-l466b\" (UID: \"d7705cbd-4912-4a7c-9e24-2420db193d4e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l466b"
Jul 09 22:16:45.158102 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.158022    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtn4r\" (UniqueName: \"kubernetes.io/projected/d7705cbd-4912-4a7c-9e24-2420db193d4e-kube-api-access-dtn4r\") pod \"cert-manager-operator-controller-manager-55c444bf86-l466b\" (UID: \"d7705cbd-4912-4a7c-9e24-2420db193d4e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l466b"
Jul 09 22:16:45.258868 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.258831    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7705cbd-4912-4a7c-9e24-2420db193d4e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-l466b\" (UID: \"d7705cbd-4912-4a7c-9e24-2420db193d4e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l466b"
Jul 09 22:16:45.259062 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.258893    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtn4r\" (UniqueName: \"kubernetes.io/projected/d7705cbd-4912-4a7c-9e24-2420db193d4e-kube-api-access-dtn4r\") pod \"cert-manager-operator-controller-manager-55c444bf86-l466b\" (UID: \"d7705cbd-4912-4a7c-9e24-2420db193d4e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l466b"
Jul 09 22:16:45.259304 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.259286    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7705cbd-4912-4a7c-9e24-2420db193d4e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-l466b\" (UID: \"d7705cbd-4912-4a7c-9e24-2420db193d4e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l466b"
Jul 09 22:16:45.267995 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.267968    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtn4r\" (UniqueName: \"kubernetes.io/projected/d7705cbd-4912-4a7c-9e24-2420db193d4e-kube-api-access-dtn4r\") pod \"cert-manager-operator-controller-manager-55c444bf86-l466b\" (UID: \"d7705cbd-4912-4a7c-9e24-2420db193d4e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l466b"
Jul 09 22:16:45.432518 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.432437    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l466b"
Jul 09 22:16:45.562763 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:45.562734    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l466b"]
Jul 09 22:16:45.566444 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:16:45.566417    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7705cbd_4912_4a7c_9e24_2420db193d4e.slice/crio-07a081882d30925cb1ad182e7886f52a9be1b39ce3819ea2744f1b885da3a25a WatchSource:0}: Error finding container 07a081882d30925cb1ad182e7886f52a9be1b39ce3819ea2744f1b885da3a25a: Status 404 returned error can't find the container with id 07a081882d30925cb1ad182e7886f52a9be1b39ce3819ea2744f1b885da3a25a
Jul 09 22:16:46.511231 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:46.511196    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l466b" event={"ID":"d7705cbd-4912-4a7c-9e24-2420db193d4e","Type":"ContainerStarted","Data":"07a081882d30925cb1ad182e7886f52a9be1b39ce3819ea2744f1b885da3a25a"}
Jul 09 22:16:46.971898 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:46.971843    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:16:47.035275 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:47.035236    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:16:47.516766 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:47.516675    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l466b" event={"ID":"d7705cbd-4912-4a7c-9e24-2420db193d4e","Type":"ContainerStarted","Data":"7628a44e9387e8209a1efd004fd0866067f04ed1b869bae51ec3f7bd270c4156"}
Jul 09 22:16:47.538800 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:47.538757    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l466b" podStartSLOduration=0.887288014 podStartE2EDuration="2.538739824s" totalImagesPullingTime="1.65145181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:16:47.537813989 +0000 UTC m=+470.211812791" watchObservedRunningTime="2026-07-09 22:16:47.538739824 +0000 UTC m=+470.212738626"
Jul 09 22:16:48.070985 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.070942    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:16:48.203935 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.203906    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:16:48.805489 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.805453    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69"]
Jul 09 22:16:48.807488 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.807471    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69"
Jul 09 22:16:48.810774 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.810752    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 22:16:48.815469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.814874    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k6lr8\""
Jul 09 22:16:48.815469 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.815237    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 22:16:48.820665 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.820641    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69"]
Jul 09 22:16:48.864825 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.864795    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:16:48.889414 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.889389    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b226deba-f035-4c50-8f4f-4611d2e8c562-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69\" (UID: \"b226deba-f035-4c50-8f4f-4611d2e8c562\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69"
Jul 09 22:16:48.889539 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.889433    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgsvd\" (UniqueName: \"kubernetes.io/projected/b226deba-f035-4c50-8f4f-4611d2e8c562-kube-api-access-bgsvd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69\" (UID: \"b226deba-f035-4c50-8f4f-4611d2e8c562\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69"
Jul 09 22:16:48.889539 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.889464    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b226deba-f035-4c50-8f4f-4611d2e8c562-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69\" (UID: \"b226deba-f035-4c50-8f4f-4611d2e8c562\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69"
Jul 09 22:16:48.973836 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.973787    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:16:48.990513 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.990487    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b226deba-f035-4c50-8f4f-4611d2e8c562-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69\" (UID: \"b226deba-f035-4c50-8f4f-4611d2e8c562\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69"
Jul 09 22:16:48.990673 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.990526    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgsvd\" (UniqueName: \"kubernetes.io/projected/b226deba-f035-4c50-8f4f-4611d2e8c562-kube-api-access-bgsvd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69\" (UID: \"b226deba-f035-4c50-8f4f-4611d2e8c562\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69"
Jul 09 22:16:48.990673 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.990549    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b226deba-f035-4c50-8f4f-4611d2e8c562-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69\" (UID: \"b226deba-f035-4c50-8f4f-4611d2e8c562\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69"
Jul 09 22:16:48.990939 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.990920    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b226deba-f035-4c50-8f4f-4611d2e8c562-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69\" (UID: \"b226deba-f035-4c50-8f4f-4611d2e8c562\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69"
Jul 09 22:16:48.991004 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.990955    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b226deba-f035-4c50-8f4f-4611d2e8c562-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69\" (UID: \"b226deba-f035-4c50-8f4f-4611d2e8c562\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69"
Jul 09 22:16:48.999429 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:48.999405    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgsvd\" (UniqueName: \"kubernetes.io/projected/b226deba-f035-4c50-8f4f-4611d2e8c562-kube-api-access-bgsvd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69\" (UID: \"b226deba-f035-4c50-8f4f-4611d2e8c562\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69"
Jul 09 22:16:49.121996 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:49.121958    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69"
Jul 09 22:16:49.249069 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:49.249023    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69"]
Jul 09 22:16:49.252012 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:16:49.251981    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb226deba_f035_4c50_8f4f_4611d2e8c562.slice/crio-61e062c8c4a4b20847ba1d6fb037e2024016f50c1e6d1abb2eabc13073c57319 WatchSource:0}: Error finding container 61e062c8c4a4b20847ba1d6fb037e2024016f50c1e6d1abb2eabc13073c57319: Status 404 returned error can't find the container with id 61e062c8c4a4b20847ba1d6fb037e2024016f50c1e6d1abb2eabc13073c57319
Jul 09 22:16:49.525101 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:49.524981    2554 generic.go:356] "Generic (PLEG): container finished" podID="b226deba-f035-4c50-8f4f-4611d2e8c562" containerID="e2b9e18304762aab1e68ba227d9e86530750bc6539eaae47868692b9365fce54" exitCode=0
Jul 09 22:16:49.525101 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:49.525078    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69" event={"ID":"b226deba-f035-4c50-8f4f-4611d2e8c562","Type":"ContainerDied","Data":"e2b9e18304762aab1e68ba227d9e86530750bc6539eaae47868692b9365fce54"}
Jul 09 22:16:49.525318 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:49.525132    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69" event={"ID":"b226deba-f035-4c50-8f4f-4611d2e8c562","Type":"ContainerStarted","Data":"61e062c8c4a4b20847ba1d6fb037e2024016f50c1e6d1abb2eabc13073c57319"}
Jul 09 22:16:50.885650 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:50.885607    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:16:51.271503 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:51.271433    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:16:52.537758 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:52.537722    2554 generic.go:356] "Generic (PLEG): container finished" podID="b226deba-f035-4c50-8f4f-4611d2e8c562" containerID="a737bd2fd6e406860dc48db74a415d919542ba947350c0d1d83bf64527e692f3" exitCode=0
Jul 09 22:16:52.538223 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:52.537805    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69" event={"ID":"b226deba-f035-4c50-8f4f-4611d2e8c562","Type":"ContainerDied","Data":"a737bd2fd6e406860dc48db74a415d919542ba947350c0d1d83bf64527e692f3"}
Jul 09 22:16:53.543556 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:53.543523    2554 generic.go:356] "Generic (PLEG): container finished" podID="b226deba-f035-4c50-8f4f-4611d2e8c562" containerID="8b21d98266fe0ab2f367876ffd3377686d0f835170d9795f0ce62ace144aa39d" exitCode=0
Jul 09 22:16:53.543919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:53.543578    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69" event={"ID":"b226deba-f035-4c50-8f4f-4611d2e8c562","Type":"ContainerDied","Data":"8b21d98266fe0ab2f367876ffd3377686d0f835170d9795f0ce62ace144aa39d"}
Jul 09 22:16:53.579746 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:53.579716    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:16:53.636953 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:53.636926    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:16:54.668413 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:54.668389    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69"
Jul 09 22:16:54.738451 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:54.738422    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b226deba-f035-4c50-8f4f-4611d2e8c562-util\") pod \"b226deba-f035-4c50-8f4f-4611d2e8c562\" (UID: \"b226deba-f035-4c50-8f4f-4611d2e8c562\") "
Jul 09 22:16:54.738608 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:54.738463    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b226deba-f035-4c50-8f4f-4611d2e8c562-bundle\") pod \"b226deba-f035-4c50-8f4f-4611d2e8c562\" (UID: \"b226deba-f035-4c50-8f4f-4611d2e8c562\") "
Jul 09 22:16:54.738608 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:54.738489    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgsvd\" (UniqueName: \"kubernetes.io/projected/b226deba-f035-4c50-8f4f-4611d2e8c562-kube-api-access-bgsvd\") pod \"b226deba-f035-4c50-8f4f-4611d2e8c562\" (UID: \"b226deba-f035-4c50-8f4f-4611d2e8c562\") "
Jul 09 22:16:54.738829 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:54.738807    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b226deba-f035-4c50-8f4f-4611d2e8c562-bundle" (OuterVolumeSpecName: "bundle") pod "b226deba-f035-4c50-8f4f-4611d2e8c562" (UID: "b226deba-f035-4c50-8f4f-4611d2e8c562"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:16:54.740759 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:54.740735    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b226deba-f035-4c50-8f4f-4611d2e8c562-kube-api-access-bgsvd" (OuterVolumeSpecName: "kube-api-access-bgsvd") pod "b226deba-f035-4c50-8f4f-4611d2e8c562" (UID: "b226deba-f035-4c50-8f4f-4611d2e8c562"). InnerVolumeSpecName "kube-api-access-bgsvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:16:54.764578 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:54.764545    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b226deba-f035-4c50-8f4f-4611d2e8c562-util" (OuterVolumeSpecName: "util") pod "b226deba-f035-4c50-8f4f-4611d2e8c562" (UID: "b226deba-f035-4c50-8f4f-4611d2e8c562"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:16:54.839257 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:54.839182    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b226deba-f035-4c50-8f4f-4611d2e8c562-util\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:16:54.839257 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:54.839209    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b226deba-f035-4c50-8f4f-4611d2e8c562-bundle\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:16:54.839257 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:54.839221    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgsvd\" (UniqueName: \"kubernetes.io/projected/b226deba-f035-4c50-8f4f-4611d2e8c562-kube-api-access-bgsvd\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:16:55.551404 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:55.551363    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69" event={"ID":"b226deba-f035-4c50-8f4f-4611d2e8c562","Type":"ContainerDied","Data":"61e062c8c4a4b20847ba1d6fb037e2024016f50c1e6d1abb2eabc13073c57319"}
Jul 09 22:16:55.551404 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:55.551389    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fc2b69"
Jul 09 22:16:55.551604 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:55.551435    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61e062c8c4a4b20847ba1d6fb037e2024016f50c1e6d1abb2eabc13073c57319"
Jul 09 22:16:57.916354 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:57.916320    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:16:58.014293 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:58.014264    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:16:59.477936 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:16:59.477905    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:00.286942 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.286910    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f4cs8"]
Jul 09 22:17:00.287170 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.287157    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b226deba-f035-4c50-8f4f-4611d2e8c562" containerName="pull"
Jul 09 22:17:00.287216 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.287172    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b226deba-f035-4c50-8f4f-4611d2e8c562" containerName="pull"
Jul 09 22:17:00.287216 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.287181    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b226deba-f035-4c50-8f4f-4611d2e8c562" containerName="extract"
Jul 09 22:17:00.287216 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.287187    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b226deba-f035-4c50-8f4f-4611d2e8c562" containerName="extract"
Jul 09 22:17:00.287216 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.287195    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b226deba-f035-4c50-8f4f-4611d2e8c562" containerName="util"
Jul 09 22:17:00.287216 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.287200    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b226deba-f035-4c50-8f4f-4611d2e8c562" containerName="util"
Jul 09 22:17:00.287359 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.287241    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b226deba-f035-4c50-8f4f-4611d2e8c562" containerName="extract"
Jul 09 22:17:00.290879 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.290863    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-f4cs8"
Jul 09 22:17:00.295694 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.295670    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 22:17:00.295790 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.295706    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 22:17:00.296489 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.296468    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8m82s\""
Jul 09 22:17:00.299836 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.299814    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f4cs8"]
Jul 09 22:17:00.382002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.381964    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65b68a22-fe6a-4bd2-8f13-f34f1e7a0024-bound-sa-token\") pod \"cert-manager-55b4d954d5-f4cs8\" (UID: \"65b68a22-fe6a-4bd2-8f13-f34f1e7a0024\") " pod="cert-manager/cert-manager-55b4d954d5-f4cs8"
Jul 09 22:17:00.382179 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.382009    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvk28\" (UniqueName: \"kubernetes.io/projected/65b68a22-fe6a-4bd2-8f13-f34f1e7a0024-kube-api-access-cvk28\") pod \"cert-manager-55b4d954d5-f4cs8\" (UID: \"65b68a22-fe6a-4bd2-8f13-f34f1e7a0024\") " pod="cert-manager/cert-manager-55b4d954d5-f4cs8"
Jul 09 22:17:00.482868 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.482832    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65b68a22-fe6a-4bd2-8f13-f34f1e7a0024-bound-sa-token\") pod \"cert-manager-55b4d954d5-f4cs8\" (UID: \"65b68a22-fe6a-4bd2-8f13-f34f1e7a0024\") " pod="cert-manager/cert-manager-55b4d954d5-f4cs8"
Jul 09 22:17:00.482868 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.482873    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvk28\" (UniqueName: \"kubernetes.io/projected/65b68a22-fe6a-4bd2-8f13-f34f1e7a0024-kube-api-access-cvk28\") pod \"cert-manager-55b4d954d5-f4cs8\" (UID: \"65b68a22-fe6a-4bd2-8f13-f34f1e7a0024\") " pod="cert-manager/cert-manager-55b4d954d5-f4cs8"
Jul 09 22:17:00.491356 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.491329    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65b68a22-fe6a-4bd2-8f13-f34f1e7a0024-bound-sa-token\") pod \"cert-manager-55b4d954d5-f4cs8\" (UID: \"65b68a22-fe6a-4bd2-8f13-f34f1e7a0024\") " pod="cert-manager/cert-manager-55b4d954d5-f4cs8"
Jul 09 22:17:00.491491 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.491436    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvk28\" (UniqueName: \"kubernetes.io/projected/65b68a22-fe6a-4bd2-8f13-f34f1e7a0024-kube-api-access-cvk28\") pod \"cert-manager-55b4d954d5-f4cs8\" (UID: \"65b68a22-fe6a-4bd2-8f13-f34f1e7a0024\") " pod="cert-manager/cert-manager-55b4d954d5-f4cs8"
Jul 09 22:17:00.605380 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.605354    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-f4cs8"
Jul 09 22:17:00.733674 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:17:00.733650    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65b68a22_fe6a_4bd2_8f13_f34f1e7a0024.slice/crio-04da67574153ed5837ef17e7824c4133accdbf88b4b2d5f964c2e01478069e61 WatchSource:0}: Error finding container 04da67574153ed5837ef17e7824c4133accdbf88b4b2d5f964c2e01478069e61: Status 404 returned error can't find the container with id 04da67574153ed5837ef17e7824c4133accdbf88b4b2d5f964c2e01478069e61
Jul 09 22:17:00.736969 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.736947    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f4cs8"]
Jul 09 22:17:00.742577 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.742556    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:00.800368 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:00.800340    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:01.576348 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:01.576309    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-f4cs8" event={"ID":"65b68a22-fe6a-4bd2-8f13-f34f1e7a0024","Type":"ContainerStarted","Data":"04da67574153ed5837ef17e7824c4133accdbf88b4b2d5f964c2e01478069e61"}
Jul 09 22:17:03.585777 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:03.585695    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-f4cs8" event={"ID":"65b68a22-fe6a-4bd2-8f13-f34f1e7a0024","Type":"ContainerStarted","Data":"312bd77713a968c83053cae980866d264546e71abe87fca4a355ffb35ff814a0"}
Jul 09 22:17:03.603377 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:03.603327    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-f4cs8" podStartSLOduration=1.156988494 podStartE2EDuration="3.603312922s" totalImagesPullingTime="2.446324428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:17:03.602263145 +0000 UTC m=+486.276261973" watchObservedRunningTime="2026-07-09 22:17:03.603312922 +0000 UTC m=+486.277311723"
Jul 09 22:17:07.234506 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:07.234466    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:07.334023 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:07.333990    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:08.685364 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:08.685331    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s"]
Jul 09 22:17:08.703700 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:08.703672    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s"]
Jul 09 22:17:08.703884 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:08.703801    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s"
Jul 09 22:17:08.706641 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:08.706615    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 22:17:08.706765 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:08.706628    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 22:17:08.707428 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:08.707408    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k6lr8\""
Jul 09 22:17:08.844047 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:08.844003    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8csm\" (UniqueName: \"kubernetes.io/projected/6bcba9df-e1d3-462c-882c-6fc169a267c2-kube-api-access-f8csm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s\" (UID: \"6bcba9df-e1d3-462c-882c-6fc169a267c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s"
Jul 09 22:17:08.844204 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:08.844054    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bcba9df-e1d3-462c-882c-6fc169a267c2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s\" (UID: \"6bcba9df-e1d3-462c-882c-6fc169a267c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s"
Jul 09 22:17:08.844204 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:08.844105    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bcba9df-e1d3-462c-882c-6fc169a267c2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s\" (UID: \"6bcba9df-e1d3-462c-882c-6fc169a267c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s"
Jul 09 22:17:08.945013 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:08.944927    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8csm\" (UniqueName: \"kubernetes.io/projected/6bcba9df-e1d3-462c-882c-6fc169a267c2-kube-api-access-f8csm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s\" (UID: \"6bcba9df-e1d3-462c-882c-6fc169a267c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s"
Jul 09 22:17:08.945013 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:08.944967    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bcba9df-e1d3-462c-882c-6fc169a267c2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s\" (UID: \"6bcba9df-e1d3-462c-882c-6fc169a267c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s"
Jul 09 22:17:08.945013 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:08.944992    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bcba9df-e1d3-462c-882c-6fc169a267c2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s\" (UID: \"6bcba9df-e1d3-462c-882c-6fc169a267c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s"
Jul 09 22:17:08.945365 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:08.945346    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bcba9df-e1d3-462c-882c-6fc169a267c2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s\" (UID: \"6bcba9df-e1d3-462c-882c-6fc169a267c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s"
Jul 09 22:17:08.945407 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:08.945364    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bcba9df-e1d3-462c-882c-6fc169a267c2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s\" (UID: \"6bcba9df-e1d3-462c-882c-6fc169a267c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s"
Jul 09 22:17:08.953757 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:08.953730    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8csm\" (UniqueName: \"kubernetes.io/projected/6bcba9df-e1d3-462c-882c-6fc169a267c2-kube-api-access-f8csm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s\" (UID: \"6bcba9df-e1d3-462c-882c-6fc169a267c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s"
Jul 09 22:17:09.012738 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:09.012702    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s"
Jul 09 22:17:09.161255 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:09.161232    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s"]
Jul 09 22:17:09.163804 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:17:09.163777    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bcba9df_e1d3_462c_882c_6fc169a267c2.slice/crio-e929870fb60826fafa4d92d949c402d0843b9fa3fc78112f4fefddb392cc54e4 WatchSource:0}: Error finding container e929870fb60826fafa4d92d949c402d0843b9fa3fc78112f4fefddb392cc54e4: Status 404 returned error can't find the container with id e929870fb60826fafa4d92d949c402d0843b9fa3fc78112f4fefddb392cc54e4
Jul 09 22:17:09.174955 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:09.174926    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:09.609342 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:09.609308    2554 generic.go:356] "Generic (PLEG): container finished" podID="6bcba9df-e1d3-462c-882c-6fc169a267c2" containerID="cd27ef38bf8d4977af0696b8eb8c24109e4fbd73b587aba174625b5f970318d7" exitCode=0
Jul 09 22:17:09.609536 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:09.609394    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s" event={"ID":"6bcba9df-e1d3-462c-882c-6fc169a267c2","Type":"ContainerDied","Data":"cd27ef38bf8d4977af0696b8eb8c24109e4fbd73b587aba174625b5f970318d7"}
Jul 09 22:17:09.609536 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:09.609446    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s" event={"ID":"6bcba9df-e1d3-462c-882c-6fc169a267c2","Type":"ContainerStarted","Data":"e929870fb60826fafa4d92d949c402d0843b9fa3fc78112f4fefddb392cc54e4"}
Jul 09 22:17:10.615757 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:10.615724    2554 generic.go:356] "Generic (PLEG): container finished" podID="6bcba9df-e1d3-462c-882c-6fc169a267c2" containerID="808285fc4266440ed2518bb0534ee1b442ffcd67347a522d511a85b98e4ed33a" exitCode=0
Jul 09 22:17:10.616156 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:10.615771    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s" event={"ID":"6bcba9df-e1d3-462c-882c-6fc169a267c2","Type":"ContainerDied","Data":"808285fc4266440ed2518bb0534ee1b442ffcd67347a522d511a85b98e4ed33a"}
Jul 09 22:17:11.621498 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:11.621461    2554 generic.go:356] "Generic (PLEG): container finished" podID="6bcba9df-e1d3-462c-882c-6fc169a267c2" containerID="3e9ea413d3ebfae1ebc13566bff101831d8f3839e52221c465a34b1cc460c740" exitCode=0
Jul 09 22:17:11.621869 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:11.621545    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s" event={"ID":"6bcba9df-e1d3-462c-882c-6fc169a267c2","Type":"ContainerDied","Data":"3e9ea413d3ebfae1ebc13566bff101831d8f3839e52221c465a34b1cc460c740"}
Jul 09 22:17:12.757714 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:12.757690    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s"
Jul 09 22:17:12.878309 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:12.878209    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bcba9df-e1d3-462c-882c-6fc169a267c2-bundle\") pod \"6bcba9df-e1d3-462c-882c-6fc169a267c2\" (UID: \"6bcba9df-e1d3-462c-882c-6fc169a267c2\") "
Jul 09 22:17:12.878309 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:12.878255    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bcba9df-e1d3-462c-882c-6fc169a267c2-util\") pod \"6bcba9df-e1d3-462c-882c-6fc169a267c2\" (UID: \"6bcba9df-e1d3-462c-882c-6fc169a267c2\") "
Jul 09 22:17:12.878309 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:12.878317    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8csm\" (UniqueName: \"kubernetes.io/projected/6bcba9df-e1d3-462c-882c-6fc169a267c2-kube-api-access-f8csm\") pod \"6bcba9df-e1d3-462c-882c-6fc169a267c2\" (UID: \"6bcba9df-e1d3-462c-882c-6fc169a267c2\") "
Jul 09 22:17:12.878964 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:12.878935    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bcba9df-e1d3-462c-882c-6fc169a267c2-bundle" (OuterVolumeSpecName: "bundle") pod "6bcba9df-e1d3-462c-882c-6fc169a267c2" (UID: "6bcba9df-e1d3-462c-882c-6fc169a267c2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:17:12.880315 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:12.880293    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bcba9df-e1d3-462c-882c-6fc169a267c2-kube-api-access-f8csm" (OuterVolumeSpecName: "kube-api-access-f8csm") pod "6bcba9df-e1d3-462c-882c-6fc169a267c2" (UID: "6bcba9df-e1d3-462c-882c-6fc169a267c2"). InnerVolumeSpecName "kube-api-access-f8csm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:17:12.884134 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:12.883984    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bcba9df-e1d3-462c-882c-6fc169a267c2-util" (OuterVolumeSpecName: "util") pod "6bcba9df-e1d3-462c-882c-6fc169a267c2" (UID: "6bcba9df-e1d3-462c-882c-6fc169a267c2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:17:12.979330 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:12.979287    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8csm\" (UniqueName: \"kubernetes.io/projected/6bcba9df-e1d3-462c-882c-6fc169a267c2-kube-api-access-f8csm\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:17:12.979330 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:12.979321    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bcba9df-e1d3-462c-882c-6fc169a267c2-bundle\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:17:12.979330 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:12.979331    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bcba9df-e1d3-462c-882c-6fc169a267c2-util\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:17:13.630793 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:13.630759    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s" event={"ID":"6bcba9df-e1d3-462c-882c-6fc169a267c2","Type":"ContainerDied","Data":"e929870fb60826fafa4d92d949c402d0843b9fa3fc78112f4fefddb392cc54e4"}
Jul 09 22:17:13.630953 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:13.630798    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afndv2s"
Jul 09 22:17:13.630953 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:13.630832    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e929870fb60826fafa4d92d949c402d0843b9fa3fc78112f4fefddb392cc54e4"
Jul 09 22:17:21.281298 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:21.281264    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:21.422999 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:21.422965    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:21.904106 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:21.904072    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:22.548540 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.548509    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:22.693112 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.693081    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:22.704017 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.703991    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"]
Jul 09 22:17:22.704247 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.704221    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bcba9df-e1d3-462c-882c-6fc169a267c2" containerName="util"
Jul 09 22:17:22.704287 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.704249    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bcba9df-e1d3-462c-882c-6fc169a267c2" containerName="util"
Jul 09 22:17:22.704287 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.704271    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bcba9df-e1d3-462c-882c-6fc169a267c2" containerName="pull"
Jul 09 22:17:22.704287 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.704276    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bcba9df-e1d3-462c-882c-6fc169a267c2" containerName="pull"
Jul 09 22:17:22.704287 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.704286    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bcba9df-e1d3-462c-882c-6fc169a267c2" containerName="extract"
Jul 09 22:17:22.704407 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.704291    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bcba9df-e1d3-462c-882c-6fc169a267c2" containerName="extract"
Jul 09 22:17:22.704407 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.704333    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bcba9df-e1d3-462c-882c-6fc169a267c2" containerName="extract"
Jul 09 22:17:22.708006 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.707990    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:22.713348 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.713327    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 22:17:22.713449 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.713329    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 22:17:22.713722 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.713703    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 22:17:22.713829 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.713720    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 22:17:22.713829 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.713726    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kj66l\""
Jul 09 22:17:22.744306 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.744278    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"]
Jul 09 22:17:22.850933 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.850905    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bftd7\" (UniqueName: \"kubernetes.io/projected/4b203897-4c48-4966-b419-602f358b46c5-kube-api-access-bftd7\") pod \"opendatahub-operator-controller-manager-5b79867d65-jt9rr\" (UID: \"4b203897-4c48-4966-b419-602f358b46c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:22.851104 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.850949    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b203897-4c48-4966-b419-602f358b46c5-manifests\") pod \"opendatahub-operator-controller-manager-5b79867d65-jt9rr\" (UID: \"4b203897-4c48-4966-b419-602f358b46c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:22.851104 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.850968    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b203897-4c48-4966-b419-602f358b46c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b79867d65-jt9rr\" (UID: \"4b203897-4c48-4966-b419-602f358b46c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:22.851104 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.851013    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b203897-4c48-4966-b419-602f358b46c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b79867d65-jt9rr\" (UID: \"4b203897-4c48-4966-b419-602f358b46c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:22.851104 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.851080    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b203897-4c48-4966-b419-602f358b46c5-tmp\") pod \"opendatahub-operator-controller-manager-5b79867d65-jt9rr\" (UID: \"4b203897-4c48-4966-b419-602f358b46c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:22.951973 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.951932    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b203897-4c48-4966-b419-602f358b46c5-manifests\") pod \"opendatahub-operator-controller-manager-5b79867d65-jt9rr\" (UID: \"4b203897-4c48-4966-b419-602f358b46c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:22.951973 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.951976    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b203897-4c48-4966-b419-602f358b46c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b79867d65-jt9rr\" (UID: \"4b203897-4c48-4966-b419-602f358b46c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:22.952234 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.952003    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b203897-4c48-4966-b419-602f358b46c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b79867d65-jt9rr\" (UID: \"4b203897-4c48-4966-b419-602f358b46c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:22.952234 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.952063    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b203897-4c48-4966-b419-602f358b46c5-tmp\") pod \"opendatahub-operator-controller-manager-5b79867d65-jt9rr\" (UID: \"4b203897-4c48-4966-b419-602f358b46c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:22.952234 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.952111    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bftd7\" (UniqueName: \"kubernetes.io/projected/4b203897-4c48-4966-b419-602f358b46c5-kube-api-access-bftd7\") pod \"opendatahub-operator-controller-manager-5b79867d65-jt9rr\" (UID: \"4b203897-4c48-4966-b419-602f358b46c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:22.952375 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.952351    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b203897-4c48-4966-b419-602f358b46c5-manifests\") pod \"opendatahub-operator-controller-manager-5b79867d65-jt9rr\" (UID: \"4b203897-4c48-4966-b419-602f358b46c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:22.954423 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.954391    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b203897-4c48-4966-b419-602f358b46c5-tmp\") pod \"opendatahub-operator-controller-manager-5b79867d65-jt9rr\" (UID: \"4b203897-4c48-4966-b419-602f358b46c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:22.954597 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.954574    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b203897-4c48-4966-b419-602f358b46c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b79867d65-jt9rr\" (UID: \"4b203897-4c48-4966-b419-602f358b46c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:22.954657 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.954643    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b203897-4c48-4966-b419-602f358b46c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b79867d65-jt9rr\" (UID: \"4b203897-4c48-4966-b419-602f358b46c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:22.963207 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.963179    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bftd7\" (UniqueName: \"kubernetes.io/projected/4b203897-4c48-4966-b419-602f358b46c5-kube-api-access-bftd7\") pod \"opendatahub-operator-controller-manager-5b79867d65-jt9rr\" (UID: \"4b203897-4c48-4966-b419-602f358b46c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:22.965557 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:22.965527    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:23.017787 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:23.017748    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:23.067179 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:23.066536    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:23.168426 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:23.168403    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"]
Jul 09 22:17:23.170765 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:17:23.170739    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b203897_4c48_4966_b419_602f358b46c5.slice/crio-f52f52919d3b8b6513031e3668734b9c53a93904e9459cb8f984ad76574b84b3 WatchSource:0}: Error finding container f52f52919d3b8b6513031e3668734b9c53a93904e9459cb8f984ad76574b84b3: Status 404 returned error can't find the container with id f52f52919d3b8b6513031e3668734b9c53a93904e9459cb8f984ad76574b84b3
Jul 09 22:17:23.187461 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:23.187438    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:23.435260 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:23.435171    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:23.594628 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:23.594595    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:23.671392 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:23.671362    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr" event={"ID":"4b203897-4c48-4966-b419-602f358b46c5","Type":"ContainerStarted","Data":"f52f52919d3b8b6513031e3668734b9c53a93904e9459cb8f984ad76574b84b3"}
Jul 09 22:17:26.685323 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:26.685282    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr" event={"ID":"4b203897-4c48-4966-b419-602f358b46c5","Type":"ContainerStarted","Data":"b4b766abc13cbd305b2e1c6d8d1ce97c90c7bf61819ea7ee973185c69dca312a"}
Jul 09 22:17:27.691153 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:27.691067    2554 generic.go:356] "Generic (PLEG): container finished" podID="4b203897-4c48-4966-b419-602f358b46c5" containerID="b4b766abc13cbd305b2e1c6d8d1ce97c90c7bf61819ea7ee973185c69dca312a" exitCode=0
Jul 09 22:17:27.691153 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:27.691105    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr" event={"ID":"4b203897-4c48-4966-b419-602f358b46c5","Type":"ContainerDied","Data":"b4b766abc13cbd305b2e1c6d8d1ce97c90c7bf61819ea7ee973185c69dca312a"}
Jul 09 22:17:28.697938 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:28.697900    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr" event={"ID":"4b203897-4c48-4966-b419-602f358b46c5","Type":"ContainerStarted","Data":"198a603a4050c56473181e276e2bfe0f0d27d1d5fd2335a42834244bffc0bc14"}
Jul 09 22:17:28.698360 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:28.697986    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:28.774612 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:28.774561    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr" podStartSLOduration=2.373856457 podStartE2EDuration="6.774545129s" totalImagesPullingTime="3.385898962s" totalInitContainerRuntime="1.01478971s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:17:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:17:28.75456269 +0000 UTC m=+511.428561527" watchObservedRunningTime="2026-07-09 22:17:28.774545129 +0000 UTC m=+511.448543930"
Jul 09 22:17:33.556778 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:33.556739    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:33.684297 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:33.684258    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:39.703530 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:39.703505    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b79867d65-jt9rr"
Jul 09 22:17:42.319096 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.319066    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"]
Jul 09 22:17:42.324800 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.324779    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"
Jul 09 22:17:42.327955 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.327930    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 22:17:42.328089 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.327931    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n55m9\""
Jul 09 22:17:42.328630 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.328614    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:17:42.329237 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.329222    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 22:17:42.329328 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.329312    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 22:17:42.329391 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.329333    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 22:17:42.351207 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.351183    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"]
Jul 09 22:17:42.499561 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.499523    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab7198eb-154e-4261-91b3-bc549ac5312f-cert\") pod \"lws-controller-manager-55bc84657b-n885t\" (UID: \"ab7198eb-154e-4261-91b3-bc549ac5312f\") " pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"
Jul 09 22:17:42.499728 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.499576    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44lb7\" (UniqueName: \"kubernetes.io/projected/ab7198eb-154e-4261-91b3-bc549ac5312f-kube-api-access-44lb7\") pod \"lws-controller-manager-55bc84657b-n885t\" (UID: \"ab7198eb-154e-4261-91b3-bc549ac5312f\") " pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"
Jul 09 22:17:42.499728 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.499616    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ab7198eb-154e-4261-91b3-bc549ac5312f-manager-config\") pod \"lws-controller-manager-55bc84657b-n885t\" (UID: \"ab7198eb-154e-4261-91b3-bc549ac5312f\") " pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"
Jul 09 22:17:42.499728 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.499697    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab7198eb-154e-4261-91b3-bc549ac5312f-metrics-cert\") pod \"lws-controller-manager-55bc84657b-n885t\" (UID: \"ab7198eb-154e-4261-91b3-bc549ac5312f\") " pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"
Jul 09 22:17:42.570386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.570306    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:42.600430 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.600399    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab7198eb-154e-4261-91b3-bc549ac5312f-cert\") pod \"lws-controller-manager-55bc84657b-n885t\" (UID: \"ab7198eb-154e-4261-91b3-bc549ac5312f\") " pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"
Jul 09 22:17:42.600589 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.600437    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44lb7\" (UniqueName: \"kubernetes.io/projected/ab7198eb-154e-4261-91b3-bc549ac5312f-kube-api-access-44lb7\") pod \"lws-controller-manager-55bc84657b-n885t\" (UID: \"ab7198eb-154e-4261-91b3-bc549ac5312f\") " pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"
Jul 09 22:17:42.600589 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.600475    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ab7198eb-154e-4261-91b3-bc549ac5312f-manager-config\") pod \"lws-controller-manager-55bc84657b-n885t\" (UID: \"ab7198eb-154e-4261-91b3-bc549ac5312f\") " pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"
Jul 09 22:17:42.600589 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.600536    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab7198eb-154e-4261-91b3-bc549ac5312f-metrics-cert\") pod \"lws-controller-manager-55bc84657b-n885t\" (UID: \"ab7198eb-154e-4261-91b3-bc549ac5312f\") " pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"
Jul 09 22:17:42.601397 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.601370    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ab7198eb-154e-4261-91b3-bc549ac5312f-manager-config\") pod \"lws-controller-manager-55bc84657b-n885t\" (UID: \"ab7198eb-154e-4261-91b3-bc549ac5312f\") " pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"
Jul 09 22:17:42.602947 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.602918    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab7198eb-154e-4261-91b3-bc549ac5312f-metrics-cert\") pod \"lws-controller-manager-55bc84657b-n885t\" (UID: \"ab7198eb-154e-4261-91b3-bc549ac5312f\") " pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"
Jul 09 22:17:42.603058 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.602948    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab7198eb-154e-4261-91b3-bc549ac5312f-cert\") pod \"lws-controller-manager-55bc84657b-n885t\" (UID: \"ab7198eb-154e-4261-91b3-bc549ac5312f\") " pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"
Jul 09 22:17:42.650293 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.650261    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44lb7\" (UniqueName: \"kubernetes.io/projected/ab7198eb-154e-4261-91b3-bc549ac5312f-kube-api-access-44lb7\") pod \"lws-controller-manager-55bc84657b-n885t\" (UID: \"ab7198eb-154e-4261-91b3-bc549ac5312f\") " pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"
Jul 09 22:17:42.850349 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.850312    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:42.934524 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:42.934485    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"
Jul 09 22:17:43.117425 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:43.117395    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"]
Jul 09 22:17:43.118130 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:17:43.118089    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab7198eb_154e_4261_91b3_bc549ac5312f.slice/crio-d31b84fea6597f6d511cc3b8a89881e061345afeea80a0408f165df33970b8f1 WatchSource:0}: Error finding container d31b84fea6597f6d511cc3b8a89881e061345afeea80a0408f165df33970b8f1: Status 404 returned error can't find the container with id d31b84fea6597f6d511cc3b8a89881e061345afeea80a0408f165df33970b8f1
Jul 09 22:17:43.269266 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:43.269204    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:43.758861 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:43.758825    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t" event={"ID":"ab7198eb-154e-4261-91b3-bc549ac5312f","Type":"ContainerStarted","Data":"d31b84fea6597f6d511cc3b8a89881e061345afeea80a0408f165df33970b8f1"}
Jul 09 22:17:43.804898 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:43.804855    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:44.072435 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:44.072354    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:44.265678 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:44.265642    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:44.764845 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:44.764814    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t" event={"ID":"ab7198eb-154e-4261-91b3-bc549ac5312f","Type":"ContainerStarted","Data":"2c828c5fe8359922fa2b846c5760820c462aa3de2acde355825d7e718a4ecd2d"}
Jul 09 22:17:44.765239 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:44.764886    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"
Jul 09 22:17:44.804219 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:44.804153    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t" podStartSLOduration=1.280445422 podStartE2EDuration="2.804136241s" totalImagesPullingTime="1.523690819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:17:44.803023497 +0000 UTC m=+527.477022302" watchObservedRunningTime="2026-07-09 22:17:44.804136241 +0000 UTC m=+527.478135042"
Jul 09 22:17:45.501227 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:45.501190    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:45.843181 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:45.843155    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:46.879635 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:46.879599    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:47.102706 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:47.102670    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:49.047807 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:49.047761    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:52.455506 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:52.455471    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:52.660920 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:52.660887    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:53.615488 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:53.615456    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:53.807147 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:53.807118    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:54.209613 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.209579    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"]
Jul 09 22:17:54.212480 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.212459    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.222008 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.221982    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wkqp6\""
Jul 09 22:17:54.222127 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.222077    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 22:17:54.222524 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.222508    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 22:17:54.223953 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.223938    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 22:17:54.290674 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.290634    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65d27310-b6ff-4e20-9465-6ec24fb40d3c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.290857 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.290687    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d27310-b6ff-4e20-9465-6ec24fb40d3c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.290857 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.290716    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65d27310-b6ff-4e20-9465-6ec24fb40d3c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.290857 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.290735    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65d27310-b6ff-4e20-9465-6ec24fb40d3c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.290857 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.290757    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65d27310-b6ff-4e20-9465-6ec24fb40d3c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.290857 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.290827    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65d27310-b6ff-4e20-9465-6ec24fb40d3c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.291066 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.290904    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65d27310-b6ff-4e20-9465-6ec24fb40d3c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.291066 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.290935    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2v7v\" (UniqueName: \"kubernetes.io/projected/65d27310-b6ff-4e20-9465-6ec24fb40d3c-kube-api-access-c2v7v\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.291066 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.290962    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d27310-b6ff-4e20-9465-6ec24fb40d3c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.357093 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.357055    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:54.391416 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.391382    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65d27310-b6ff-4e20-9465-6ec24fb40d3c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.391564 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.391424    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65d27310-b6ff-4e20-9465-6ec24fb40d3c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.391564 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.391549    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2v7v\" (UniqueName: \"kubernetes.io/projected/65d27310-b6ff-4e20-9465-6ec24fb40d3c-kube-api-access-c2v7v\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.391632 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.391597    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d27310-b6ff-4e20-9465-6ec24fb40d3c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.391632 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.391626    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65d27310-b6ff-4e20-9465-6ec24fb40d3c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.391720 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.391667    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d27310-b6ff-4e20-9465-6ec24fb40d3c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.391720 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.391693    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65d27310-b6ff-4e20-9465-6ec24fb40d3c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.391806 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.391717    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65d27310-b6ff-4e20-9465-6ec24fb40d3c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.391806 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.391754    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65d27310-b6ff-4e20-9465-6ec24fb40d3c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.392159 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.391956    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d27310-b6ff-4e20-9465-6ec24fb40d3c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.392249 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.392196    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65d27310-b6ff-4e20-9465-6ec24fb40d3c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.392249 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.392226    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d27310-b6ff-4e20-9465-6ec24fb40d3c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.392360 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.392272    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65d27310-b6ff-4e20-9465-6ec24fb40d3c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.392360 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.392295    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65d27310-b6ff-4e20-9465-6ec24fb40d3c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.393933 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.393912    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65d27310-b6ff-4e20-9465-6ec24fb40d3c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.393933 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.393929    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65d27310-b6ff-4e20-9465-6ec24fb40d3c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.424351 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.424321    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"]
Jul 09 22:17:54.425277 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.425251    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2v7v\" (UniqueName: \"kubernetes.io/projected/65d27310-b6ff-4e20-9465-6ec24fb40d3c-kube-api-access-c2v7v\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.454180 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.454145    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65d27310-b6ff-4e20-9465-6ec24fb40d3c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ls9vh\" (UID: \"65d27310-b6ff-4e20-9465-6ec24fb40d3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.522068 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.521948    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:54.618983 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.618947    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:54.701562 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.701531    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"]
Jul 09 22:17:54.704429 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:17:54.704398    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d27310_b6ff_4e20_9465_6ec24fb40d3c.slice/crio-bf15edb5109738e392631a52db810f6d96663a2ad7a2169c2ce174eb62c00bba WatchSource:0}: Error finding container bf15edb5109738e392631a52db810f6d96663a2ad7a2169c2ce174eb62c00bba: Status 404 returned error can't find the container with id bf15edb5109738e392631a52db810f6d96663a2ad7a2169c2ce174eb62c00bba
Jul 09 22:17:54.805356 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.805272    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh" event={"ID":"65d27310-b6ff-4e20-9465-6ec24fb40d3c","Type":"ContainerStarted","Data":"bf15edb5109738e392631a52db810f6d96663a2ad7a2169c2ce174eb62c00bba"}
Jul 09 22:17:54.837693 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:54.837665    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:55.772306 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:55.772260    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55bc84657b-n885t"
Jul 09 22:17:56.369579 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.369541    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"]
Jul 09 22:17:56.376556 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.376519    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.395003 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.394977    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 22:17:56.396455 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.396438    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-g8cdh\""
Jul 09 22:17:56.396920 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.396894    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 22:17:56.411100 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.411066    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.411220 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.411110    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.411220 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.411149    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.411220 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.411206    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.411389 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.411237    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slvxw\" (UniqueName: \"kubernetes.io/projected/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-kube-api-access-slvxw\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.411389 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.411288    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.411389 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.411308    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.419798 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.419771    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 22:17:56.476441 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.476414    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"]
Jul 09 22:17:56.512272 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.512244    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.512446 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.512275    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.512446 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.512307    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.512446 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.512435    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.512622 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.512467    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.512622 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.512510    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.512622 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.512538    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slvxw\" (UniqueName: \"kubernetes.io/projected/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-kube-api-access-slvxw\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.513329 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.513298    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.515208 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.515162    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.515208 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.515192    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.515208 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.515201    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.515417 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.515268    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.534566 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.534524    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slvxw\" (UniqueName: \"kubernetes.io/projected/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-kube-api-access-slvxw\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.534672 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.534606    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74f625ff-aaf7-4f68-92ba-491fc6e10bdb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hx5z4\" (UID: \"74f625ff-aaf7-4f68-92ba-491fc6e10bdb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:56.687593 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:56.687509    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:17:57.174980 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:57.174945    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:57.240694 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:57.240645    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:17:57.240807 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:57.240717    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:17:57.240807 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:57.240744    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:17:57.377648 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:57.377618    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"]
Jul 09 22:17:57.380309 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:17:57.380283    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f625ff_aaf7_4f68_92ba_491fc6e10bdb.slice/crio-537f8360d5797472e910bc29b12df2610b9b8743f5686cf22c3c7b594968c087 WatchSource:0}: Error finding container 537f8360d5797472e910bc29b12df2610b9b8743f5686cf22c3c7b594968c087: Status 404 returned error can't find the container with id 537f8360d5797472e910bc29b12df2610b9b8743f5686cf22c3c7b594968c087
Jul 09 22:17:57.409811 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:57.409778    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:57.656619 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:57.656585    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:57.820990 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:57.820957    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh" event={"ID":"65d27310-b6ff-4e20-9465-6ec24fb40d3c","Type":"ContainerStarted","Data":"04793921f88dec6dea7ca6938a3c5f2f03a36cac8210fc332a6cc43d61c7518e"}
Jul 09 22:17:57.822209 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:57.822187    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4" event={"ID":"74f625ff-aaf7-4f68-92ba-491fc6e10bdb","Type":"ContainerStarted","Data":"537f8360d5797472e910bc29b12df2610b9b8743f5686cf22c3c7b594968c087"}
Jul 09 22:17:57.870920 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:57.870872    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh" podStartSLOduration=1.336717527 podStartE2EDuration="3.870856499s" totalImagesPullingTime="2.534138972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:17:57.869143384 +0000 UTC m=+540.543142199" watchObservedRunningTime="2026-07-09 22:17:57.870856499 +0000 UTC m=+540.544855301"
Jul 09 22:17:57.878696 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:57.878665    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:58.085090 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:58.084986    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:17:58.522529 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:58.522490    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:58.527927 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:58.527893    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:58.827139 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:58.827067    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:58.827948 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:58.827918    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ls9vh"
Jul 09 22:17:59.713589 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:59.713558    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:17:59.713865 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:59.713648    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:17:59.833103 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:59.833068    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4" event={"ID":"74f625ff-aaf7-4f68-92ba-491fc6e10bdb","Type":"ContainerStarted","Data":"d739f339a9bc65fc22b272050a267748c581ada75d56818b3b791bfdd698c974"}
Jul 09 22:17:59.833302 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:17:59.833285    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:18:00.838860 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:18:00.838830    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4"
Jul 09 22:18:00.911375 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:18:00.911326    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hx5z4" podStartSLOduration=2.5808706729999997 podStartE2EDuration="4.911312553s" totalImagesPullingTime="2.33044188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:17:59.875943869 +0000 UTC m=+542.549942699" watchObservedRunningTime="2026-07-09 22:18:00.911312553 +0000 UTC m=+543.585311355"
Jul 09 22:18:15.257247 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:18:15.257206    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:18:43.941236 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:18:43.941195    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:18:44.083511 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:18:44.083472    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:18:44.176391 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:18:44.176357    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:18:55.145025 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:18:55.144987    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:18:56.375566 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:18:56.375532    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:18:59.845808 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:18:59.845768    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj"]
Jul 09 22:18:59.847803 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:18:59.847789    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj"
Jul 09 22:18:59.852673 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:18:59.852650    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 22:18:59.853631 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:18:59.853611    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 22:18:59.853747 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:18:59.853619    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qxmpn\""
Jul 09 22:18:59.868837 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:18:59.868809    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj"]
Jul 09 22:18:59.933347 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:18:59.933317    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1055509c-1ff4-4754-aa5a-7b9452267fdd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj\" (UID: \"1055509c-1ff4-4754-aa5a-7b9452267fdd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj"
Jul 09 22:18:59.933526 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:18:59.933373    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ltks\" (UniqueName: \"kubernetes.io/projected/1055509c-1ff4-4754-aa5a-7b9452267fdd-kube-api-access-5ltks\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj\" (UID: \"1055509c-1ff4-4754-aa5a-7b9452267fdd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj"
Jul 09 22:18:59.933526 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:18:59.933512    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1055509c-1ff4-4754-aa5a-7b9452267fdd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj\" (UID: \"1055509c-1ff4-4754-aa5a-7b9452267fdd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj"
Jul 09 22:19:00.034696 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.034659    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ltks\" (UniqueName: \"kubernetes.io/projected/1055509c-1ff4-4754-aa5a-7b9452267fdd-kube-api-access-5ltks\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj\" (UID: \"1055509c-1ff4-4754-aa5a-7b9452267fdd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj"
Jul 09 22:19:00.034783 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.034722    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1055509c-1ff4-4754-aa5a-7b9452267fdd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj\" (UID: \"1055509c-1ff4-4754-aa5a-7b9452267fdd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj"
Jul 09 22:19:00.034783 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.034754    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1055509c-1ff4-4754-aa5a-7b9452267fdd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj\" (UID: \"1055509c-1ff4-4754-aa5a-7b9452267fdd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj"
Jul 09 22:19:00.035142 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.035120    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1055509c-1ff4-4754-aa5a-7b9452267fdd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj\" (UID: \"1055509c-1ff4-4754-aa5a-7b9452267fdd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj"
Jul 09 22:19:00.035185 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.035139    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1055509c-1ff4-4754-aa5a-7b9452267fdd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj\" (UID: \"1055509c-1ff4-4754-aa5a-7b9452267fdd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj"
Jul 09 22:19:00.043888 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.043862    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ltks\" (UniqueName: \"kubernetes.io/projected/1055509c-1ff4-4754-aa5a-7b9452267fdd-kube-api-access-5ltks\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj\" (UID: \"1055509c-1ff4-4754-aa5a-7b9452267fdd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj"
Jul 09 22:19:00.157404 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.157327    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj"
Jul 09 22:19:00.301027 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.301003    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj"]
Jul 09 22:19:00.303065 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:19:00.303006    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1055509c_1ff4_4754_aa5a_7b9452267fdd.slice/crio-8b43c68c5fdb2f6b7cea1ced3e6e79e788d658d6160ba93ddef0db4410bc511c WatchSource:0}: Error finding container 8b43c68c5fdb2f6b7cea1ced3e6e79e788d658d6160ba93ddef0db4410bc511c: Status 404 returned error can't find the container with id 8b43c68c5fdb2f6b7cea1ced3e6e79e788d658d6160ba93ddef0db4410bc511c
Jul 09 22:19:00.623142 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.623105    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx"]
Jul 09 22:19:00.625384 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.625363    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx"
Jul 09 22:19:00.635539 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.635515    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx"]
Jul 09 22:19:00.637972 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.637950    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jljmn\" (UniqueName: \"kubernetes.io/projected/a829c6ac-0431-4292-ae61-3f04bf864627-kube-api-access-jljmn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx\" (UID: \"a829c6ac-0431-4292-ae61-3f04bf864627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx"
Jul 09 22:19:00.638101 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.638015    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a829c6ac-0431-4292-ae61-3f04bf864627-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx\" (UID: \"a829c6ac-0431-4292-ae61-3f04bf864627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx"
Jul 09 22:19:00.638101 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.638062    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a829c6ac-0431-4292-ae61-3f04bf864627-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx\" (UID: \"a829c6ac-0431-4292-ae61-3f04bf864627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx"
Jul 09 22:19:00.739171 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.739140    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a829c6ac-0431-4292-ae61-3f04bf864627-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx\" (UID: \"a829c6ac-0431-4292-ae61-3f04bf864627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx"
Jul 09 22:19:00.739171 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.739176    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a829c6ac-0431-4292-ae61-3f04bf864627-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx\" (UID: \"a829c6ac-0431-4292-ae61-3f04bf864627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx"
Jul 09 22:19:00.739376 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.739219    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jljmn\" (UniqueName: \"kubernetes.io/projected/a829c6ac-0431-4292-ae61-3f04bf864627-kube-api-access-jljmn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx\" (UID: \"a829c6ac-0431-4292-ae61-3f04bf864627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx"
Jul 09 22:19:00.739538 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.739517    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a829c6ac-0431-4292-ae61-3f04bf864627-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx\" (UID: \"a829c6ac-0431-4292-ae61-3f04bf864627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx"
Jul 09 22:19:00.739598 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.739579    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a829c6ac-0431-4292-ae61-3f04bf864627-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx\" (UID: \"a829c6ac-0431-4292-ae61-3f04bf864627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx"
Jul 09 22:19:00.748204 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.748182    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jljmn\" (UniqueName: \"kubernetes.io/projected/a829c6ac-0431-4292-ae61-3f04bf864627-kube-api-access-jljmn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx\" (UID: \"a829c6ac-0431-4292-ae61-3f04bf864627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx"
Jul 09 22:19:00.933909 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:00.933815    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx"
Jul 09 22:19:01.061951 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.061920    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx"]
Jul 09 22:19:01.064988 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:19:01.064959    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda829c6ac_0431_4292_ae61_3f04bf864627.slice/crio-a725cc120e48040c013d4da41bc3d1f2082198731ae500666468089eab74d989 WatchSource:0}: Error finding container a725cc120e48040c013d4da41bc3d1f2082198731ae500666468089eab74d989: Status 404 returned error can't find the container with id a725cc120e48040c013d4da41bc3d1f2082198731ae500666468089eab74d989
Jul 09 22:19:01.084322 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.084291    2554 generic.go:356] "Generic (PLEG): container finished" podID="1055509c-1ff4-4754-aa5a-7b9452267fdd" containerID="0f9f45a39c8a8965d59926adc832d4a30805c8d1063918264cb84645b036a381" exitCode=0
Jul 09 22:19:01.084448 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.084403    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj" event={"ID":"1055509c-1ff4-4754-aa5a-7b9452267fdd","Type":"ContainerDied","Data":"0f9f45a39c8a8965d59926adc832d4a30805c8d1063918264cb84645b036a381"}
Jul 09 22:19:01.084518 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.084484    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj" event={"ID":"1055509c-1ff4-4754-aa5a-7b9452267fdd","Type":"ContainerStarted","Data":"8b43c68c5fdb2f6b7cea1ced3e6e79e788d658d6160ba93ddef0db4410bc511c"}
Jul 09 22:19:01.085966 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.085933    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx" event={"ID":"a829c6ac-0431-4292-ae61-3f04bf864627","Type":"ContainerStarted","Data":"a725cc120e48040c013d4da41bc3d1f2082198731ae500666468089eab74d989"}
Jul 09 22:19:01.222680 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.222606    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n"]
Jul 09 22:19:01.224897 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.224879    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n"
Jul 09 22:19:01.235920 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.235894    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n"]
Jul 09 22:19:01.243449 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.243409    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/727ad24e-f4b3-44a2-865f-04e46b8a212d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n\" (UID: \"727ad24e-f4b3-44a2-865f-04e46b8a212d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n"
Jul 09 22:19:01.243584 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.243460    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/727ad24e-f4b3-44a2-865f-04e46b8a212d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n\" (UID: \"727ad24e-f4b3-44a2-865f-04e46b8a212d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n"
Jul 09 22:19:01.243584 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.243520    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx5cc\" (UniqueName: \"kubernetes.io/projected/727ad24e-f4b3-44a2-865f-04e46b8a212d-kube-api-access-cx5cc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n\" (UID: \"727ad24e-f4b3-44a2-865f-04e46b8a212d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n"
Jul 09 22:19:01.344116 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.344075    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/727ad24e-f4b3-44a2-865f-04e46b8a212d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n\" (UID: \"727ad24e-f4b3-44a2-865f-04e46b8a212d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n"
Jul 09 22:19:01.344116 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.344119    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/727ad24e-f4b3-44a2-865f-04e46b8a212d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n\" (UID: \"727ad24e-f4b3-44a2-865f-04e46b8a212d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n"
Jul 09 22:19:01.344313 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.344137    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx5cc\" (UniqueName: \"kubernetes.io/projected/727ad24e-f4b3-44a2-865f-04e46b8a212d-kube-api-access-cx5cc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n\" (UID: \"727ad24e-f4b3-44a2-865f-04e46b8a212d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n"
Jul 09 22:19:01.344530 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.344505    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/727ad24e-f4b3-44a2-865f-04e46b8a212d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n\" (UID: \"727ad24e-f4b3-44a2-865f-04e46b8a212d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n"
Jul 09 22:19:01.344575 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.344515    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/727ad24e-f4b3-44a2-865f-04e46b8a212d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n\" (UID: \"727ad24e-f4b3-44a2-865f-04e46b8a212d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n"
Jul 09 22:19:01.353631 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.353596    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx5cc\" (UniqueName: \"kubernetes.io/projected/727ad24e-f4b3-44a2-865f-04e46b8a212d-kube-api-access-cx5cc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n\" (UID: \"727ad24e-f4b3-44a2-865f-04e46b8a212d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n"
Jul 09 22:19:01.546933 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.546851    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n"
Jul 09 22:19:01.631014 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.630981    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r"]
Jul 09 22:19:01.640457 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.640426    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r"
Jul 09 22:19:01.643578 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.643548    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r"]
Jul 09 22:19:01.646666 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.646637    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpnr2\" (UniqueName: \"kubernetes.io/projected/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-kube-api-access-wpnr2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r\" (UID: \"84dd133a-068b-4cf8-bc9b-123b31f9a6d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r"
Jul 09 22:19:01.646816 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.646744    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r\" (UID: \"84dd133a-068b-4cf8-bc9b-123b31f9a6d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r"
Jul 09 22:19:01.646816 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.646787    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r\" (UID: \"84dd133a-068b-4cf8-bc9b-123b31f9a6d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r"
Jul 09 22:19:01.685258 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.685233    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n"]
Jul 09 22:19:01.748148 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.748120    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r\" (UID: \"84dd133a-068b-4cf8-bc9b-123b31f9a6d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r"
Jul 09 22:19:01.748305 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.748158    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r\" (UID: \"84dd133a-068b-4cf8-bc9b-123b31f9a6d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r"
Jul 09 22:19:01.748372 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.748344    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpnr2\" (UniqueName: \"kubernetes.io/projected/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-kube-api-access-wpnr2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r\" (UID: \"84dd133a-068b-4cf8-bc9b-123b31f9a6d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r"
Jul 09 22:19:01.748515 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.748491    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r\" (UID: \"84dd133a-068b-4cf8-bc9b-123b31f9a6d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r"
Jul 09 22:19:01.748577 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.748537    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r\" (UID: \"84dd133a-068b-4cf8-bc9b-123b31f9a6d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r"
Jul 09 22:19:01.757338 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:19:01.757306    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod727ad24e_f4b3_44a2_865f_04e46b8a212d.slice/crio-10e1a249e9aee4afc43e561ea24290adf94b6653453d96af90d27076cd0b5666 WatchSource:0}: Error finding container 10e1a249e9aee4afc43e561ea24290adf94b6653453d96af90d27076cd0b5666: Status 404 returned error can't find the container with id 10e1a249e9aee4afc43e561ea24290adf94b6653453d96af90d27076cd0b5666
Jul 09 22:19:01.758416 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.758391    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpnr2\" (UniqueName: \"kubernetes.io/projected/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-kube-api-access-wpnr2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r\" (UID: \"84dd133a-068b-4cf8-bc9b-123b31f9a6d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r"
Jul 09 22:19:01.953353 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:01.953327    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r"
Jul 09 22:19:02.082937 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:02.082909    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r"]
Jul 09 22:19:02.084754 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:19:02.084724    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84dd133a_068b_4cf8_bc9b_123b31f9a6d3.slice/crio-74c486e0f54b417e8508a5dc5d0c564374f34b2a3272a1b136f16149e7f2b862 WatchSource:0}: Error finding container 74c486e0f54b417e8508a5dc5d0c564374f34b2a3272a1b136f16149e7f2b862: Status 404 returned error can't find the container with id 74c486e0f54b417e8508a5dc5d0c564374f34b2a3272a1b136f16149e7f2b862
Jul 09 22:19:02.092423 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:02.092398    2554 generic.go:356] "Generic (PLEG): container finished" podID="1055509c-1ff4-4754-aa5a-7b9452267fdd" containerID="858947ea99f2a91de836ec702039539ce742881d84fc5b01ce77f48c32ed45cb" exitCode=0
Jul 09 22:19:02.092523 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:02.092490    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj" event={"ID":"1055509c-1ff4-4754-aa5a-7b9452267fdd","Type":"ContainerDied","Data":"858947ea99f2a91de836ec702039539ce742881d84fc5b01ce77f48c32ed45cb"}
Jul 09 22:19:02.094024 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:02.094002    2554 generic.go:356] "Generic (PLEG): container finished" podID="a829c6ac-0431-4292-ae61-3f04bf864627" containerID="a94074fd1e9726d36d2391d5ead91a0d5ff5bf96623f40e2978cddeeaae35f74" exitCode=0
Jul 09 22:19:02.094132 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:02.094063    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx" event={"ID":"a829c6ac-0431-4292-ae61-3f04bf864627","Type":"ContainerDied","Data":"a94074fd1e9726d36d2391d5ead91a0d5ff5bf96623f40e2978cddeeaae35f74"}
Jul 09 22:19:02.095308 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:02.095290    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r" event={"ID":"84dd133a-068b-4cf8-bc9b-123b31f9a6d3","Type":"ContainerStarted","Data":"74c486e0f54b417e8508a5dc5d0c564374f34b2a3272a1b136f16149e7f2b862"}
Jul 09 22:19:02.096938 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:02.096916    2554 generic.go:356] "Generic (PLEG): container finished" podID="727ad24e-f4b3-44a2-865f-04e46b8a212d" containerID="3484080c430880db58c5aef2419e6c1ca2828d1876c069aee65e439486ed0b1b" exitCode=0
Jul 09 22:19:02.097025 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:02.096974    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n" event={"ID":"727ad24e-f4b3-44a2-865f-04e46b8a212d","Type":"ContainerDied","Data":"3484080c430880db58c5aef2419e6c1ca2828d1876c069aee65e439486ed0b1b"}
Jul 09 22:19:02.097025 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:02.097008    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n" event={"ID":"727ad24e-f4b3-44a2-865f-04e46b8a212d","Type":"ContainerStarted","Data":"10e1a249e9aee4afc43e561ea24290adf94b6653453d96af90d27076cd0b5666"}
Jul 09 22:19:03.103658 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:03.103625    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx" event={"ID":"a829c6ac-0431-4292-ae61-3f04bf864627","Type":"ContainerStarted","Data":"e28db40fda6555c03451931d2a93bb10cd60d582965d4a220e0e462d37055fa7"}
Jul 09 22:19:03.105349 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:03.105325    2554 generic.go:356] "Generic (PLEG): container finished" podID="84dd133a-068b-4cf8-bc9b-123b31f9a6d3" containerID="490a2896acd5df5b1f652dc33c1361b40d9e8e346f0f3c4c50c3900ade69228e" exitCode=0
Jul 09 22:19:03.105466 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:03.105389    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r" event={"ID":"84dd133a-068b-4cf8-bc9b-123b31f9a6d3","Type":"ContainerDied","Data":"490a2896acd5df5b1f652dc33c1361b40d9e8e346f0f3c4c50c3900ade69228e"}
Jul 09 22:19:03.107599 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:03.107574    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n" event={"ID":"727ad24e-f4b3-44a2-865f-04e46b8a212d","Type":"ContainerStarted","Data":"828e963be986da68c2b9e60aaf1c2dc7d11b4e83401b662bd2600baf160dd4fc"}
Jul 09 22:19:03.110172 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:03.110150    2554 generic.go:356] "Generic (PLEG): container finished" podID="1055509c-1ff4-4754-aa5a-7b9452267fdd" containerID="340456b2131d418dc5323a740cc439686658aefda832ffe1f0bb118d285ba378" exitCode=0
Jul 09 22:19:03.110268 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:03.110185    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj" event={"ID":"1055509c-1ff4-4754-aa5a-7b9452267fdd","Type":"ContainerDied","Data":"340456b2131d418dc5323a740cc439686658aefda832ffe1f0bb118d285ba378"}
Jul 09 22:19:04.116494 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:04.116404    2554 generic.go:356] "Generic (PLEG): container finished" podID="727ad24e-f4b3-44a2-865f-04e46b8a212d" containerID="828e963be986da68c2b9e60aaf1c2dc7d11b4e83401b662bd2600baf160dd4fc" exitCode=0
Jul 09 22:19:04.116930 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:04.116487    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n" event={"ID":"727ad24e-f4b3-44a2-865f-04e46b8a212d","Type":"ContainerDied","Data":"828e963be986da68c2b9e60aaf1c2dc7d11b4e83401b662bd2600baf160dd4fc"}
Jul 09 22:19:04.118201 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:04.118163    2554 generic.go:356] "Generic (PLEG): container finished" podID="a829c6ac-0431-4292-ae61-3f04bf864627" containerID="e28db40fda6555c03451931d2a93bb10cd60d582965d4a220e0e462d37055fa7" exitCode=0
Jul 09 22:19:04.118268 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:04.118233    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx" event={"ID":"a829c6ac-0431-4292-ae61-3f04bf864627","Type":"ContainerDied","Data":"e28db40fda6555c03451931d2a93bb10cd60d582965d4a220e0e462d37055fa7"}
Jul 09 22:19:04.120133 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:04.120110    2554 generic.go:356] "Generic (PLEG): container finished" podID="84dd133a-068b-4cf8-bc9b-123b31f9a6d3" containerID="318c268af2a849912ded87147b061bddc1dc4772e3c1c6ca1879215bab9556d7" exitCode=0
Jul 09 22:19:04.120252 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:04.120137    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r" event={"ID":"84dd133a-068b-4cf8-bc9b-123b31f9a6d3","Type":"ContainerDied","Data":"318c268af2a849912ded87147b061bddc1dc4772e3c1c6ca1879215bab9556d7"}
Jul 09 22:19:04.271574 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:04.271551    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj"
Jul 09 22:19:04.375327 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:04.375243    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ltks\" (UniqueName: \"kubernetes.io/projected/1055509c-1ff4-4754-aa5a-7b9452267fdd-kube-api-access-5ltks\") pod \"1055509c-1ff4-4754-aa5a-7b9452267fdd\" (UID: \"1055509c-1ff4-4754-aa5a-7b9452267fdd\") "
Jul 09 22:19:04.375327 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:04.375294    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1055509c-1ff4-4754-aa5a-7b9452267fdd-util\") pod \"1055509c-1ff4-4754-aa5a-7b9452267fdd\" (UID: \"1055509c-1ff4-4754-aa5a-7b9452267fdd\") "
Jul 09 22:19:04.375541 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:04.375421    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1055509c-1ff4-4754-aa5a-7b9452267fdd-bundle\") pod \"1055509c-1ff4-4754-aa5a-7b9452267fdd\" (UID: \"1055509c-1ff4-4754-aa5a-7b9452267fdd\") "
Jul 09 22:19:04.376259 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:04.375876    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1055509c-1ff4-4754-aa5a-7b9452267fdd-bundle" (OuterVolumeSpecName: "bundle") pod "1055509c-1ff4-4754-aa5a-7b9452267fdd" (UID: "1055509c-1ff4-4754-aa5a-7b9452267fdd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:19:04.377570 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:04.377550    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1055509c-1ff4-4754-aa5a-7b9452267fdd-kube-api-access-5ltks" (OuterVolumeSpecName: "kube-api-access-5ltks") pod "1055509c-1ff4-4754-aa5a-7b9452267fdd" (UID: "1055509c-1ff4-4754-aa5a-7b9452267fdd"). InnerVolumeSpecName "kube-api-access-5ltks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:19:04.380747 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:04.380718    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1055509c-1ff4-4754-aa5a-7b9452267fdd-util" (OuterVolumeSpecName: "util") pod "1055509c-1ff4-4754-aa5a-7b9452267fdd" (UID: "1055509c-1ff4-4754-aa5a-7b9452267fdd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:19:04.476527 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:04.476482    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1055509c-1ff4-4754-aa5a-7b9452267fdd-bundle\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:19:04.476527 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:04.476521    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ltks\" (UniqueName: \"kubernetes.io/projected/1055509c-1ff4-4754-aa5a-7b9452267fdd-kube-api-access-5ltks\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:19:04.476527 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:04.476531    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1055509c-1ff4-4754-aa5a-7b9452267fdd-util\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:19:05.126505 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:05.126470    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj"
Jul 09 22:19:05.126935 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:05.126478    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj" event={"ID":"1055509c-1ff4-4754-aa5a-7b9452267fdd","Type":"ContainerDied","Data":"8b43c68c5fdb2f6b7cea1ced3e6e79e788d658d6160ba93ddef0db4410bc511c"}
Jul 09 22:19:05.126935 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:05.126600    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b43c68c5fdb2f6b7cea1ced3e6e79e788d658d6160ba93ddef0db4410bc511c"
Jul 09 22:19:05.128684 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:05.128655    2554 generic.go:356] "Generic (PLEG): container finished" podID="a829c6ac-0431-4292-ae61-3f04bf864627" containerID="6563cbaa15f82f72739e50125d93e2133115c6136fd639b59b63206c1d580108" exitCode=0
Jul 09 22:19:05.128799 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:05.128727    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx" event={"ID":"a829c6ac-0431-4292-ae61-3f04bf864627","Type":"ContainerDied","Data":"6563cbaa15f82f72739e50125d93e2133115c6136fd639b59b63206c1d580108"}
Jul 09 22:19:05.130811 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:05.130789    2554 generic.go:356] "Generic (PLEG): container finished" podID="84dd133a-068b-4cf8-bc9b-123b31f9a6d3" containerID="8bb1ebf60f62e80fb2e904f0af837482a826500661a3270f06d07011ae3be725" exitCode=0
Jul 09 22:19:05.130914 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:05.130868    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r" event={"ID":"84dd133a-068b-4cf8-bc9b-123b31f9a6d3","Type":"ContainerDied","Data":"8bb1ebf60f62e80fb2e904f0af837482a826500661a3270f06d07011ae3be725"}
Jul 09 22:19:05.132833 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:05.132810    2554 generic.go:356] "Generic (PLEG): container finished" podID="727ad24e-f4b3-44a2-865f-04e46b8a212d" containerID="be2dc762c8a5473d136c1019cbb5ecee35d515b8930e2ea1671cf58f4a31a007" exitCode=0
Jul 09 22:19:05.132930 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:05.132839    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n" event={"ID":"727ad24e-f4b3-44a2-865f-04e46b8a212d","Type":"ContainerDied","Data":"be2dc762c8a5473d136c1019cbb5ecee35d515b8930e2ea1671cf58f4a31a007"}
Jul 09 22:19:06.273894 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.273870    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r"
Jul 09 22:19:06.290490 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.290469    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-bundle\") pod \"84dd133a-068b-4cf8-bc9b-123b31f9a6d3\" (UID: \"84dd133a-068b-4cf8-bc9b-123b31f9a6d3\") "
Jul 09 22:19:06.290643 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.290516    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpnr2\" (UniqueName: \"kubernetes.io/projected/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-kube-api-access-wpnr2\") pod \"84dd133a-068b-4cf8-bc9b-123b31f9a6d3\" (UID: \"84dd133a-068b-4cf8-bc9b-123b31f9a6d3\") "
Jul 09 22:19:06.290643 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.290574    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-util\") pod \"84dd133a-068b-4cf8-bc9b-123b31f9a6d3\" (UID: \"84dd133a-068b-4cf8-bc9b-123b31f9a6d3\") "
Jul 09 22:19:06.291324 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.291298    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-bundle" (OuterVolumeSpecName: "bundle") pod "84dd133a-068b-4cf8-bc9b-123b31f9a6d3" (UID: "84dd133a-068b-4cf8-bc9b-123b31f9a6d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:19:06.293410 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.293384    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-kube-api-access-wpnr2" (OuterVolumeSpecName: "kube-api-access-wpnr2") pod "84dd133a-068b-4cf8-bc9b-123b31f9a6d3" (UID: "84dd133a-068b-4cf8-bc9b-123b31f9a6d3"). InnerVolumeSpecName "kube-api-access-wpnr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:19:06.296730 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.296615    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-util" (OuterVolumeSpecName: "util") pod "84dd133a-068b-4cf8-bc9b-123b31f9a6d3" (UID: "84dd133a-068b-4cf8-bc9b-123b31f9a6d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:19:06.322681 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.322657    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx"
Jul 09 22:19:06.325526 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.325511    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n"
Jul 09 22:19:06.391468 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.391392    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jljmn\" (UniqueName: \"kubernetes.io/projected/a829c6ac-0431-4292-ae61-3f04bf864627-kube-api-access-jljmn\") pod \"a829c6ac-0431-4292-ae61-3f04bf864627\" (UID: \"a829c6ac-0431-4292-ae61-3f04bf864627\") "
Jul 09 22:19:06.391468 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.391431    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a829c6ac-0431-4292-ae61-3f04bf864627-bundle\") pod \"a829c6ac-0431-4292-ae61-3f04bf864627\" (UID: \"a829c6ac-0431-4292-ae61-3f04bf864627\") "
Jul 09 22:19:06.391468 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.391451    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/727ad24e-f4b3-44a2-865f-04e46b8a212d-bundle\") pod \"727ad24e-f4b3-44a2-865f-04e46b8a212d\" (UID: \"727ad24e-f4b3-44a2-865f-04e46b8a212d\") "
Jul 09 22:19:06.391739 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.391479    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx5cc\" (UniqueName: \"kubernetes.io/projected/727ad24e-f4b3-44a2-865f-04e46b8a212d-kube-api-access-cx5cc\") pod \"727ad24e-f4b3-44a2-865f-04e46b8a212d\" (UID: \"727ad24e-f4b3-44a2-865f-04e46b8a212d\") "
Jul 09 22:19:06.391739 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.391512    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a829c6ac-0431-4292-ae61-3f04bf864627-util\") pod \"a829c6ac-0431-4292-ae61-3f04bf864627\" (UID: \"a829c6ac-0431-4292-ae61-3f04bf864627\") "
Jul 09 22:19:06.391739 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.391585    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/727ad24e-f4b3-44a2-865f-04e46b8a212d-util\") pod \"727ad24e-f4b3-44a2-865f-04e46b8a212d\" (UID: \"727ad24e-f4b3-44a2-865f-04e46b8a212d\") "
Jul 09 22:19:06.391891 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.391837    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-util\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:19:06.391891 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.391855    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-bundle\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:19:06.391891 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.391871    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpnr2\" (UniqueName: \"kubernetes.io/projected/84dd133a-068b-4cf8-bc9b-123b31f9a6d3-kube-api-access-wpnr2\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:19:06.392058 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.391948    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a829c6ac-0431-4292-ae61-3f04bf864627-bundle" (OuterVolumeSpecName: "bundle") pod "a829c6ac-0431-4292-ae61-3f04bf864627" (UID: "a829c6ac-0431-4292-ae61-3f04bf864627"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:19:06.392224 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.392200    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/727ad24e-f4b3-44a2-865f-04e46b8a212d-bundle" (OuterVolumeSpecName: "bundle") pod "727ad24e-f4b3-44a2-865f-04e46b8a212d" (UID: "727ad24e-f4b3-44a2-865f-04e46b8a212d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:19:06.394102 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.394081    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/727ad24e-f4b3-44a2-865f-04e46b8a212d-kube-api-access-cx5cc" (OuterVolumeSpecName: "kube-api-access-cx5cc") pod "727ad24e-f4b3-44a2-865f-04e46b8a212d" (UID: "727ad24e-f4b3-44a2-865f-04e46b8a212d"). InnerVolumeSpecName "kube-api-access-cx5cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:19:06.394189 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.394100    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a829c6ac-0431-4292-ae61-3f04bf864627-kube-api-access-jljmn" (OuterVolumeSpecName: "kube-api-access-jljmn") pod "a829c6ac-0431-4292-ae61-3f04bf864627" (UID: "a829c6ac-0431-4292-ae61-3f04bf864627"). InnerVolumeSpecName "kube-api-access-jljmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:19:06.399052 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.399015    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a829c6ac-0431-4292-ae61-3f04bf864627-util" (OuterVolumeSpecName: "util") pod "a829c6ac-0431-4292-ae61-3f04bf864627" (UID: "a829c6ac-0431-4292-ae61-3f04bf864627"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:19:06.399733 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.399714    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/727ad24e-f4b3-44a2-865f-04e46b8a212d-util" (OuterVolumeSpecName: "util") pod "727ad24e-f4b3-44a2-865f-04e46b8a212d" (UID: "727ad24e-f4b3-44a2-865f-04e46b8a212d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:19:06.492635 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.492588    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/727ad24e-f4b3-44a2-865f-04e46b8a212d-util\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:19:06.492635 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.492630    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jljmn\" (UniqueName: \"kubernetes.io/projected/a829c6ac-0431-4292-ae61-3f04bf864627-kube-api-access-jljmn\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:19:06.492635 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.492641    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a829c6ac-0431-4292-ae61-3f04bf864627-bundle\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:19:06.492635 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.492650    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/727ad24e-f4b3-44a2-865f-04e46b8a212d-bundle\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:19:06.492861 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.492659    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx5cc\" (UniqueName: \"kubernetes.io/projected/727ad24e-f4b3-44a2-865f-04e46b8a212d-kube-api-access-cx5cc\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:19:06.492861 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:06.492666    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a829c6ac-0431-4292-ae61-3f04bf864627-util\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:19:07.142975 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:07.142947    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n"
Jul 09 22:19:07.143172 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:07.142972    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n" event={"ID":"727ad24e-f4b3-44a2-865f-04e46b8a212d","Type":"ContainerDied","Data":"10e1a249e9aee4afc43e561ea24290adf94b6653453d96af90d27076cd0b5666"}
Jul 09 22:19:07.143172 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:07.143018    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10e1a249e9aee4afc43e561ea24290adf94b6653453d96af90d27076cd0b5666"
Jul 09 22:19:07.144874 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:07.144853    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx"
Jul 09 22:19:07.144874 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:07.144865    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx" event={"ID":"a829c6ac-0431-4292-ae61-3f04bf864627","Type":"ContainerDied","Data":"a725cc120e48040c013d4da41bc3d1f2082198731ae500666468089eab74d989"}
Jul 09 22:19:07.145072 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:07.144905    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a725cc120e48040c013d4da41bc3d1f2082198731ae500666468089eab74d989"
Jul 09 22:19:07.146725 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:07.146703    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r" event={"ID":"84dd133a-068b-4cf8-bc9b-123b31f9a6d3","Type":"ContainerDied","Data":"74c486e0f54b417e8508a5dc5d0c564374f34b2a3272a1b136f16149e7f2b862"}
Jul 09 22:19:07.146835 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:07.146731    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r"
Jul 09 22:19:07.146835 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:07.146743    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74c486e0f54b417e8508a5dc5d0c564374f34b2a3272a1b136f16149e7f2b862"
Jul 09 22:19:13.743567 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:13.743518    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:13.836357 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:13.836327    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:17.147549 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:17.147517    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:20.430138 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:20.430028    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:21.812749 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:21.812715    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:21.987127 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:21.987088    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:22.532230 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:22.532201    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:25.469173 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:25.469145    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:26.328686 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:26.328649    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:28.176005 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:28.175973    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:29.807209 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:29.807157    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:29.966462 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:29.966433    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:32.029869 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:32.029832    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:32.322199 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:32.322112    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:33.547844 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:33.547814    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:33.648791 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:33.648755    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:39.691550 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:39.691518    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:42.977467 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:42.977429    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:43.085941 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:43.085904    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:46.016082 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:46.016043    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:46.225224 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:46.225154    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:48.579403 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:48.579367    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:48.686704 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:48.686670    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:52.403239 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:52.403201    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:19:52.502105 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:19:52.502062    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:02.370660 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:02.370621    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:02.475239 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:02.475210    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:05.359420 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:05.359391    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:05.465681 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:05.465648    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:11.554413 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:11.554371    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:11.777553 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:11.777518    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:16.819374 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:16.819339    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:16.885206 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:16.885164    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:16.956110 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:16.956075    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:17.542964 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:17.542929    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:17.646537 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:17.646502    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:20.103195 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:20.103165    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:20.228395 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:20.228366    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:20.332223 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:20.332170    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:20.926689 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:20.926651    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:20.989867 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:20.989834    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:27.722702 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:27.722655    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:27.823766 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:27.823718    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:41.340372 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:41.340335    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:41.437923 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:41.437889    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:41.842564 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:41.842517    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:54.463660 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:54.463550    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:20:54.717396 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:20:54.717317    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:21:01.516450 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.516422    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:21:01.532512 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532486    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59944d76c8-4qzsj"]
Jul 09 22:21:01.532753 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532742    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a829c6ac-0431-4292-ae61-3f04bf864627" containerName="pull"
Jul 09 22:21:01.532801 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532755    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a829c6ac-0431-4292-ae61-3f04bf864627" containerName="pull"
Jul 09 22:21:01.532801 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532766    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84dd133a-068b-4cf8-bc9b-123b31f9a6d3" containerName="extract"
Jul 09 22:21:01.532801 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532772    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="84dd133a-068b-4cf8-bc9b-123b31f9a6d3" containerName="extract"
Jul 09 22:21:01.532801 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532781    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a829c6ac-0431-4292-ae61-3f04bf864627" containerName="extract"
Jul 09 22:21:01.532801 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532787    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a829c6ac-0431-4292-ae61-3f04bf864627" containerName="extract"
Jul 09 22:21:01.532801 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532795    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1055509c-1ff4-4754-aa5a-7b9452267fdd" containerName="util"
Jul 09 22:21:01.532801 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532800    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1055509c-1ff4-4754-aa5a-7b9452267fdd" containerName="util"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532807    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="727ad24e-f4b3-44a2-865f-04e46b8a212d" containerName="extract"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532812    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="727ad24e-f4b3-44a2-865f-04e46b8a212d" containerName="extract"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532820    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1055509c-1ff4-4754-aa5a-7b9452267fdd" containerName="extract"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532825    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1055509c-1ff4-4754-aa5a-7b9452267fdd" containerName="extract"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532833    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84dd133a-068b-4cf8-bc9b-123b31f9a6d3" containerName="util"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532837    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="84dd133a-068b-4cf8-bc9b-123b31f9a6d3" containerName="util"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532843    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84dd133a-068b-4cf8-bc9b-123b31f9a6d3" containerName="pull"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532848    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="84dd133a-068b-4cf8-bc9b-123b31f9a6d3" containerName="pull"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532853    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="727ad24e-f4b3-44a2-865f-04e46b8a212d" containerName="util"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532857    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="727ad24e-f4b3-44a2-865f-04e46b8a212d" containerName="util"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532863    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="727ad24e-f4b3-44a2-865f-04e46b8a212d" containerName="pull"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532868    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="727ad24e-f4b3-44a2-865f-04e46b8a212d" containerName="pull"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532872    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a829c6ac-0431-4292-ae61-3f04bf864627" containerName="util"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532877    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a829c6ac-0431-4292-ae61-3f04bf864627" containerName="util"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532882    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1055509c-1ff4-4754-aa5a-7b9452267fdd" containerName="pull"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532886    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1055509c-1ff4-4754-aa5a-7b9452267fdd" containerName="pull"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532926    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1055509c-1ff4-4754-aa5a-7b9452267fdd" containerName="extract"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532931    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a829c6ac-0431-4292-ae61-3f04bf864627" containerName="extract"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532937    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="727ad24e-f4b3-44a2-865f-04e46b8a212d" containerName="extract"
Jul 09 22:21:01.533001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.532942    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="84dd133a-068b-4cf8-bc9b-123b31f9a6d3" containerName="extract"
Jul 09 22:21:01.535778 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.535759    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59944d76c8-4qzsj"
Jul 09 22:21:01.538387 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.538363    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 22:21:01.538503 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.538437    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jvz8r\""
Jul 09 22:21:01.539223 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.539208    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 22:21:01.545535 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.545502    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59944d76c8-4qzsj"]
Jul 09 22:21:01.589533 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.589496    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:21:01.604603 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.604567    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zhxp\" (UniqueName: \"kubernetes.io/projected/18736e7a-7813-42dc-85fc-139f47f96f47-kube-api-access-4zhxp\") pod \"maas-controller-59944d76c8-4qzsj\" (UID: \"18736e7a-7813-42dc-85fc-139f47f96f47\") " pod="opendatahub/maas-controller-59944d76c8-4qzsj"
Jul 09 22:21:01.604701 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.604612    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18736e7a-7813-42dc-85fc-139f47f96f47-webhook-cert\") pod \"maas-controller-59944d76c8-4qzsj\" (UID: \"18736e7a-7813-42dc-85fc-139f47f96f47\") " pod="opendatahub/maas-controller-59944d76c8-4qzsj"
Jul 09 22:21:01.705913 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.705880    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zhxp\" (UniqueName: \"kubernetes.io/projected/18736e7a-7813-42dc-85fc-139f47f96f47-kube-api-access-4zhxp\") pod \"maas-controller-59944d76c8-4qzsj\" (UID: \"18736e7a-7813-42dc-85fc-139f47f96f47\") " pod="opendatahub/maas-controller-59944d76c8-4qzsj"
Jul 09 22:21:01.706140 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.705919    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18736e7a-7813-42dc-85fc-139f47f96f47-webhook-cert\") pod \"maas-controller-59944d76c8-4qzsj\" (UID: \"18736e7a-7813-42dc-85fc-139f47f96f47\") " pod="opendatahub/maas-controller-59944d76c8-4qzsj"
Jul 09 22:21:01.706140 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:21:01.706066    2554 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 09 22:21:01.706140 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:21:01.706132    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18736e7a-7813-42dc-85fc-139f47f96f47-webhook-cert podName:18736e7a-7813-42dc-85fc-139f47f96f47 nodeName:}" failed. No retries permitted until 2026-07-09 22:21:02.206112157 +0000 UTC m=+724.880110937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/18736e7a-7813-42dc-85fc-139f47f96f47-webhook-cert") pod "maas-controller-59944d76c8-4qzsj" (UID: "18736e7a-7813-42dc-85fc-139f47f96f47") : secret "maas-controller-webhook-cert" not found
Jul 09 22:21:01.714478 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.714452    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zhxp\" (UniqueName: \"kubernetes.io/projected/18736e7a-7813-42dc-85fc-139f47f96f47-kube-api-access-4zhxp\") pod \"maas-controller-59944d76c8-4qzsj\" (UID: \"18736e7a-7813-42dc-85fc-139f47f96f47\") " pod="opendatahub/maas-controller-59944d76c8-4qzsj"
Jul 09 22:21:01.937823 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.937789    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-748d684877-z2b7g"]
Jul 09 22:21:01.940947 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.940927    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-748d684877-z2b7g"
Jul 09 22:21:01.950945 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.950924    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-748d684877-z2b7g"]
Jul 09 22:21:01.966719 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:01.966684    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:21:02.008934 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:02.008902    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5445bed6-62ac-4150-a2d1-cc680dfc6a31-webhook-cert\") pod \"maas-controller-748d684877-z2b7g\" (UID: \"5445bed6-62ac-4150-a2d1-cc680dfc6a31\") " pod="opendatahub/maas-controller-748d684877-z2b7g"
Jul 09 22:21:02.009134 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:02.008960    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpcl4\" (UniqueName: \"kubernetes.io/projected/5445bed6-62ac-4150-a2d1-cc680dfc6a31-kube-api-access-lpcl4\") pod \"maas-controller-748d684877-z2b7g\" (UID: \"5445bed6-62ac-4150-a2d1-cc680dfc6a31\") " pod="opendatahub/maas-controller-748d684877-z2b7g"
Jul 09 22:21:02.110257 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:02.110231    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5445bed6-62ac-4150-a2d1-cc680dfc6a31-webhook-cert\") pod \"maas-controller-748d684877-z2b7g\" (UID: \"5445bed6-62ac-4150-a2d1-cc680dfc6a31\") " pod="opendatahub/maas-controller-748d684877-z2b7g"
Jul 09 22:21:02.110419 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:02.110282    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpcl4\" (UniqueName: \"kubernetes.io/projected/5445bed6-62ac-4150-a2d1-cc680dfc6a31-kube-api-access-lpcl4\") pod \"maas-controller-748d684877-z2b7g\" (UID: \"5445bed6-62ac-4150-a2d1-cc680dfc6a31\") " pod="opendatahub/maas-controller-748d684877-z2b7g"
Jul 09 22:21:02.112714 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:02.112695    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5445bed6-62ac-4150-a2d1-cc680dfc6a31-webhook-cert\") pod \"maas-controller-748d684877-z2b7g\" (UID: \"5445bed6-62ac-4150-a2d1-cc680dfc6a31\") " pod="opendatahub/maas-controller-748d684877-z2b7g"
Jul 09 22:21:02.118626 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:02.118601    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpcl4\" (UniqueName: \"kubernetes.io/projected/5445bed6-62ac-4150-a2d1-cc680dfc6a31-kube-api-access-lpcl4\") pod \"maas-controller-748d684877-z2b7g\" (UID: \"5445bed6-62ac-4150-a2d1-cc680dfc6a31\") " pod="opendatahub/maas-controller-748d684877-z2b7g"
Jul 09 22:21:02.211175 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:02.211096    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18736e7a-7813-42dc-85fc-139f47f96f47-webhook-cert\") pod \"maas-controller-59944d76c8-4qzsj\" (UID: \"18736e7a-7813-42dc-85fc-139f47f96f47\") " pod="opendatahub/maas-controller-59944d76c8-4qzsj"
Jul 09 22:21:02.213499 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:02.213478    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18736e7a-7813-42dc-85fc-139f47f96f47-webhook-cert\") pod \"maas-controller-59944d76c8-4qzsj\" (UID: \"18736e7a-7813-42dc-85fc-139f47f96f47\") " pod="opendatahub/maas-controller-59944d76c8-4qzsj"
Jul 09 22:21:02.251417 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:02.251385    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-748d684877-z2b7g"
Jul 09 22:21:02.377529 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:02.377505    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-748d684877-z2b7g"]
Jul 09 22:21:02.379907 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:21:02.379883    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5445bed6_62ac_4150_a2d1_cc680dfc6a31.slice/crio-2f2904667c558e92d13d92bea1123eeb9f6a800b2758ba2a05d2686818dde1e4 WatchSource:0}: Error finding container 2f2904667c558e92d13d92bea1123eeb9f6a800b2758ba2a05d2686818dde1e4: Status 404 returned error can't find the container with id 2f2904667c558e92d13d92bea1123eeb9f6a800b2758ba2a05d2686818dde1e4
Jul 09 22:21:02.381178 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:02.381162    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:21:02.446598 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:02.446570    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59944d76c8-4qzsj"
Jul 09 22:21:02.570607 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:02.570583    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59944d76c8-4qzsj"]
Jul 09 22:21:02.572103 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:21:02.572079    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18736e7a_7813_42dc_85fc_139f47f96f47.slice/crio-cc39bc23a81cafe456d2a54f2751cce184cbc8438fa2ca377bebbb59825490d8 WatchSource:0}: Error finding container cc39bc23a81cafe456d2a54f2751cce184cbc8438fa2ca377bebbb59825490d8: Status 404 returned error can't find the container with id cc39bc23a81cafe456d2a54f2751cce184cbc8438fa2ca377bebbb59825490d8
Jul 09 22:21:02.657757 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:02.657721    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-748d684877-z2b7g" event={"ID":"5445bed6-62ac-4150-a2d1-cc680dfc6a31","Type":"ContainerStarted","Data":"2f2904667c558e92d13d92bea1123eeb9f6a800b2758ba2a05d2686818dde1e4"}
Jul 09 22:21:02.658819 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:02.658791    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59944d76c8-4qzsj" event={"ID":"18736e7a-7813-42dc-85fc-139f47f96f47","Type":"ContainerStarted","Data":"cc39bc23a81cafe456d2a54f2751cce184cbc8438fa2ca377bebbb59825490d8"}
Jul 09 22:21:05.063905 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:05.063845    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:21:05.161205 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:05.161118    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:21:05.677897 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:05.677858    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-748d684877-z2b7g" event={"ID":"5445bed6-62ac-4150-a2d1-cc680dfc6a31","Type":"ContainerStarted","Data":"b766b7b1766c57ce500c236e84427469fb780efbfe18a4927ea9d25facfff9aa"}
Jul 09 22:21:05.678120 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:05.678024    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-748d684877-z2b7g"
Jul 09 22:21:05.679441 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:05.679416    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59944d76c8-4qzsj" event={"ID":"18736e7a-7813-42dc-85fc-139f47f96f47","Type":"ContainerStarted","Data":"4557812db2c0d3805dd1ad29638fcb0d8c9f35cb736e73a25c66bddbb1be08d3"}
Jul 09 22:21:05.679574 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:05.679560    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59944d76c8-4qzsj"
Jul 09 22:21:05.701424 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:05.701369    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-748d684877-z2b7g" podStartSLOduration=1.913067176 podStartE2EDuration="4.701350183s" totalImagesPullingTime="2.788283007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:21:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:21:05.70060289 +0000 UTC m=+728.374601695" watchObservedRunningTime="2026-07-09 22:21:05.701350183 +0000 UTC m=+728.375348986"
Jul 09 22:21:05.726192 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:05.726142    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59944d76c8-4qzsj" podStartSLOduration=2.4360672 podStartE2EDuration="4.726122371s" totalImagesPullingTime="2.290055171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:21:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:21:05.722840572 +0000 UTC m=+728.396839396" watchObservedRunningTime="2026-07-09 22:21:05.726122371 +0000 UTC m=+728.400121174"
Jul 09 22:21:09.006344 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:09.006313    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:21:16.689781 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:16.689750    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-748d684877-z2b7g"
Jul 09 22:21:16.690313 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:16.690292    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59944d76c8-4qzsj"
Jul 09 22:21:16.752107 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:16.752072    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59944d76c8-4qzsj"]
Jul 09 22:21:16.752334 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:16.752261    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-59944d76c8-4qzsj" podUID="18736e7a-7813-42dc-85fc-139f47f96f47" containerName="manager" containerID="cri-o://4557812db2c0d3805dd1ad29638fcb0d8c9f35cb736e73a25c66bddbb1be08d3" gracePeriod=30
Jul 09 22:21:17.000312 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:17.000291    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59944d76c8-4qzsj"
Jul 09 22:21:17.026047 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:17.026007    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zhxp\" (UniqueName: \"kubernetes.io/projected/18736e7a-7813-42dc-85fc-139f47f96f47-kube-api-access-4zhxp\") pod \"18736e7a-7813-42dc-85fc-139f47f96f47\" (UID: \"18736e7a-7813-42dc-85fc-139f47f96f47\") "
Jul 09 22:21:17.026220 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:17.026087    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18736e7a-7813-42dc-85fc-139f47f96f47-webhook-cert\") pod \"18736e7a-7813-42dc-85fc-139f47f96f47\" (UID: \"18736e7a-7813-42dc-85fc-139f47f96f47\") "
Jul 09 22:21:17.028170 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:17.028142    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18736e7a-7813-42dc-85fc-139f47f96f47-kube-api-access-4zhxp" (OuterVolumeSpecName: "kube-api-access-4zhxp") pod "18736e7a-7813-42dc-85fc-139f47f96f47" (UID: "18736e7a-7813-42dc-85fc-139f47f96f47"). InnerVolumeSpecName "kube-api-access-4zhxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:21:17.028263 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:17.028182    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18736e7a-7813-42dc-85fc-139f47f96f47-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "18736e7a-7813-42dc-85fc-139f47f96f47" (UID: "18736e7a-7813-42dc-85fc-139f47f96f47"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:21:17.127432 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:17.127405    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zhxp\" (UniqueName: \"kubernetes.io/projected/18736e7a-7813-42dc-85fc-139f47f96f47-kube-api-access-4zhxp\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:21:17.127432 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:17.127428    2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18736e7a-7813-42dc-85fc-139f47f96f47-webhook-cert\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:21:17.733424 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:17.733391    2554 generic.go:356] "Generic (PLEG): container finished" podID="18736e7a-7813-42dc-85fc-139f47f96f47" containerID="4557812db2c0d3805dd1ad29638fcb0d8c9f35cb736e73a25c66bddbb1be08d3" exitCode=0
Jul 09 22:21:17.733837 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:17.733437    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59944d76c8-4qzsj"
Jul 09 22:21:17.733837 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:17.733477    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59944d76c8-4qzsj" event={"ID":"18736e7a-7813-42dc-85fc-139f47f96f47","Type":"ContainerDied","Data":"4557812db2c0d3805dd1ad29638fcb0d8c9f35cb736e73a25c66bddbb1be08d3"}
Jul 09 22:21:17.733837 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:17.733529    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59944d76c8-4qzsj" event={"ID":"18736e7a-7813-42dc-85fc-139f47f96f47","Type":"ContainerDied","Data":"cc39bc23a81cafe456d2a54f2751cce184cbc8438fa2ca377bebbb59825490d8"}
Jul 09 22:21:17.733837 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:17.733565    2554 scope.go:117] "RemoveContainer" containerID="4557812db2c0d3805dd1ad29638fcb0d8c9f35cb736e73a25c66bddbb1be08d3"
Jul 09 22:21:17.746672 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:17.746651    2554 scope.go:117] "RemoveContainer" containerID="4557812db2c0d3805dd1ad29638fcb0d8c9f35cb736e73a25c66bddbb1be08d3"
Jul 09 22:21:17.747072 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:21:17.747047    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4557812db2c0d3805dd1ad29638fcb0d8c9f35cb736e73a25c66bddbb1be08d3\": container with ID starting with 4557812db2c0d3805dd1ad29638fcb0d8c9f35cb736e73a25c66bddbb1be08d3 not found: ID does not exist" containerID="4557812db2c0d3805dd1ad29638fcb0d8c9f35cb736e73a25c66bddbb1be08d3"
Jul 09 22:21:17.747152 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:17.747083    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4557812db2c0d3805dd1ad29638fcb0d8c9f35cb736e73a25c66bddbb1be08d3"} err="failed to get container status \"4557812db2c0d3805dd1ad29638fcb0d8c9f35cb736e73a25c66bddbb1be08d3\": rpc error: code = NotFound desc = could not find container \"4557812db2c0d3805dd1ad29638fcb0d8c9f35cb736e73a25c66bddbb1be08d3\": container with ID starting with 4557812db2c0d3805dd1ad29638fcb0d8c9f35cb736e73a25c66bddbb1be08d3 not found: ID does not exist"
Jul 09 22:21:17.757165 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:17.757138    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59944d76c8-4qzsj"]
Jul 09 22:21:17.761903 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:17.761881    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-59944d76c8-4qzsj"]
Jul 09 22:21:17.881881 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:17.881848    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18736e7a-7813-42dc-85fc-139f47f96f47" path="/var/lib/kubelet/pods/18736e7a-7813-42dc-85fc-139f47f96f47/volumes"
Jul 09 22:21:36.261655 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.261619    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:21:36.662957 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.662917    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:21:36.727986 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.727957    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t"]
Jul 09 22:21:36.728259 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.728245    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18736e7a-7813-42dc-85fc-139f47f96f47" containerName="manager"
Jul 09 22:21:36.728259 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.728259    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="18736e7a-7813-42dc-85fc-139f47f96f47" containerName="manager"
Jul 09 22:21:36.728358 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.728318    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="18736e7a-7813-42dc-85fc-139f47f96f47" containerName="manager"
Jul 09 22:21:36.731249 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.731234    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t"
Jul 09 22:21:36.733670 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.733649    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 22:21:36.733823 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.733809    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-57hq5\""
Jul 09 22:21:36.734654 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.734639    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 22:21:36.734744 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.734645    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 09 22:21:36.744089 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.744068    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t"]
Jul 09 22:21:36.780830 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.780796    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snlt9\" (UniqueName: \"kubernetes.io/projected/ab520d02-c135-4a02-9be5-7516742bfc4f-kube-api-access-snlt9\") pod \"maas-api-5ff7bc6b84-6q99t\" (UID: \"ab520d02-c135-4a02-9be5-7516742bfc4f\") " pod="odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t"
Jul 09 22:21:36.781004 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.780870    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab520d02-c135-4a02-9be5-7516742bfc4f-openshift-service-ca\") pod \"maas-api-5ff7bc6b84-6q99t\" (UID: \"ab520d02-c135-4a02-9be5-7516742bfc4f\") " pod="odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t"
Jul 09 22:21:36.781004 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.780909    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab520d02-c135-4a02-9be5-7516742bfc4f-maas-api-tls\") pod \"maas-api-5ff7bc6b84-6q99t\" (UID: \"ab520d02-c135-4a02-9be5-7516742bfc4f\") " pod="odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t"
Jul 09 22:21:36.882235 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.882205    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab520d02-c135-4a02-9be5-7516742bfc4f-maas-api-tls\") pod \"maas-api-5ff7bc6b84-6q99t\" (UID: \"ab520d02-c135-4a02-9be5-7516742bfc4f\") " pod="odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t"
Jul 09 22:21:36.882420 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.882247    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snlt9\" (UniqueName: \"kubernetes.io/projected/ab520d02-c135-4a02-9be5-7516742bfc4f-kube-api-access-snlt9\") pod \"maas-api-5ff7bc6b84-6q99t\" (UID: \"ab520d02-c135-4a02-9be5-7516742bfc4f\") " pod="odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t"
Jul 09 22:21:36.882420 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.882285    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab520d02-c135-4a02-9be5-7516742bfc4f-openshift-service-ca\") pod \"maas-api-5ff7bc6b84-6q99t\" (UID: \"ab520d02-c135-4a02-9be5-7516742bfc4f\") " pod="odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t"
Jul 09 22:21:36.882420 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:21:36.882345    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 09 22:21:36.882420 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:21:36.882420    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab520d02-c135-4a02-9be5-7516742bfc4f-maas-api-tls podName:ab520d02-c135-4a02-9be5-7516742bfc4f nodeName:}" failed. No retries permitted until 2026-07-09 22:21:37.382402224 +0000 UTC m=+760.056401005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ab520d02-c135-4a02-9be5-7516742bfc4f-maas-api-tls") pod "maas-api-5ff7bc6b84-6q99t" (UID: "ab520d02-c135-4a02-9be5-7516742bfc4f") : secret "maas-api-serving-cert" not found
Jul 09 22:21:36.882838 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.882821    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab520d02-c135-4a02-9be5-7516742bfc4f-openshift-service-ca\") pod \"maas-api-5ff7bc6b84-6q99t\" (UID: \"ab520d02-c135-4a02-9be5-7516742bfc4f\") " pod="odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t"
Jul 09 22:21:36.891298 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:36.891280    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snlt9\" (UniqueName: \"kubernetes.io/projected/ab520d02-c135-4a02-9be5-7516742bfc4f-kube-api-access-snlt9\") pod \"maas-api-5ff7bc6b84-6q99t\" (UID: \"ab520d02-c135-4a02-9be5-7516742bfc4f\") " pod="odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t"
Jul 09 22:21:37.114680 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:37.114598    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:21:37.206724 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:37.206694    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:21:37.387072 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:37.386965    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab520d02-c135-4a02-9be5-7516742bfc4f-maas-api-tls\") pod \"maas-api-5ff7bc6b84-6q99t\" (UID: \"ab520d02-c135-4a02-9be5-7516742bfc4f\") " pod="odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t"
Jul 09 22:21:37.389460 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:37.389440    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab520d02-c135-4a02-9be5-7516742bfc4f-maas-api-tls\") pod \"maas-api-5ff7bc6b84-6q99t\" (UID: \"ab520d02-c135-4a02-9be5-7516742bfc4f\") " pod="odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t"
Jul 09 22:21:37.641924 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:37.641839    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t"
Jul 09 22:21:37.793799 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:37.793765    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t"]
Jul 09 22:21:37.797394 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:21:37.797364    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab520d02_c135_4a02_9be5_7516742bfc4f.slice/crio-4dfcdce2f48f55229f70bc8391150b90f1361c4626c7ec2493b7de59742d07c1 WatchSource:0}: Error finding container 4dfcdce2f48f55229f70bc8391150b90f1361c4626c7ec2493b7de59742d07c1: Status 404 returned error can't find the container with id 4dfcdce2f48f55229f70bc8391150b90f1361c4626c7ec2493b7de59742d07c1
Jul 09 22:21:37.832912 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:37.832883    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t" event={"ID":"ab520d02-c135-4a02-9be5-7516742bfc4f","Type":"ContainerStarted","Data":"4dfcdce2f48f55229f70bc8391150b90f1361c4626c7ec2493b7de59742d07c1"}
Jul 09 22:21:39.843918 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:39.843887    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t" event={"ID":"ab520d02-c135-4a02-9be5-7516742bfc4f","Type":"ContainerStarted","Data":"c35cf28c75cc1fe8d81f94cd55f5cc2ee72831cc6e43546e714af1069fbe46b8"}
Jul 09 22:21:39.844303 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:39.843949    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t"
Jul 09 22:21:39.861791 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:39.861739    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t" podStartSLOduration=2.28166621 podStartE2EDuration="3.861723351s" totalImagesPullingTime="1.580057141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:21:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:21:39.860632051 +0000 UTC m=+762.534630875" watchObservedRunningTime="2026-07-09 22:21:39.861723351 +0000 UTC m=+762.535722153"
Jul 09 22:21:45.855320 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:45.855293    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5ff7bc6b84-6q99t"
Jul 09 22:21:46.887780 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:46.887746    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:21:46.987166 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:46.987110    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:21:52.486358 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.486325    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"]
Jul 09 22:21:52.493023 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.492996    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.495727 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.495705    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 22:21:52.495727 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.495721    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 09 22:21:52.495897 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.495734    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bf8gl\""
Jul 09 22:21:52.495897 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.495749    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 22:21:52.500797 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.500776    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"]
Jul 09 22:21:52.593102 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.593071    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:21:52.618619 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.618587    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/caf12037-07e5-49e2-a101-49df8909f3bb-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.618779 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.618630    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwj92\" (UniqueName: \"kubernetes.io/projected/caf12037-07e5-49e2-a101-49df8909f3bb-kube-api-access-wwj92\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.618779 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.618661    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/caf12037-07e5-49e2-a101-49df8909f3bb-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.618779 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.618728    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/caf12037-07e5-49e2-a101-49df8909f3bb-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.618779 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.618762    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caf12037-07e5-49e2-a101-49df8909f3bb-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.618916 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.618792    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/caf12037-07e5-49e2-a101-49df8909f3bb-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.719786 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.719744    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/caf12037-07e5-49e2-a101-49df8909f3bb-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.719984 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.719799    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwj92\" (UniqueName: \"kubernetes.io/projected/caf12037-07e5-49e2-a101-49df8909f3bb-kube-api-access-wwj92\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.719984 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.719830    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/caf12037-07e5-49e2-a101-49df8909f3bb-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.719984 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.719857    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/caf12037-07e5-49e2-a101-49df8909f3bb-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.719984 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.719887    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caf12037-07e5-49e2-a101-49df8909f3bb-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.719984 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.719925    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/caf12037-07e5-49e2-a101-49df8909f3bb-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.720297 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.720272    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/caf12037-07e5-49e2-a101-49df8909f3bb-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.720353 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.720296    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caf12037-07e5-49e2-a101-49df8909f3bb-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.720451 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.720430    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/caf12037-07e5-49e2-a101-49df8909f3bb-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.722062 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.722024    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/caf12037-07e5-49e2-a101-49df8909f3bb-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.722429 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.722410    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/caf12037-07e5-49e2-a101-49df8909f3bb-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.727355 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.727332    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwj92\" (UniqueName: \"kubernetes.io/projected/caf12037-07e5-49e2-a101-49df8909f3bb-kube-api-access-wwj92\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g\" (UID: \"caf12037-07e5-49e2-a101-49df8909f3bb\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.804460 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.804369    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:21:52.936678 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:52.936535    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"]
Jul 09 22:21:52.938905 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:21:52.938872    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf12037_07e5_49e2_a101_49df8909f3bb.slice/crio-72449b7038d6f29b9c3c6e7e354d329340cacbb36cb2736cf4f2a955db495bb1 WatchSource:0}: Error finding container 72449b7038d6f29b9c3c6e7e354d329340cacbb36cb2736cf4f2a955db495bb1: Status 404 returned error can't find the container with id 72449b7038d6f29b9c3c6e7e354d329340cacbb36cb2736cf4f2a955db495bb1
Jul 09 22:21:53.911824 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:53.911788    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g" event={"ID":"caf12037-07e5-49e2-a101-49df8909f3bb","Type":"ContainerStarted","Data":"72449b7038d6f29b9c3c6e7e354d329340cacbb36cb2736cf4f2a955db495bb1"}
Jul 09 22:21:54.917464 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:54.917424    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g" event={"ID":"caf12037-07e5-49e2-a101-49df8909f3bb","Type":"ContainerStarted","Data":"1734759acb05eb6f7dfabc402843fc035b2fddbc6049ec17842e936141be80bd"}
Jul 09 22:21:54.934788 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:54.934729    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g" podStartSLOduration=1.778425709 podStartE2EDuration="2.934712209s" totalImagesPullingTime="1.1562865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:21:54.933865932 +0000 UTC m=+777.607864735" watchObservedRunningTime="2026-07-09 22:21:54.934712209 +0000 UTC m=+777.608711011"
Jul 09 22:21:57.507789 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:21:57.507758    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:22:02.805056 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:02.804993    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:22:02.805456 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:02.805081    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:22:02.817755 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:02.817726    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:22:02.965828 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:02.965801    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g"
Jul 09 22:22:06.223761 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:06.223714    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:22:19.383591 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.383518    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"]
Jul 09 22:22:19.389305 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.389286    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.391916 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.391900    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 09 22:22:19.397613 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.397590    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"]
Jul 09 22:22:19.407300 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.407279    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:22:19.420428 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.420406    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66f1e5f0-1928-42b5-9bb8-3c780f20775e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.420539 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.420443    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66f1e5f0-1928-42b5-9bb8-3c780f20775e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.420539 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.420472    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66f1e5f0-1928-42b5-9bb8-3c780f20775e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.420667 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.420543    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66f1e5f0-1928-42b5-9bb8-3c780f20775e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.420667 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.420595    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66f1e5f0-1928-42b5-9bb8-3c780f20775e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.420667 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.420634    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb8w5\" (UniqueName: \"kubernetes.io/projected/66f1e5f0-1928-42b5-9bb8-3c780f20775e-kube-api-access-wb8w5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.521593 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.521553    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66f1e5f0-1928-42b5-9bb8-3c780f20775e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.521779 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.521601    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb8w5\" (UniqueName: \"kubernetes.io/projected/66f1e5f0-1928-42b5-9bb8-3c780f20775e-kube-api-access-wb8w5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.521779 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.521671    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66f1e5f0-1928-42b5-9bb8-3c780f20775e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.521779 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.521720    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66f1e5f0-1928-42b5-9bb8-3c780f20775e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.521779 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.521755    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66f1e5f0-1928-42b5-9bb8-3c780f20775e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.521979 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.521783    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66f1e5f0-1928-42b5-9bb8-3c780f20775e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.521979 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.521956    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66f1e5f0-1928-42b5-9bb8-3c780f20775e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.522148 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.522124    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66f1e5f0-1928-42b5-9bb8-3c780f20775e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.522210 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.522152    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66f1e5f0-1928-42b5-9bb8-3c780f20775e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.523968 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.523941    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66f1e5f0-1928-42b5-9bb8-3c780f20775e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.524207 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.524190    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66f1e5f0-1928-42b5-9bb8-3c780f20775e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.530927 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.530905    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb8w5\" (UniqueName: \"kubernetes.io/projected/66f1e5f0-1928-42b5-9bb8-3c780f20775e-kube-api-access-wb8w5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht\" (UID: \"66f1e5f0-1928-42b5-9bb8-3c780f20775e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.699752 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.699666    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:19.832318 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:19.832294    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"]
Jul 09 22:22:19.834309 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:22:19.834280    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f1e5f0_1928_42b5_9bb8_3c780f20775e.slice/crio-84c1b7c26c3a2e4f4f7a7f371fc846a4dffc85658d673223cabd098509b5828a WatchSource:0}: Error finding container 84c1b7c26c3a2e4f4f7a7f371fc846a4dffc85658d673223cabd098509b5828a: Status 404 returned error can't find the container with id 84c1b7c26c3a2e4f4f7a7f371fc846a4dffc85658d673223cabd098509b5828a
Jul 09 22:22:20.033019 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:20.032993    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht" event={"ID":"66f1e5f0-1928-42b5-9bb8-3c780f20775e","Type":"ContainerStarted","Data":"84c1b7c26c3a2e4f4f7a7f371fc846a4dffc85658d673223cabd098509b5828a"}
Jul 09 22:22:21.044445 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:21.044407    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht" event={"ID":"66f1e5f0-1928-42b5-9bb8-3c780f20775e","Type":"ContainerStarted","Data":"902e37f31ddd0174108ad82f6a4bffec017933ad24beb820d28eba338cb0bc6b"}
Jul 09 22:22:21.065369 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:21.065316    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht" podStartSLOduration=1.884600603 podStartE2EDuration="2.065301092s" totalImagesPullingTime="180.700489ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:22:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:22:21.064706832 +0000 UTC m=+803.738705630" watchObservedRunningTime="2026-07-09 22:22:21.065301092 +0000 UTC m=+803.739299894"
Jul 09 22:22:29.700228 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:29.700184    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:29.700847 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:29.700294    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:29.712585 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:29.712547    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:30.102026 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.101993    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht"
Jul 09 22:22:30.700292 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.700260    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"]
Jul 09 22:22:30.706631 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.706608    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.709314 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.709284    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 09 22:22:30.711430 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.711404    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"]
Jul 09 22:22:30.726412 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.726383    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:22:30.811740 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.811707    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.811740 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.811740    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.811983 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.811771    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.811983 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.811879    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.811983 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.811925    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs7vg\" (UniqueName: \"kubernetes.io/projected/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-kube-api-access-hs7vg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.811983 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.811966    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.913210 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.913155    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.913210 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.913211    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.913508 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.913330    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.913508 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.913410    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.913508 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.913438    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs7vg\" (UniqueName: \"kubernetes.io/projected/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-kube-api-access-hs7vg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.913508 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.913472    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.913709 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.913624    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.913709 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.913696    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.913836 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.913810    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.915519 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.915494    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.915662 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.915644    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:30.921137 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:30.921119    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs7vg\" (UniqueName: \"kubernetes.io/projected/ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e-kube-api-access-hs7vg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-96zdw\" (UID: \"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:31.018369 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:31.018280    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:31.153464 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:31.153440    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"]
Jul 09 22:22:31.155435 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:22:31.155403    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff8230fe_3cc8_46bb_9d6f_6ad6a53e6d6e.slice/crio-e464a0138724d9a5b112a81c752cc4fbb5b3cc1d53930a0d043004d4311b01e2 WatchSource:0}: Error finding container e464a0138724d9a5b112a81c752cc4fbb5b3cc1d53930a0d043004d4311b01e2: Status 404 returned error can't find the container with id e464a0138724d9a5b112a81c752cc4fbb5b3cc1d53930a0d043004d4311b01e2
Jul 09 22:22:32.102526 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:32.102494    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw" event={"ID":"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e","Type":"ContainerStarted","Data":"4daa46f5ba2f2ba45fb67b9fc69bc3bff18c659186236ad4cd09841d7f666cf6"}
Jul 09 22:22:32.102952 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:32.102549    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw" event={"ID":"ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e","Type":"ContainerStarted","Data":"e464a0138724d9a5b112a81c752cc4fbb5b3cc1d53930a0d043004d4311b01e2"}
Jul 09 22:22:32.122404 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:32.122350    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw" podStartSLOduration=1.951438354 podStartE2EDuration="2.12233374s" totalImagesPullingTime="170.895386ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:22:32.120150037 +0000 UTC m=+814.794148856" watchObservedRunningTime="2026-07-09 22:22:32.12233374 +0000 UTC m=+814.796332542"
Jul 09 22:22:41.018652 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:41.018612    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:41.019110 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:41.018676    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:41.031127 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:41.031103    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:41.157168 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:41.157141    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-96zdw"
Jul 09 22:22:49.615814 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:22:49.615782    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:23:42.681025 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:23:42.680982    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:23:53.144442 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:23:53.144404    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:23:53.251356 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:23:53.251327    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:23:54.273597 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:23:54.273554    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:23:54.374568 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:23:54.374531    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:24:02.416271 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:24:02.416238    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:24:52.707650 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:24:52.707609    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:24:52.806105 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:24:52.806073    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:25:04.236395 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.236353    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:25:04.331988 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.331953    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-748d684877-z2b7g"]
Jul 09 22:25:04.332245 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.332219    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-748d684877-z2b7g" podUID="5445bed6-62ac-4150-a2d1-cc680dfc6a31" containerName="manager" containerID="cri-o://b766b7b1766c57ce500c236e84427469fb780efbfe18a4927ea9d25facfff9aa" gracePeriod=30
Jul 09 22:25:04.572220 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.572198    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-748d684877-z2b7g"
Jul 09 22:25:04.614663 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.614634    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5445bed6-62ac-4150-a2d1-cc680dfc6a31-webhook-cert\") pod \"5445bed6-62ac-4150-a2d1-cc680dfc6a31\" (UID: \"5445bed6-62ac-4150-a2d1-cc680dfc6a31\") "
Jul 09 22:25:04.614663 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.614667    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpcl4\" (UniqueName: \"kubernetes.io/projected/5445bed6-62ac-4150-a2d1-cc680dfc6a31-kube-api-access-lpcl4\") pod \"5445bed6-62ac-4150-a2d1-cc680dfc6a31\" (UID: \"5445bed6-62ac-4150-a2d1-cc680dfc6a31\") "
Jul 09 22:25:04.616687 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.616656    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5445bed6-62ac-4150-a2d1-cc680dfc6a31-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5445bed6-62ac-4150-a2d1-cc680dfc6a31" (UID: "5445bed6-62ac-4150-a2d1-cc680dfc6a31"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:25:04.616800 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.616720    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5445bed6-62ac-4150-a2d1-cc680dfc6a31-kube-api-access-lpcl4" (OuterVolumeSpecName: "kube-api-access-lpcl4") pod "5445bed6-62ac-4150-a2d1-cc680dfc6a31" (UID: "5445bed6-62ac-4150-a2d1-cc680dfc6a31"). InnerVolumeSpecName "kube-api-access-lpcl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:25:04.715521 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.715487    2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5445bed6-62ac-4150-a2d1-cc680dfc6a31-webhook-cert\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:25:04.715521 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.715514    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpcl4\" (UniqueName: \"kubernetes.io/projected/5445bed6-62ac-4150-a2d1-cc680dfc6a31-kube-api-access-lpcl4\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:25:04.828415 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.828324    2554 generic.go:356] "Generic (PLEG): container finished" podID="5445bed6-62ac-4150-a2d1-cc680dfc6a31" containerID="b766b7b1766c57ce500c236e84427469fb780efbfe18a4927ea9d25facfff9aa" exitCode=0
Jul 09 22:25:04.828415 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.828373    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-748d684877-z2b7g"
Jul 09 22:25:04.828614 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.828409    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-748d684877-z2b7g" event={"ID":"5445bed6-62ac-4150-a2d1-cc680dfc6a31","Type":"ContainerDied","Data":"b766b7b1766c57ce500c236e84427469fb780efbfe18a4927ea9d25facfff9aa"}
Jul 09 22:25:04.828614 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.828462    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-748d684877-z2b7g" event={"ID":"5445bed6-62ac-4150-a2d1-cc680dfc6a31","Type":"ContainerDied","Data":"2f2904667c558e92d13d92bea1123eeb9f6a800b2758ba2a05d2686818dde1e4"}
Jul 09 22:25:04.828614 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.828483    2554 scope.go:117] "RemoveContainer" containerID="b766b7b1766c57ce500c236e84427469fb780efbfe18a4927ea9d25facfff9aa"
Jul 09 22:25:04.837277 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.837260    2554 scope.go:117] "RemoveContainer" containerID="b766b7b1766c57ce500c236e84427469fb780efbfe18a4927ea9d25facfff9aa"
Jul 09 22:25:04.837526 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:25:04.837503    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b766b7b1766c57ce500c236e84427469fb780efbfe18a4927ea9d25facfff9aa\": container with ID starting with b766b7b1766c57ce500c236e84427469fb780efbfe18a4927ea9d25facfff9aa not found: ID does not exist" containerID="b766b7b1766c57ce500c236e84427469fb780efbfe18a4927ea9d25facfff9aa"
Jul 09 22:25:04.837573 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.837535    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b766b7b1766c57ce500c236e84427469fb780efbfe18a4927ea9d25facfff9aa"} err="failed to get container status \"b766b7b1766c57ce500c236e84427469fb780efbfe18a4927ea9d25facfff9aa\": rpc error: code = NotFound desc = could not find container \"b766b7b1766c57ce500c236e84427469fb780efbfe18a4927ea9d25facfff9aa\": container with ID starting with b766b7b1766c57ce500c236e84427469fb780efbfe18a4927ea9d25facfff9aa not found: ID does not exist"
Jul 09 22:25:04.851344 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.851325    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-748d684877-z2b7g"]
Jul 09 22:25:04.856270 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:04.856251    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-748d684877-z2b7g"]
Jul 09 22:25:05.500240 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.500211    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:25:05.611219 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.611193    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-748d684877-flrs2"]
Jul 09 22:25:05.611490 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.611478    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5445bed6-62ac-4150-a2d1-cc680dfc6a31" containerName="manager"
Jul 09 22:25:05.611532 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.611492    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5445bed6-62ac-4150-a2d1-cc680dfc6a31" containerName="manager"
Jul 09 22:25:05.611565 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.611545    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5445bed6-62ac-4150-a2d1-cc680dfc6a31" containerName="manager"
Jul 09 22:25:05.615698 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.615673    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-748d684877-flrs2"
Jul 09 22:25:05.618918 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.618899    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 22:25:05.618918 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.618910    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 22:25:05.619070 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.618978    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jvz8r\""
Jul 09 22:25:05.625003 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.624980    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-748d684877-flrs2"]
Jul 09 22:25:05.722550 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.722508    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxbcw\" (UniqueName: \"kubernetes.io/projected/a1e3bdce-eda3-4178-88f6-8cef2fdc9be6-kube-api-access-gxbcw\") pod \"maas-controller-748d684877-flrs2\" (UID: \"a1e3bdce-eda3-4178-88f6-8cef2fdc9be6\") " pod="opendatahub/maas-controller-748d684877-flrs2"
Jul 09 22:25:05.722733 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.722557    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1e3bdce-eda3-4178-88f6-8cef2fdc9be6-webhook-cert\") pod \"maas-controller-748d684877-flrs2\" (UID: \"a1e3bdce-eda3-4178-88f6-8cef2fdc9be6\") " pod="opendatahub/maas-controller-748d684877-flrs2"
Jul 09 22:25:05.823161 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.823070    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxbcw\" (UniqueName: \"kubernetes.io/projected/a1e3bdce-eda3-4178-88f6-8cef2fdc9be6-kube-api-access-gxbcw\") pod \"maas-controller-748d684877-flrs2\" (UID: \"a1e3bdce-eda3-4178-88f6-8cef2fdc9be6\") " pod="opendatahub/maas-controller-748d684877-flrs2"
Jul 09 22:25:05.823161 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.823116    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1e3bdce-eda3-4178-88f6-8cef2fdc9be6-webhook-cert\") pod \"maas-controller-748d684877-flrs2\" (UID: \"a1e3bdce-eda3-4178-88f6-8cef2fdc9be6\") " pod="opendatahub/maas-controller-748d684877-flrs2"
Jul 09 22:25:05.825584 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.825561    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1e3bdce-eda3-4178-88f6-8cef2fdc9be6-webhook-cert\") pod \"maas-controller-748d684877-flrs2\" (UID: \"a1e3bdce-eda3-4178-88f6-8cef2fdc9be6\") " pod="opendatahub/maas-controller-748d684877-flrs2"
Jul 09 22:25:05.838507 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.835300    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxbcw\" (UniqueName: \"kubernetes.io/projected/a1e3bdce-eda3-4178-88f6-8cef2fdc9be6-kube-api-access-gxbcw\") pod \"maas-controller-748d684877-flrs2\" (UID: \"a1e3bdce-eda3-4178-88f6-8cef2fdc9be6\") " pod="opendatahub/maas-controller-748d684877-flrs2"
Jul 09 22:25:05.880852 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.880815    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5445bed6-62ac-4150-a2d1-cc680dfc6a31" path="/var/lib/kubelet/pods/5445bed6-62ac-4150-a2d1-cc680dfc6a31/volumes"
Jul 09 22:25:05.926146 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:05.926117    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-748d684877-flrs2"
Jul 09 22:25:06.060494 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:06.060468    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-748d684877-flrs2"]
Jul 09 22:25:06.062441 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:25:06.062410    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e3bdce_eda3_4178_88f6_8cef2fdc9be6.slice/crio-0bc7d495cab76ca464dbb952659220945091b72e41e98a86b77ff60bc1d10b3c WatchSource:0}: Error finding container 0bc7d495cab76ca464dbb952659220945091b72e41e98a86b77ff60bc1d10b3c: Status 404 returned error can't find the container with id 0bc7d495cab76ca464dbb952659220945091b72e41e98a86b77ff60bc1d10b3c
Jul 09 22:25:06.844893 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:06.844860    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-748d684877-flrs2" event={"ID":"a1e3bdce-eda3-4178-88f6-8cef2fdc9be6","Type":"ContainerStarted","Data":"60c7f17087ca726172eb71a233b4bd1f4f7a07d77474f71d77ff85882fb995bd"}
Jul 09 22:25:06.845286 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:06.844923    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-748d684877-flrs2"
Jul 09 22:25:06.845286 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:06.844945    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-748d684877-flrs2" event={"ID":"a1e3bdce-eda3-4178-88f6-8cef2fdc9be6","Type":"ContainerStarted","Data":"0bc7d495cab76ca464dbb952659220945091b72e41e98a86b77ff60bc1d10b3c"}
Jul 09 22:25:06.863638 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:06.863589    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-748d684877-flrs2" podStartSLOduration=1.258265583 podStartE2EDuration="1.863575284s" totalImagesPullingTime="605.309701ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:25:06.861217734 +0000 UTC m=+969.535216536" watchObservedRunningTime="2026-07-09 22:25:06.863575284 +0000 UTC m=+969.537574086"
Jul 09 22:25:17.856534 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:17.856503    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-748d684877-flrs2"
Jul 09 22:25:38.996272 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:38.996235    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:25:39.149849 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:39.149813    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:25:39.266223 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:39.266124    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:25:45.012321 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:45.012285    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:25:45.081529 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:45.081482    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:25:45.172461 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:45.172431    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:25:45.271060 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:45.270955    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:25:45.370598 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:45.370561    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:25:51.315832 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:51.315799    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:25:51.377517 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:25:51.377486    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:26:59.679334 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:26:59.679252    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:28:10.624968 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:28:10.624937    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:28:10.728182 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:28:10.728151    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:28:22.970599 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:28:22.970562    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:28:23.028566 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:28:23.028531    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:29:14.612310 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:29:14.612272    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:29:15.996538 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:29:15.996495    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:29:20.337848 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:29:20.337799    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:33:37.609736 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:33:37.609695    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:33:37.694520 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:33:37.694489    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:33:59.256018 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:33:59.255985    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:34:55.890406 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:34:55.890358    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:36:12.089580 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:36:12.089501    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:36:40.794815 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:36:40.794778    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:36:48.566316 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:36:48.566281    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:36:56.835189 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:36:56.835152    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:01.929296 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:01.929264    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:04.714649 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:04.714602    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:04.817340 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:04.817305    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:05.161412 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:05.161378    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:11.202229 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:11.202191    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:11.299518 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:11.299482    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:11.482330 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:11.482248    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:11.575197 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:11.575161    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:12.621247 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:12.621217    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:12.714212 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:12.714177    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"]
Jul 09 22:37:12.717359 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:12.717338    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"
Jul 09 22:37:12.720167 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:12.720145    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b9db9547-serving-cert\""
Jul 09 22:37:12.725869 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:12.725842    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:12.735787 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:12.735766    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"]
Jul 09 22:37:12.819648 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:12.819616    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:12.840147 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:12.840114    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpnb9\" (UniqueName: \"kubernetes.io/projected/3c42ec92-c121-4770-aef5-7a77a691315a-kube-api-access-xpnb9\") pod \"maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg\" (UID: \"3c42ec92-c121-4770-aef5-7a77a691315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"
Jul 09 22:37:12.840297 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:12.840168    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c42ec92-c121-4770-aef5-7a77a691315a-openshift-service-ca\") pod \"maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg\" (UID: \"3c42ec92-c121-4770-aef5-7a77a691315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"
Jul 09 22:37:12.840297 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:12.840257    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c42ec92-c121-4770-aef5-7a77a691315a-maas-api-tls\") pod \"maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg\" (UID: \"3c42ec92-c121-4770-aef5-7a77a691315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"
Jul 09 22:37:12.941508 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:12.941414    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c42ec92-c121-4770-aef5-7a77a691315a-maas-api-tls\") pod \"maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg\" (UID: \"3c42ec92-c121-4770-aef5-7a77a691315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"
Jul 09 22:37:12.941508 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:12.941469    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpnb9\" (UniqueName: \"kubernetes.io/projected/3c42ec92-c121-4770-aef5-7a77a691315a-kube-api-access-xpnb9\") pod \"maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg\" (UID: \"3c42ec92-c121-4770-aef5-7a77a691315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"
Jul 09 22:37:12.941733 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:12.941516    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c42ec92-c121-4770-aef5-7a77a691315a-openshift-service-ca\") pod \"maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg\" (UID: \"3c42ec92-c121-4770-aef5-7a77a691315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"
Jul 09 22:37:12.942181 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:12.942162    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c42ec92-c121-4770-aef5-7a77a691315a-openshift-service-ca\") pod \"maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg\" (UID: \"3c42ec92-c121-4770-aef5-7a77a691315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"
Jul 09 22:37:12.943892 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:12.943873    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c42ec92-c121-4770-aef5-7a77a691315a-maas-api-tls\") pod \"maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg\" (UID: \"3c42ec92-c121-4770-aef5-7a77a691315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"
Jul 09 22:37:12.962584 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:12.962554    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpnb9\" (UniqueName: \"kubernetes.io/projected/3c42ec92-c121-4770-aef5-7a77a691315a-kube-api-access-xpnb9\") pod \"maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg\" (UID: \"3c42ec92-c121-4770-aef5-7a77a691315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"
Jul 09 22:37:12.970722 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:12.970696    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:13.028072 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:13.028017    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"
Jul 09 22:37:13.176572 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:37:13.176536    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c42ec92_c121_4770_aef5_7a77a691315a.slice/crio-074c739112b7e1ffd891aceac48d8fb795cda2f317e5a70d19392cb7cd2f6ce1 WatchSource:0}: Error finding container 074c739112b7e1ffd891aceac48d8fb795cda2f317e5a70d19392cb7cd2f6ce1: Status 404 returned error can't find the container with id 074c739112b7e1ffd891aceac48d8fb795cda2f317e5a70d19392cb7cd2f6ce1
Jul 09 22:37:13.176903 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:13.176879    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"]
Jul 09 22:37:13.177956 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:13.177939    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:37:13.227932 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:13.227854    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg" event={"ID":"3c42ec92-c121-4770-aef5-7a77a691315a","Type":"ContainerStarted","Data":"074c739112b7e1ffd891aceac48d8fb795cda2f317e5a70d19392cb7cd2f6ce1"}
Jul 09 22:37:13.577560 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:13.577462    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:13.679521 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:13.679488    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:14.239476 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:14.239441    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg" event={"ID":"3c42ec92-c121-4770-aef5-7a77a691315a","Type":"ContainerStarted","Data":"95a05049369d595e114f2c088d6f51d316a008dc57c7883926f0243786ea1108"}
Jul 09 22:37:14.239655 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:14.239529    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"
Jul 09 22:37:14.267075 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:14.266999    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg" podStartSLOduration=1.7458406480000002 podStartE2EDuration="2.266979809s" totalImagesPullingTime="521.139161ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:14.264783482 +0000 UTC m=+1696.938782312" watchObservedRunningTime="2026-07-09 22:37:14.266979809 +0000 UTC m=+1696.940978612"
Jul 09 22:37:15.024614 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:15.024583    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:17.662594 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:17.662558    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:17.857797 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:17.857757    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:17.954854 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:17.954746    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:18.096787 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:18.096758    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"]
Jul 09 22:37:18.096986 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:18.096957    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg" podUID="3c42ec92-c121-4770-aef5-7a77a691315a" containerName="maas-api" containerID="cri-o://95a05049369d595e114f2c088d6f51d316a008dc57c7883926f0243786ea1108" gracePeriod=30
Jul 09 22:37:18.102050 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:18.102013    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"
Jul 09 22:37:18.139755 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:18.139721    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:18.268729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:18.268700    2554 generic.go:356] "Generic (PLEG): container finished" podID="3c42ec92-c121-4770-aef5-7a77a691315a" containerID="95a05049369d595e114f2c088d6f51d316a008dc57c7883926f0243786ea1108" exitCode=0
Jul 09 22:37:18.268855 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:18.268769    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg" event={"ID":"3c42ec92-c121-4770-aef5-7a77a691315a","Type":"ContainerDied","Data":"95a05049369d595e114f2c088d6f51d316a008dc57c7883926f0243786ea1108"}
Jul 09 22:37:18.340858 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:18.340834    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"
Jul 09 22:37:18.490718 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:18.490626    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpnb9\" (UniqueName: \"kubernetes.io/projected/3c42ec92-c121-4770-aef5-7a77a691315a-kube-api-access-xpnb9\") pod \"3c42ec92-c121-4770-aef5-7a77a691315a\" (UID: \"3c42ec92-c121-4770-aef5-7a77a691315a\") "
Jul 09 22:37:18.490718 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:18.490697    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c42ec92-c121-4770-aef5-7a77a691315a-openshift-service-ca\") pod \"3c42ec92-c121-4770-aef5-7a77a691315a\" (UID: \"3c42ec92-c121-4770-aef5-7a77a691315a\") "
Jul 09 22:37:18.491249 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:18.490859    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c42ec92-c121-4770-aef5-7a77a691315a-maas-api-tls\") pod \"3c42ec92-c121-4770-aef5-7a77a691315a\" (UID: \"3c42ec92-c121-4770-aef5-7a77a691315a\") "
Jul 09 22:37:18.491249 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:18.491096    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c42ec92-c121-4770-aef5-7a77a691315a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3c42ec92-c121-4770-aef5-7a77a691315a" (UID: "3c42ec92-c121-4770-aef5-7a77a691315a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:37:18.491463 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:18.491313    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c42ec92-c121-4770-aef5-7a77a691315a-openshift-service-ca\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:37:18.492892 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:18.492866    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c42ec92-c121-4770-aef5-7a77a691315a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3c42ec92-c121-4770-aef5-7a77a691315a" (UID: "3c42ec92-c121-4770-aef5-7a77a691315a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:37:18.492949 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:18.492870    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c42ec92-c121-4770-aef5-7a77a691315a-kube-api-access-xpnb9" (OuterVolumeSpecName: "kube-api-access-xpnb9") pod "3c42ec92-c121-4770-aef5-7a77a691315a" (UID: "3c42ec92-c121-4770-aef5-7a77a691315a"). InnerVolumeSpecName "kube-api-access-xpnb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:37:18.592616 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:18.592570    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c42ec92-c121-4770-aef5-7a77a691315a-maas-api-tls\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:37:18.592616 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:18.592613    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpnb9\" (UniqueName: \"kubernetes.io/projected/3c42ec92-c121-4770-aef5-7a77a691315a-kube-api-access-xpnb9\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:37:19.274818 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:19.274731    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"
Jul 09 22:37:19.274818 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:19.274741    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg" event={"ID":"3c42ec92-c121-4770-aef5-7a77a691315a","Type":"ContainerDied","Data":"074c739112b7e1ffd891aceac48d8fb795cda2f317e5a70d19392cb7cd2f6ce1"}
Jul 09 22:37:19.274818 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:19.274806    2554 scope.go:117] "RemoveContainer" containerID="95a05049369d595e114f2c088d6f51d316a008dc57c7883926f0243786ea1108"
Jul 09 22:37:19.299173 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:19.299152    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"]
Jul 09 22:37:19.304609 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:19.304588    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b9db9547-7c5c6ff685-4qgdg"]
Jul 09 22:37:19.881045 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:19.880993    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c42ec92-c121-4770-aef5-7a77a691315a" path="/var/lib/kubelet/pods/3c42ec92-c121-4770-aef5-7a77a691315a/volumes"
Jul 09 22:37:21.064373 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:21.064340    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:23.986510 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:23.986474    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:24.072404 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:24.072372    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:24.256227 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:24.256144    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:24.345079 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:24.345020    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:25.439225 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.439186    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:25.576003 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.575968    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:25.674242 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.674210    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"]
Jul 09 22:37:25.674516 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.674504    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c42ec92-c121-4770-aef5-7a77a691315a" containerName="maas-api"
Jul 09 22:37:25.674560 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.674517    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c42ec92-c121-4770-aef5-7a77a691315a" containerName="maas-api"
Jul 09 22:37:25.674595 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.674575    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c42ec92-c121-4770-aef5-7a77a691315a" containerName="maas-api"
Jul 09 22:37:25.678920 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.678904    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"
Jul 09 22:37:25.682183 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.682162    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e594723c-serving-cert\""
Jul 09 22:37:25.698542 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.698490    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"]
Jul 09 22:37:25.770949 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.770914    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:25.853200 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.853169    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbrtz\" (UniqueName: \"kubernetes.io/projected/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-kube-api-access-cbrtz\") pod \"maas-api-e2e-ait-e594723c-96d4cfbf-c7snh\" (UID: \"0384dbdc-c670-48aa-99dc-a9fbf3a343d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"
Jul 09 22:37:25.853200 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.853204    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-openshift-service-ca\") pod \"maas-api-e2e-ait-e594723c-96d4cfbf-c7snh\" (UID: \"0384dbdc-c670-48aa-99dc-a9fbf3a343d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"
Jul 09 22:37:25.853449 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.853227    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-maas-api-tls\") pod \"maas-api-e2e-ait-e594723c-96d4cfbf-c7snh\" (UID: \"0384dbdc-c670-48aa-99dc-a9fbf3a343d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"
Jul 09 22:37:25.954319 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.954233    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbrtz\" (UniqueName: \"kubernetes.io/projected/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-kube-api-access-cbrtz\") pod \"maas-api-e2e-ait-e594723c-96d4cfbf-c7snh\" (UID: \"0384dbdc-c670-48aa-99dc-a9fbf3a343d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"
Jul 09 22:37:25.954319 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.954268    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-openshift-service-ca\") pod \"maas-api-e2e-ait-e594723c-96d4cfbf-c7snh\" (UID: \"0384dbdc-c670-48aa-99dc-a9fbf3a343d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"
Jul 09 22:37:25.954319 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.954294    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-maas-api-tls\") pod \"maas-api-e2e-ait-e594723c-96d4cfbf-c7snh\" (UID: \"0384dbdc-c670-48aa-99dc-a9fbf3a343d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"
Jul 09 22:37:25.954699 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:37:25.954417    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-serving-cert: secret "maas-api-e2e-ait-e594723c-serving-cert" not found
Jul 09 22:37:25.954699 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:37:25.954481    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-maas-api-tls podName:0384dbdc-c670-48aa-99dc-a9fbf3a343d6 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:26.45446187 +0000 UTC m=+1709.128460669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-maas-api-tls") pod "maas-api-e2e-ait-e594723c-96d4cfbf-c7snh" (UID: "0384dbdc-c670-48aa-99dc-a9fbf3a343d6") : secret "maas-api-e2e-ait-e594723c-serving-cert" not found
Jul 09 22:37:25.955017 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.954993    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-openshift-service-ca\") pod \"maas-api-e2e-ait-e594723c-96d4cfbf-c7snh\" (UID: \"0384dbdc-c670-48aa-99dc-a9fbf3a343d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"
Jul 09 22:37:25.983774 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:25.983750    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbrtz\" (UniqueName: \"kubernetes.io/projected/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-kube-api-access-cbrtz\") pod \"maas-api-e2e-ait-e594723c-96d4cfbf-c7snh\" (UID: \"0384dbdc-c670-48aa-99dc-a9fbf3a343d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"
Jul 09 22:37:26.110558 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:26.110525    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:26.459151 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:26.459107    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-maas-api-tls\") pod \"maas-api-e2e-ait-e594723c-96d4cfbf-c7snh\" (UID: \"0384dbdc-c670-48aa-99dc-a9fbf3a343d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"
Jul 09 22:37:26.461638 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:26.461608    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-maas-api-tls\") pod \"maas-api-e2e-ait-e594723c-96d4cfbf-c7snh\" (UID: \"0384dbdc-c670-48aa-99dc-a9fbf3a343d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"
Jul 09 22:37:26.571918 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:26.571872    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:26.589112 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:26.589082    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"
Jul 09 22:37:26.676195 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:26.676165    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:26.735184 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:26.735156    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"]
Jul 09 22:37:26.738170 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:37:26.737284    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0384dbdc_c670_48aa_99dc_a9fbf3a343d6.slice/crio-d8e5cfd1363a2fd9c63ab19a2f445a521bc385a98c0af5b7f6fdd7dc07b214f1 WatchSource:0}: Error finding container d8e5cfd1363a2fd9c63ab19a2f445a521bc385a98c0af5b7f6fdd7dc07b214f1: Status 404 returned error can't find the container with id d8e5cfd1363a2fd9c63ab19a2f445a521bc385a98c0af5b7f6fdd7dc07b214f1
Jul 09 22:37:27.320060 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:27.317103    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh" event={"ID":"0384dbdc-c670-48aa-99dc-a9fbf3a343d6","Type":"ContainerStarted","Data":"f71e580178838e407136eb1cd90386b6b6ae843514c27f145d48432731408f72"}
Jul 09 22:37:27.320060 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:27.317167    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh" event={"ID":"0384dbdc-c670-48aa-99dc-a9fbf3a343d6","Type":"ContainerStarted","Data":"d8e5cfd1363a2fd9c63ab19a2f445a521bc385a98c0af5b7f6fdd7dc07b214f1"}
Jul 09 22:37:27.320060 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:27.317873    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"
Jul 09 22:37:27.342444 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:27.342319    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh" podStartSLOduration=2.007053484 podStartE2EDuration="2.342299842s" totalImagesPullingTime="335.246358ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:27.342106393 +0000 UTC m=+1710.016105197" watchObservedRunningTime="2026-07-09 22:37:27.342299842 +0000 UTC m=+1710.016298645"
Jul 09 22:37:27.361987 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:27.361951    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:30.460165 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:30.460129    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:30.798260 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:30.798171    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"]
Jul 09 22:37:30.798423 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:30.798350    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh" podUID="0384dbdc-c670-48aa-99dc-a9fbf3a343d6" containerName="maas-api" containerID="cri-o://f71e580178838e407136eb1cd90386b6b6ae843514c27f145d48432731408f72" gracePeriod=30
Jul 09 22:37:30.827818 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:30.827791    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:31.034728 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.034688    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"
Jul 09 22:37:31.099204 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.099178    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-openshift-service-ca\") pod \"0384dbdc-c670-48aa-99dc-a9fbf3a343d6\" (UID: \"0384dbdc-c670-48aa-99dc-a9fbf3a343d6\") "
Jul 09 22:37:31.099369 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.099215    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbrtz\" (UniqueName: \"kubernetes.io/projected/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-kube-api-access-cbrtz\") pod \"0384dbdc-c670-48aa-99dc-a9fbf3a343d6\" (UID: \"0384dbdc-c670-48aa-99dc-a9fbf3a343d6\") "
Jul 09 22:37:31.099369 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.099340    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-maas-api-tls\") pod \"0384dbdc-c670-48aa-99dc-a9fbf3a343d6\" (UID: \"0384dbdc-c670-48aa-99dc-a9fbf3a343d6\") "
Jul 09 22:37:31.099612 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.099581    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0384dbdc-c670-48aa-99dc-a9fbf3a343d6" (UID: "0384dbdc-c670-48aa-99dc-a9fbf3a343d6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:37:31.101319 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.101296    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-kube-api-access-cbrtz" (OuterVolumeSpecName: "kube-api-access-cbrtz") pod "0384dbdc-c670-48aa-99dc-a9fbf3a343d6" (UID: "0384dbdc-c670-48aa-99dc-a9fbf3a343d6"). InnerVolumeSpecName "kube-api-access-cbrtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:37:31.101491 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.101472    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0384dbdc-c670-48aa-99dc-a9fbf3a343d6" (UID: "0384dbdc-c670-48aa-99dc-a9fbf3a343d6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:37:31.200586 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.200555    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-maas-api-tls\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:37:31.200586 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.200585    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-openshift-service-ca\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:37:31.200586 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.200594    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbrtz\" (UniqueName: \"kubernetes.io/projected/0384dbdc-c670-48aa-99dc-a9fbf3a343d6-kube-api-access-cbrtz\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:37:31.337890 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.337853    2554 generic.go:356] "Generic (PLEG): container finished" podID="0384dbdc-c670-48aa-99dc-a9fbf3a343d6" containerID="f71e580178838e407136eb1cd90386b6b6ae843514c27f145d48432731408f72" exitCode=0
Jul 09 22:37:31.338103 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.337897    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"
Jul 09 22:37:31.338103 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.337907    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh" event={"ID":"0384dbdc-c670-48aa-99dc-a9fbf3a343d6","Type":"ContainerDied","Data":"f71e580178838e407136eb1cd90386b6b6ae843514c27f145d48432731408f72"}
Jul 09 22:37:31.338103 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.337984    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh" event={"ID":"0384dbdc-c670-48aa-99dc-a9fbf3a343d6","Type":"ContainerDied","Data":"d8e5cfd1363a2fd9c63ab19a2f445a521bc385a98c0af5b7f6fdd7dc07b214f1"}
Jul 09 22:37:31.338103 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.338013    2554 scope.go:117] "RemoveContainer" containerID="f71e580178838e407136eb1cd90386b6b6ae843514c27f145d48432731408f72"
Jul 09 22:37:31.347288 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.347270    2554 scope.go:117] "RemoveContainer" containerID="f71e580178838e407136eb1cd90386b6b6ae843514c27f145d48432731408f72"
Jul 09 22:37:31.347544 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:37:31.347520    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f71e580178838e407136eb1cd90386b6b6ae843514c27f145d48432731408f72\": container with ID starting with f71e580178838e407136eb1cd90386b6b6ae843514c27f145d48432731408f72 not found: ID does not exist" containerID="f71e580178838e407136eb1cd90386b6b6ae843514c27f145d48432731408f72"
Jul 09 22:37:31.347602 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.347551    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f71e580178838e407136eb1cd90386b6b6ae843514c27f145d48432731408f72"} err="failed to get container status \"f71e580178838e407136eb1cd90386b6b6ae843514c27f145d48432731408f72\": rpc error: code = NotFound desc = could not find container \"f71e580178838e407136eb1cd90386b6b6ae843514c27f145d48432731408f72\": container with ID starting with f71e580178838e407136eb1cd90386b6b6ae843514c27f145d48432731408f72 not found: ID does not exist"
Jul 09 22:37:31.362169 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.362095    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"]
Jul 09 22:37:31.366530 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.366508    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e594723c-96d4cfbf-c7snh"]
Jul 09 22:37:31.881990 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:31.881959    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0384dbdc-c670-48aa-99dc-a9fbf3a343d6" path="/var/lib/kubelet/pods/0384dbdc-c670-48aa-99dc-a9fbf3a343d6/volumes"
Jul 09 22:37:36.539320 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:36.539290    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:36.634496 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:36.634462    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:42.768604 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:42.768570    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:42.840363 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:42.840328    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:43.031523 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:43.031440    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:43.804952 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:43.804916    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:43.908186 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:43.908137    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:44.222565 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.222528    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:44.319074 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.319016    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:44.427020 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.426984    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"]
Jul 09 22:37:44.427458 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.427439    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0384dbdc-c670-48aa-99dc-a9fbf3a343d6" containerName="maas-api"
Jul 09 22:37:44.427458 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.427459    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0384dbdc-c670-48aa-99dc-a9fbf3a343d6" containerName="maas-api"
Jul 09 22:37:44.427596 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.427553    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0384dbdc-c670-48aa-99dc-a9fbf3a343d6" containerName="maas-api"
Jul 09 22:37:44.431921 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.431905    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"
Jul 09 22:37:44.434250 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.434231    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-b48c91c5-serving-cert\""
Jul 09 22:37:44.440985 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.440965    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"]
Jul 09 22:37:44.477239 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.477157    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:44.515384 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.515349    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-maas-api-tls\") pod \"maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp\" (UID: \"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"
Jul 09 22:37:44.515559 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.515394    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-openshift-service-ca\") pod \"maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp\" (UID: \"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"
Jul 09 22:37:44.515559 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.515455    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzlj9\" (UniqueName: \"kubernetes.io/projected/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-kube-api-access-pzlj9\") pod \"maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp\" (UID: \"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"
Jul 09 22:37:44.616571 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.616517    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-maas-api-tls\") pod \"maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp\" (UID: \"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"
Jul 09 22:37:44.616571 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.616576    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-openshift-service-ca\") pod \"maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp\" (UID: \"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"
Jul 09 22:37:44.616777 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.616608    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzlj9\" (UniqueName: \"kubernetes.io/projected/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-kube-api-access-pzlj9\") pod \"maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp\" (UID: \"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"
Jul 09 22:37:44.617273 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.617253    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-openshift-service-ca\") pod \"maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp\" (UID: \"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"
Jul 09 22:37:44.618988 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.618960    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-maas-api-tls\") pod \"maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp\" (UID: \"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"
Jul 09 22:37:44.625384 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.625358    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzlj9\" (UniqueName: \"kubernetes.io/projected/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-kube-api-access-pzlj9\") pod \"maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp\" (UID: \"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"
Jul 09 22:37:44.651335 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.651300    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:44.744214 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.744124    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"
Jul 09 22:37:44.883960 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:44.883936    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"]
Jul 09 22:37:44.886476 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:37:44.886447    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b9c9dd_0fca_4058_bb6a_6b52cd3df4f8.slice/crio-08c6eb05b255dd955e09eed6a71a8cc2016e8306c40deec8258ac884c6e2cc7a WatchSource:0}: Error finding container 08c6eb05b255dd955e09eed6a71a8cc2016e8306c40deec8258ac884c6e2cc7a: Status 404 returned error can't find the container with id 08c6eb05b255dd955e09eed6a71a8cc2016e8306c40deec8258ac884c6e2cc7a
Jul 09 22:37:45.055269 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:45.055184    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:45.151423 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:45.151384    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:45.407516 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:45.407483    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp" event={"ID":"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8","Type":"ContainerStarted","Data":"04fc2b2e5438a67f58a65f4efd4cd15cd7ba38e1c3f0cea428d369ba6844d860"}
Jul 09 22:37:45.407709 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:45.407532    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp" event={"ID":"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8","Type":"ContainerStarted","Data":"08c6eb05b255dd955e09eed6a71a8cc2016e8306c40deec8258ac884c6e2cc7a"}
Jul 09 22:37:45.407709 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:45.407616    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"
Jul 09 22:37:45.429559 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:45.429511    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp" podStartSLOduration=1.118674691 podStartE2EDuration="1.429496095s" totalImagesPullingTime="310.821404ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:45.428661348 +0000 UTC m=+1728.102660149" watchObservedRunningTime="2026-07-09 22:37:45.429496095 +0000 UTC m=+1728.103494966"
Jul 09 22:37:47.281875 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:47.281837    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:48.571457 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:48.571420    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:48.758900 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:48.758858    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:48.862090 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:48.862053    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:49.016437 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.016402    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"]
Jul 09 22:37:49.016717 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.016689    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp" podUID="82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8" containerName="maas-api" containerID="cri-o://04fc2b2e5438a67f58a65f4efd4cd15cd7ba38e1c3f0cea428d369ba6844d860" gracePeriod=30
Jul 09 22:37:49.040119 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.040075    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:49.261013 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.260988    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"
Jul 09 22:37:49.358420 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.358385    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzlj9\" (UniqueName: \"kubernetes.io/projected/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-kube-api-access-pzlj9\") pod \"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8\" (UID: \"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8\") "
Jul 09 22:37:49.358611 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.358436    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-openshift-service-ca\") pod \"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8\" (UID: \"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8\") "
Jul 09 22:37:49.358611 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.358458    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-maas-api-tls\") pod \"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8\" (UID: \"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8\") "
Jul 09 22:37:49.358763 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.358740    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8" (UID: "82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:37:49.360531 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.360509    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8" (UID: "82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:37:49.360632 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.360534    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-kube-api-access-pzlj9" (OuterVolumeSpecName: "kube-api-access-pzlj9") pod "82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8" (UID: "82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8"). InnerVolumeSpecName "kube-api-access-pzlj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:37:49.429698 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.429612    2554 generic.go:356] "Generic (PLEG): container finished" podID="82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8" containerID="04fc2b2e5438a67f58a65f4efd4cd15cd7ba38e1c3f0cea428d369ba6844d860" exitCode=0
Jul 09 22:37:49.429698 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.429657    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"
Jul 09 22:37:49.429879 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.429696    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp" event={"ID":"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8","Type":"ContainerDied","Data":"04fc2b2e5438a67f58a65f4efd4cd15cd7ba38e1c3f0cea428d369ba6844d860"}
Jul 09 22:37:49.429879 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.429750    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp" event={"ID":"82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8","Type":"ContainerDied","Data":"08c6eb05b255dd955e09eed6a71a8cc2016e8306c40deec8258ac884c6e2cc7a"}
Jul 09 22:37:49.429879 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.429773    2554 scope.go:117] "RemoveContainer" containerID="04fc2b2e5438a67f58a65f4efd4cd15cd7ba38e1c3f0cea428d369ba6844d860"
Jul 09 22:37:49.440435 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.440420    2554 scope.go:117] "RemoveContainer" containerID="04fc2b2e5438a67f58a65f4efd4cd15cd7ba38e1c3f0cea428d369ba6844d860"
Jul 09 22:37:49.440741 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:37:49.440718    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04fc2b2e5438a67f58a65f4efd4cd15cd7ba38e1c3f0cea428d369ba6844d860\": container with ID starting with 04fc2b2e5438a67f58a65f4efd4cd15cd7ba38e1c3f0cea428d369ba6844d860 not found: ID does not exist" containerID="04fc2b2e5438a67f58a65f4efd4cd15cd7ba38e1c3f0cea428d369ba6844d860"
Jul 09 22:37:49.440798 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.440752    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04fc2b2e5438a67f58a65f4efd4cd15cd7ba38e1c3f0cea428d369ba6844d860"} err="failed to get container status \"04fc2b2e5438a67f58a65f4efd4cd15cd7ba38e1c3f0cea428d369ba6844d860\": rpc error: code = NotFound desc = could not find container \"04fc2b2e5438a67f58a65f4efd4cd15cd7ba38e1c3f0cea428d369ba6844d860\": container with ID starting with 04fc2b2e5438a67f58a65f4efd4cd15cd7ba38e1c3f0cea428d369ba6844d860 not found: ID does not exist"
Jul 09 22:37:49.459582 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.459560    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-maas-api-tls\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:37:49.459652 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.459582    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzlj9\" (UniqueName: \"kubernetes.io/projected/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-kube-api-access-pzlj9\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:37:49.459652 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.459592    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8-openshift-service-ca\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:37:49.464885 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.464861    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"]
Jul 09 22:37:49.477770 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.477747    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b48c91c5-7845cdc54c-hj5fp"]
Jul 09 22:37:49.881646 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:49.881613    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8" path="/var/lib/kubelet/pods/82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8/volumes"
Jul 09 22:37:50.309304 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:50.309276    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:54.884267 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:54.884229    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:54.984653 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:54.984614    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:55.387957 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:55.387894    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:55.480397 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:55.480367    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:55.583466 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:55.583434    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:37:57.010983 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:37:57.010949    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:38:03.437874 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:38:03.437830    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:38:03.548198 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:38:03.548159    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:38:03.665735 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:38:03.665705    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:38:03.761586 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:38:03.761507    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:38:04.164702 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:38:04.164664    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:38:30.126300 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:38:30.126267    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:38:36.969930 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:38:36.969896    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:38:37.096231 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:38:37.096191    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:38:37.204028 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:38:37.203993    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:38:53.082116 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:38:53.082005    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:38:59.067490 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:38:59.067452    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:38:59.180817 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:38:59.180782    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:38:59.295581 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:38:59.295550    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:09.806536 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:09.806496    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:10.633666 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:10.633622    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:16.537248 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:16.537206    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:16.643562 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:16.643522    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:16.736536 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:16.736482    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:16.839802 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:16.839707    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:17.653022 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:17.652992    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:17.742769 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:17.742736    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:17.847181 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:17.847153    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:19.534060 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:19.534004    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:25.417630 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:25.417598    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:25.517328 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:25.517287    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:26.152136 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:26.152102    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:32.201142 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:32.201110    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:32.302616 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:32.302578    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:32.436478 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:32.436445    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:32.779115 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:32.779081    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:33.109226 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:33.109192    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:35.804328 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:35.804285    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:35.966386 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:35.966347    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:36.063169 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.063088    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"]
Jul 09 22:39:36.063629 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.063607    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8" containerName="maas-api"
Jul 09 22:39:36.063727 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.063633    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8" containerName="maas-api"
Jul 09 22:39:36.063727 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.063719    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="82b9c9dd-0fca-4058-bb6a-6b52cd3df4f8" containerName="maas-api"
Jul 09 22:39:36.066563 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.066546    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"
Jul 09 22:39:36.069460 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.069440    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b2036d22-serving-cert\""
Jul 09 22:39:36.085416 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.085391    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"]
Jul 09 22:39:36.123456 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.123423    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:36.180770 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.180738    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bf3684c-eb0f-4857-aa69-59ab216df495-openshift-service-ca\") pod \"maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2\" (UID: \"3bf3684c-eb0f-4857-aa69-59ab216df495\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"
Jul 09 22:39:36.180938 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.180779    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bf3684c-eb0f-4857-aa69-59ab216df495-maas-api-tls\") pod \"maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2\" (UID: \"3bf3684c-eb0f-4857-aa69-59ab216df495\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"
Jul 09 22:39:36.180938 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.180867    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chpsb\" (UniqueName: \"kubernetes.io/projected/3bf3684c-eb0f-4857-aa69-59ab216df495-kube-api-access-chpsb\") pod \"maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2\" (UID: \"3bf3684c-eb0f-4857-aa69-59ab216df495\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"
Jul 09 22:39:36.239359 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.239317    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:36.281705 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.281676    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chpsb\" (UniqueName: \"kubernetes.io/projected/3bf3684c-eb0f-4857-aa69-59ab216df495-kube-api-access-chpsb\") pod \"maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2\" (UID: \"3bf3684c-eb0f-4857-aa69-59ab216df495\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"
Jul 09 22:39:36.281900 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.281724    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bf3684c-eb0f-4857-aa69-59ab216df495-openshift-service-ca\") pod \"maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2\" (UID: \"3bf3684c-eb0f-4857-aa69-59ab216df495\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"
Jul 09 22:39:36.281900 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.281749    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bf3684c-eb0f-4857-aa69-59ab216df495-maas-api-tls\") pod \"maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2\" (UID: \"3bf3684c-eb0f-4857-aa69-59ab216df495\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"
Jul 09 22:39:36.282403 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.282379    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bf3684c-eb0f-4857-aa69-59ab216df495-openshift-service-ca\") pod \"maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2\" (UID: \"3bf3684c-eb0f-4857-aa69-59ab216df495\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"
Jul 09 22:39:36.284247 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.284229    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bf3684c-eb0f-4857-aa69-59ab216df495-maas-api-tls\") pod \"maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2\" (UID: \"3bf3684c-eb0f-4857-aa69-59ab216df495\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"
Jul 09 22:39:36.289929 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.289903    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chpsb\" (UniqueName: \"kubernetes.io/projected/3bf3684c-eb0f-4857-aa69-59ab216df495-kube-api-access-chpsb\") pod \"maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2\" (UID: \"3bf3684c-eb0f-4857-aa69-59ab216df495\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"
Jul 09 22:39:36.376932 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.376899    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"
Jul 09 22:39:36.509670 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.509647    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"]
Jul 09 22:39:36.511116 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:39:36.511089    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf3684c_eb0f_4857_aa69_59ab216df495.slice/crio-7ce861d6173fc477fd5335a009dbbdba630a63ae10c67a945d62bb1ff18f3bd0 WatchSource:0}: Error finding container 7ce861d6173fc477fd5335a009dbbdba630a63ae10c67a945d62bb1ff18f3bd0: Status 404 returned error can't find the container with id 7ce861d6173fc477fd5335a009dbbdba630a63ae10c67a945d62bb1ff18f3bd0
Jul 09 22:39:36.658642 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.658551    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:36.766858 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.766829    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:36.939632 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:36.939548    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2" event={"ID":"3bf3684c-eb0f-4857-aa69-59ab216df495","Type":"ContainerStarted","Data":"7ce861d6173fc477fd5335a009dbbdba630a63ae10c67a945d62bb1ff18f3bd0"}
Jul 09 22:39:37.945934 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:37.945901    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2" event={"ID":"3bf3684c-eb0f-4857-aa69-59ab216df495","Type":"ContainerStarted","Data":"7687b4855a46ac098bfbed7db6e40f6e615b6c2ef80196988ce42117ed66583f"}
Jul 09 22:39:37.946358 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:37.945971    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"
Jul 09 22:39:37.971745 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:37.971679    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2" podStartSLOduration=1.106267007 podStartE2EDuration="1.971654584s" totalImagesPullingTime="865.387577ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:39:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:39:37.970867831 +0000 UTC m=+1840.644866640" watchObservedRunningTime="2026-07-09 22:39:37.971654584 +0000 UTC m=+1840.645653387"
Jul 09 22:39:40.265435 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:40.265398    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:40.972011 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:40.971948    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:41.184923 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:41.184887    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:41.394285 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:41.394250    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:43.957060 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:43.957005    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"
Jul 09 22:39:47.400816 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:47.400783    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:47.499503 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:47.499469    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:47.837574 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:47.837483    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:48.242441 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:48.242412    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:48.335745 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:48.335708    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"]
Jul 09 22:39:48.336286 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:48.336254    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2" podUID="3bf3684c-eb0f-4857-aa69-59ab216df495" containerName="maas-api" containerID="cri-o://7687b4855a46ac098bfbed7db6e40f6e615b6c2ef80196988ce42117ed66583f" gracePeriod=30
Jul 09 22:39:48.370521 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:48.370496    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:48.576288 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:48.576266    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"
Jul 09 22:39:48.687192 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:48.687161    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chpsb\" (UniqueName: \"kubernetes.io/projected/3bf3684c-eb0f-4857-aa69-59ab216df495-kube-api-access-chpsb\") pod \"3bf3684c-eb0f-4857-aa69-59ab216df495\" (UID: \"3bf3684c-eb0f-4857-aa69-59ab216df495\") "
Jul 09 22:39:48.687357 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:48.687202    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bf3684c-eb0f-4857-aa69-59ab216df495-maas-api-tls\") pod \"3bf3684c-eb0f-4857-aa69-59ab216df495\" (UID: \"3bf3684c-eb0f-4857-aa69-59ab216df495\") "
Jul 09 22:39:48.687357 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:48.687261    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bf3684c-eb0f-4857-aa69-59ab216df495-openshift-service-ca\") pod \"3bf3684c-eb0f-4857-aa69-59ab216df495\" (UID: \"3bf3684c-eb0f-4857-aa69-59ab216df495\") "
Jul 09 22:39:48.687652 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:48.687624    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bf3684c-eb0f-4857-aa69-59ab216df495-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3bf3684c-eb0f-4857-aa69-59ab216df495" (UID: "3bf3684c-eb0f-4857-aa69-59ab216df495"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:39:48.689328 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:48.689296    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bf3684c-eb0f-4857-aa69-59ab216df495-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3bf3684c-eb0f-4857-aa69-59ab216df495" (UID: "3bf3684c-eb0f-4857-aa69-59ab216df495"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:39:48.689403 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:48.689328    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bf3684c-eb0f-4857-aa69-59ab216df495-kube-api-access-chpsb" (OuterVolumeSpecName: "kube-api-access-chpsb") pod "3bf3684c-eb0f-4857-aa69-59ab216df495" (UID: "3bf3684c-eb0f-4857-aa69-59ab216df495"). InnerVolumeSpecName "kube-api-access-chpsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:39:48.788060 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:48.787951    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bf3684c-eb0f-4857-aa69-59ab216df495-openshift-service-ca\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:39:48.788060 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:48.787981    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chpsb\" (UniqueName: \"kubernetes.io/projected/3bf3684c-eb0f-4857-aa69-59ab216df495-kube-api-access-chpsb\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:39:48.788060 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:48.787991    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bf3684c-eb0f-4857-aa69-59ab216df495-maas-api-tls\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:39:49.000690 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:49.000653    2554 generic.go:356] "Generic (PLEG): container finished" podID="3bf3684c-eb0f-4857-aa69-59ab216df495" containerID="7687b4855a46ac098bfbed7db6e40f6e615b6c2ef80196988ce42117ed66583f" exitCode=0
Jul 09 22:39:49.000892 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:49.000701    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"
Jul 09 22:39:49.000892 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:49.000736    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2" event={"ID":"3bf3684c-eb0f-4857-aa69-59ab216df495","Type":"ContainerDied","Data":"7687b4855a46ac098bfbed7db6e40f6e615b6c2ef80196988ce42117ed66583f"}
Jul 09 22:39:49.000892 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:49.000788    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2" event={"ID":"3bf3684c-eb0f-4857-aa69-59ab216df495","Type":"ContainerDied","Data":"7ce861d6173fc477fd5335a009dbbdba630a63ae10c67a945d62bb1ff18f3bd0"}
Jul 09 22:39:49.000892 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:49.000812    2554 scope.go:117] "RemoveContainer" containerID="7687b4855a46ac098bfbed7db6e40f6e615b6c2ef80196988ce42117ed66583f"
Jul 09 22:39:49.010119 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:49.010101    2554 scope.go:117] "RemoveContainer" containerID="7687b4855a46ac098bfbed7db6e40f6e615b6c2ef80196988ce42117ed66583f"
Jul 09 22:39:49.010349 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:39:49.010324    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7687b4855a46ac098bfbed7db6e40f6e615b6c2ef80196988ce42117ed66583f\": container with ID starting with 7687b4855a46ac098bfbed7db6e40f6e615b6c2ef80196988ce42117ed66583f not found: ID does not exist" containerID="7687b4855a46ac098bfbed7db6e40f6e615b6c2ef80196988ce42117ed66583f"
Jul 09 22:39:49.010396 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:49.010357    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7687b4855a46ac098bfbed7db6e40f6e615b6c2ef80196988ce42117ed66583f"} err="failed to get container status \"7687b4855a46ac098bfbed7db6e40f6e615b6c2ef80196988ce42117ed66583f\": rpc error: code = NotFound desc = could not find container \"7687b4855a46ac098bfbed7db6e40f6e615b6c2ef80196988ce42117ed66583f\": container with ID starting with 7687b4855a46ac098bfbed7db6e40f6e615b6c2ef80196988ce42117ed66583f not found: ID does not exist"
Jul 09 22:39:49.023856 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:49.023834    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"]
Jul 09 22:39:49.028001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:49.027980    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2036d22-58b648f8dc-27jh2"]
Jul 09 22:39:49.881146 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:49.881117    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bf3684c-eb0f-4857-aa69-59ab216df495" path="/var/lib/kubelet/pods/3bf3684c-eb0f-4857-aa69-59ab216df495/volumes"
Jul 09 22:39:54.172215 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:54.172173    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:54.276611 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:54.276577    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:54.415575 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:54.415536    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:54.627728 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:54.627693    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:54.745610 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:54.745580    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:54.847621 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:54.847586    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:39:54.966733 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:39:54.966646    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:00.776902 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:00.776866    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:03.229053 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:03.229001    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:06.972003 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:06.971973    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:07.037258 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:07.037220    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:13.801879 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:13.801831    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:14.155533 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.155504    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"]
Jul 09 22:40:14.155877 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.155865    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf3684c-eb0f-4857-aa69-59ab216df495" containerName="maas-api"
Jul 09 22:40:14.155922 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.155879    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf3684c-eb0f-4857-aa69-59ab216df495" containerName="maas-api"
Jul 09 22:40:14.155956 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.155928    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bf3684c-eb0f-4857-aa69-59ab216df495" containerName="maas-api"
Jul 09 22:40:14.158845 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.158825    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.165837 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.165817    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f040043d-openshift-default-dockercfg-kc4q5\""
Jul 09 22:40:14.184352 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.184324    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"]
Jul 09 22:40:14.196516 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.196492    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-data\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.196663 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.196534    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9sh5\" (UniqueName: \"kubernetes.io/projected/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-kube-api-access-s9sh5\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.196663 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.196554    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-workload-certs\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.196663 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.196592    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-envoy\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.196784 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.196663    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-token\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.196784 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.196695    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-credential-socket\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.196784 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.196723    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-podinfo\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.196784 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.196738    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istiod-ca-cert\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.196784 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.196763    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-workload-socket\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.230314 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.230268    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:14.297304 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.297267    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-envoy\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.297304 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.297312    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-token\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.297574 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.297334    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-credential-socket\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.297574 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.297365    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-podinfo\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.297574 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.297390    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istiod-ca-cert\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.297574 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.297427    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-workload-socket\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.297574 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.297478    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-data\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.297574 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.297508    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9sh5\" (UniqueName: \"kubernetes.io/projected/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-kube-api-access-s9sh5\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.297574 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.297534    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-workload-certs\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.297935 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.297858    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-credential-socket\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.298025 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.298001    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-workload-certs\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.298113 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.298050    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-data\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.298253 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.298234    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istiod-ca-cert\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.298253 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.298242    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-workload-socket\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.299657 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.299635    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-envoy\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.299959 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.299938    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-podinfo\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.308314 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.308287    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-token\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.309810 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.309790    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9sh5\" (UniqueName: \"kubernetes.io/projected/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-kube-api-access-s9sh5\") pod \"e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") " pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.443650 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.443570    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:14.469574 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.469542    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:14.607451 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.607428    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"]
Jul 09 22:40:14.609069 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:40:14.609002    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ffa25a3_7e2f_4c7c_92fc_8310a9960797.slice/crio-929bf5819faacdac9a1bee5a16883240b268710680126e384d0b183153929b46 WatchSource:0}: Error finding container 929bf5819faacdac9a1bee5a16883240b268710680126e384d0b183153929b46: Status 404 returned error can't find the container with id 929bf5819faacdac9a1bee5a16883240b268710680126e384d0b183153929b46
Jul 09 22:40:14.611144 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.611111    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:40:14.611231 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.611195    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:40:14.611270 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:14.611229    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:40:15.136350 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:15.136315    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n" event={"ID":"3ffa25a3-7e2f-4c7c-92fc-8310a9960797","Type":"ContainerStarted","Data":"8d0cc8d4ce2a8842a1172ed5532c03fee2a7b9ffac21cab7c0c4a2309a387332"}
Jul 09 22:40:15.136791 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:15.136369    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n" event={"ID":"3ffa25a3-7e2f-4c7c-92fc-8310a9960797","Type":"ContainerStarted","Data":"929bf5819faacdac9a1bee5a16883240b268710680126e384d0b183153929b46"}
Jul 09 22:40:15.166128 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:15.166077    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n" podStartSLOduration=1.166061124 podStartE2EDuration="1.166061124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:40:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:40:15.163383122 +0000 UTC m=+1877.837381937" watchObservedRunningTime="2026-07-09 22:40:15.166061124 +0000 UTC m=+1877.840059922"
Jul 09 22:40:15.470794 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:15.470701    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:15.475335 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:15.475307    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:16.141476 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:16.141449    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:16.142391 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:16.142369    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:17.143224 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:17.143176    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:17.264827 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:17.264794    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:17.339445 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:17.339409    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"]
Jul 09 22:40:17.342692 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:17.342672    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"
Jul 09 22:40:17.345167 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:17.345141    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f040043d-serving-cert\""
Jul 09 22:40:17.356881 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:17.356861    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"]
Jul 09 22:40:17.382113 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:17.382086    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:17.427968 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:17.427884    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ksdn\" (UniqueName: \"kubernetes.io/projected/adb720dd-982c-485d-be48-a46c67cc90e9-kube-api-access-6ksdn\") pod \"maas-api-e2e-mt-f040043d-f5c847bb9-wxst2\" (UID: \"adb720dd-982c-485d-be48-a46c67cc90e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"
Jul 09 22:40:17.428144 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:17.428003    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adb720dd-982c-485d-be48-a46c67cc90e9-maas-api-tls\") pod \"maas-api-e2e-mt-f040043d-f5c847bb9-wxst2\" (UID: \"adb720dd-982c-485d-be48-a46c67cc90e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"
Jul 09 22:40:17.428144 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:17.428027    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adb720dd-982c-485d-be48-a46c67cc90e9-openshift-service-ca\") pod \"maas-api-e2e-mt-f040043d-f5c847bb9-wxst2\" (UID: \"adb720dd-982c-485d-be48-a46c67cc90e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"
Jul 09 22:40:17.529422 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:17.529383    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adb720dd-982c-485d-be48-a46c67cc90e9-maas-api-tls\") pod \"maas-api-e2e-mt-f040043d-f5c847bb9-wxst2\" (UID: \"adb720dd-982c-485d-be48-a46c67cc90e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"
Jul 09 22:40:17.529422 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:17.529422    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adb720dd-982c-485d-be48-a46c67cc90e9-openshift-service-ca\") pod \"maas-api-e2e-mt-f040043d-f5c847bb9-wxst2\" (UID: \"adb720dd-982c-485d-be48-a46c67cc90e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"
Jul 09 22:40:17.529637 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:17.529449    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ksdn\" (UniqueName: \"kubernetes.io/projected/adb720dd-982c-485d-be48-a46c67cc90e9-kube-api-access-6ksdn\") pod \"maas-api-e2e-mt-f040043d-f5c847bb9-wxst2\" (UID: \"adb720dd-982c-485d-be48-a46c67cc90e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"
Jul 09 22:40:17.529637 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:40:17.529553    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-serving-cert: secret "maas-api-e2e-mt-f040043d-serving-cert" not found
Jul 09 22:40:17.529703 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:40:17.529641    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adb720dd-982c-485d-be48-a46c67cc90e9-maas-api-tls podName:adb720dd-982c-485d-be48-a46c67cc90e9 nodeName:}" failed. No retries permitted until 2026-07-09 22:40:18.029619992 +0000 UTC m=+1880.703618789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/adb720dd-982c-485d-be48-a46c67cc90e9-maas-api-tls") pod "maas-api-e2e-mt-f040043d-f5c847bb9-wxst2" (UID: "adb720dd-982c-485d-be48-a46c67cc90e9") : secret "maas-api-e2e-mt-f040043d-serving-cert" not found
Jul 09 22:40:17.530132 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:17.530117    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adb720dd-982c-485d-be48-a46c67cc90e9-openshift-service-ca\") pod \"maas-api-e2e-mt-f040043d-f5c847bb9-wxst2\" (UID: \"adb720dd-982c-485d-be48-a46c67cc90e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"
Jul 09 22:40:17.550816 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:17.550787    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ksdn\" (UniqueName: \"kubernetes.io/projected/adb720dd-982c-485d-be48-a46c67cc90e9-kube-api-access-6ksdn\") pod \"maas-api-e2e-mt-f040043d-f5c847bb9-wxst2\" (UID: \"adb720dd-982c-485d-be48-a46c67cc90e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"
Jul 09 22:40:17.931316 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:17.931278    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:18.034586 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:18.034549    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adb720dd-982c-485d-be48-a46c67cc90e9-maas-api-tls\") pod \"maas-api-e2e-mt-f040043d-f5c847bb9-wxst2\" (UID: \"adb720dd-982c-485d-be48-a46c67cc90e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"
Jul 09 22:40:18.036990 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:18.036958    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adb720dd-982c-485d-be48-a46c67cc90e9-maas-api-tls\") pod \"maas-api-e2e-mt-f040043d-f5c847bb9-wxst2\" (UID: \"adb720dd-982c-485d-be48-a46c67cc90e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"
Jul 09 22:40:18.124188 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:18.124152    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:18.230265 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:18.230162    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:18.253297 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:18.253264    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"
Jul 09 22:40:18.397700 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:18.397674    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"]
Jul 09 22:40:18.399293 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:40:18.399268    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb720dd_982c_485d_be48_a46c67cc90e9.slice/crio-41b88f4d0b2a933efccce6e459a3d80036b4f70b6c009f4b6ce8febd4730c020 WatchSource:0}: Error finding container 41b88f4d0b2a933efccce6e459a3d80036b4f70b6c009f4b6ce8febd4730c020: Status 404 returned error can't find the container with id 41b88f4d0b2a933efccce6e459a3d80036b4f70b6c009f4b6ce8febd4730c020
Jul 09 22:40:19.158767 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:19.158737    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2" event={"ID":"adb720dd-982c-485d-be48-a46c67cc90e9","Type":"ContainerStarted","Data":"73a9ed1968addf54a1cbdf8bc86ec7eab0368b83438cf4bb652de633e1da69b6"}
Jul 09 22:40:19.158973 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:19.158785    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2" event={"ID":"adb720dd-982c-485d-be48-a46c67cc90e9","Type":"ContainerStarted","Data":"41b88f4d0b2a933efccce6e459a3d80036b4f70b6c009f4b6ce8febd4730c020"}
Jul 09 22:40:19.158973 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:19.158876    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"
Jul 09 22:40:19.180053 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:19.179985    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2" podStartSLOduration=1.76307794 podStartE2EDuration="2.179963194s" totalImagesPullingTime="416.885254ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:40:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:40:19.178128396 +0000 UTC m=+1881.852127197" watchObservedRunningTime="2026-07-09 22:40:19.179963194 +0000 UTC m=+1881.853961997"
Jul 09 22:40:21.606175 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:21.606142    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:25.173356 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:25.173327    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"
Jul 09 22:40:27.278315 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:27.278281    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:27.378195 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:27.378159    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:31.143552 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:31.143516    2554 patch_prober.go:28] interesting pod/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 09 22:40:31.144002 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:31.143574    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n" podUID="3ffa25a3-7e2f-4c7c-92fc-8310a9960797" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 09 22:40:31.216593 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:31.216555    2554 generic.go:356] "Generic (PLEG): container finished" podID="3ffa25a3-7e2f-4c7c-92fc-8310a9960797" containerID="8d0cc8d4ce2a8842a1172ed5532c03fee2a7b9ffac21cab7c0c4a2309a387332" exitCode=0
Jul 09 22:40:31.216748 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:31.216630    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n" event={"ID":"3ffa25a3-7e2f-4c7c-92fc-8310a9960797","Type":"ContainerDied","Data":"8d0cc8d4ce2a8842a1172ed5532c03fee2a7b9ffac21cab7c0c4a2309a387332"}
Jul 09 22:40:31.217053 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:31.217026    2554 scope.go:117] "RemoveContainer" containerID="8d0cc8d4ce2a8842a1172ed5532c03fee2a7b9ffac21cab7c0c4a2309a387332"
Jul 09 22:40:31.218019 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:31.217992    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:40:31.218114 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:31.218085    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:40:31.218165 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:31.218117    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:40:32.222919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:32.222880    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n" event={"ID":"3ffa25a3-7e2f-4c7c-92fc-8310a9960797","Type":"ContainerStarted","Data":"9a464e1d194d76e041ab38766554a15f31093e9b49efb2fba02f5daa674fc329"}
Jul 09 22:40:32.470183 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:32.470142    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:32.470394 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:32.470276    2554 patch_prober.go:28] interesting pod/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 09 22:40:32.470394 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:32.470322    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n" podUID="3ffa25a3-7e2f-4c7c-92fc-8310a9960797" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 09 22:40:33.470140 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:33.470099    2554 patch_prober.go:28] interesting pod/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 09 22:40:33.470668 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:33.470169    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n" podUID="3ffa25a3-7e2f-4c7c-92fc-8310a9960797" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 09 22:40:34.470473 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:34.470432    2554 patch_prober.go:28] interesting pod/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 09 22:40:34.470984 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:34.470536    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n" podUID="3ffa25a3-7e2f-4c7c-92fc-8310a9960797" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 09 22:40:35.470605 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:35.470567    2554 patch_prober.go:28] interesting pod/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 09 22:40:35.471239 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:35.471210    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n" podUID="3ffa25a3-7e2f-4c7c-92fc-8310a9960797" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 09 22:40:36.473718 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:36.473678    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:36.474123 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:36.473932    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:36.474703 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:36.474689    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:40:39.111444 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:39.111412    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:39.208630 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:39.208592    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:40:46.001435 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:40:46.001398    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:41:04.327452 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:04.327416    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:41:04.812555 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:04.812510    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"]
Jul 09 22:41:04.812777 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:04.812753    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2" podUID="adb720dd-982c-485d-be48-a46c67cc90e9" containerName="maas-api" containerID="cri-o://73a9ed1968addf54a1cbdf8bc86ec7eab0368b83438cf4bb652de633e1da69b6" gracePeriod=30
Jul 09 22:41:04.965366 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:04.965331    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:41:05.058470 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.058447    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"
Jul 09 22:41:05.141893 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.141861    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adb720dd-982c-485d-be48-a46c67cc90e9-openshift-service-ca\") pod \"adb720dd-982c-485d-be48-a46c67cc90e9\" (UID: \"adb720dd-982c-485d-be48-a46c67cc90e9\") "
Jul 09 22:41:05.141893 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.141898    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adb720dd-982c-485d-be48-a46c67cc90e9-maas-api-tls\") pod \"adb720dd-982c-485d-be48-a46c67cc90e9\" (UID: \"adb720dd-982c-485d-be48-a46c67cc90e9\") "
Jul 09 22:41:05.142134 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.141917    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ksdn\" (UniqueName: \"kubernetes.io/projected/adb720dd-982c-485d-be48-a46c67cc90e9-kube-api-access-6ksdn\") pod \"adb720dd-982c-485d-be48-a46c67cc90e9\" (UID: \"adb720dd-982c-485d-be48-a46c67cc90e9\") "
Jul 09 22:41:05.142342 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.142317    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adb720dd-982c-485d-be48-a46c67cc90e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "adb720dd-982c-485d-be48-a46c67cc90e9" (UID: "adb720dd-982c-485d-be48-a46c67cc90e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:41:05.144057 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.144024    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adb720dd-982c-485d-be48-a46c67cc90e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "adb720dd-982c-485d-be48-a46c67cc90e9" (UID: "adb720dd-982c-485d-be48-a46c67cc90e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:41:05.144169 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.144065    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adb720dd-982c-485d-be48-a46c67cc90e9-kube-api-access-6ksdn" (OuterVolumeSpecName: "kube-api-access-6ksdn") pod "adb720dd-982c-485d-be48-a46c67cc90e9" (UID: "adb720dd-982c-485d-be48-a46c67cc90e9"). InnerVolumeSpecName "kube-api-access-6ksdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:41:05.242779 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.242739    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adb720dd-982c-485d-be48-a46c67cc90e9-openshift-service-ca\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:41:05.242779 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.242767    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adb720dd-982c-485d-be48-a46c67cc90e9-maas-api-tls\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:41:05.242779 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.242779    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ksdn\" (UniqueName: \"kubernetes.io/projected/adb720dd-982c-485d-be48-a46c67cc90e9-kube-api-access-6ksdn\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:41:05.384886 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.384851    2554 generic.go:356] "Generic (PLEG): container finished" podID="adb720dd-982c-485d-be48-a46c67cc90e9" containerID="73a9ed1968addf54a1cbdf8bc86ec7eab0368b83438cf4bb652de633e1da69b6" exitCode=0
Jul 09 22:41:05.385347 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.384903    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"
Jul 09 22:41:05.385347 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.384911    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2" event={"ID":"adb720dd-982c-485d-be48-a46c67cc90e9","Type":"ContainerDied","Data":"73a9ed1968addf54a1cbdf8bc86ec7eab0368b83438cf4bb652de633e1da69b6"}
Jul 09 22:41:05.385347 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.384964    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2" event={"ID":"adb720dd-982c-485d-be48-a46c67cc90e9","Type":"ContainerDied","Data":"41b88f4d0b2a933efccce6e459a3d80036b4f70b6c009f4b6ce8febd4730c020"}
Jul 09 22:41:05.385347 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.385006    2554 scope.go:117] "RemoveContainer" containerID="73a9ed1968addf54a1cbdf8bc86ec7eab0368b83438cf4bb652de633e1da69b6"
Jul 09 22:41:05.393918 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.393900    2554 scope.go:117] "RemoveContainer" containerID="73a9ed1968addf54a1cbdf8bc86ec7eab0368b83438cf4bb652de633e1da69b6"
Jul 09 22:41:05.394196 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:41:05.394178    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73a9ed1968addf54a1cbdf8bc86ec7eab0368b83438cf4bb652de633e1da69b6\": container with ID starting with 73a9ed1968addf54a1cbdf8bc86ec7eab0368b83438cf4bb652de633e1da69b6 not found: ID does not exist" containerID="73a9ed1968addf54a1cbdf8bc86ec7eab0368b83438cf4bb652de633e1da69b6"
Jul 09 22:41:05.394246 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.394206    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73a9ed1968addf54a1cbdf8bc86ec7eab0368b83438cf4bb652de633e1da69b6"} err="failed to get container status \"73a9ed1968addf54a1cbdf8bc86ec7eab0368b83438cf4bb652de633e1da69b6\": rpc error: code = NotFound desc = could not find container \"73a9ed1968addf54a1cbdf8bc86ec7eab0368b83438cf4bb652de633e1da69b6\": container with ID starting with 73a9ed1968addf54a1cbdf8bc86ec7eab0368b83438cf4bb652de633e1da69b6 not found: ID does not exist"
Jul 09 22:41:05.428679 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.427755    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"]
Jul 09 22:41:05.433667 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.433638    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f040043d-f5c847bb9-wxst2"]
Jul 09 22:41:05.881440 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:05.881405    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adb720dd-982c-485d-be48-a46c67cc90e9" path="/var/lib/kubelet/pods/adb720dd-982c-485d-be48-a46c67cc90e9/volumes"
Jul 09 22:41:10.358763 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:10.358731    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:41:15.452919 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:15.452879    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:41:51.900615 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:51.900527    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:41:52.957349 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:52.957312    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:41:58.534798 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:58.534758    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:41:58.635021 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:58.634985    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:41:58.824060 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:58.823964    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"]
Jul 09 22:41:58.824275 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:58.824249    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n" podUID="3ffa25a3-7e2f-4c7c-92fc-8310a9960797" containerName="istio-proxy" containerID="cri-o://9a464e1d194d76e041ab38766554a15f31093e9b49efb2fba02f5daa674fc329" gracePeriod=30
Jul 09 22:41:58.836987 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:58.836964    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:41:59.061991 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:41:59.061953    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:00.149498 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:00.149457    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:00.240759 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:00.240720    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:00.342941 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:00.342909    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:01.066567 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:01.066529    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:01.169571 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:01.169533    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:01.270284 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:01.270246    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:02.687860 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:02.687825    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:04.069790 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.069763    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:42:04.124872 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.124842    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9sh5\" (UniqueName: \"kubernetes.io/projected/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-kube-api-access-s9sh5\") pod \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") "
Jul 09 22:42:04.125018 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.124897    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-workload-certs\") pod \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") "
Jul 09 22:42:04.125018 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.124922    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-podinfo\") pod \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") "
Jul 09 22:42:04.125018 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.124939    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istiod-ca-cert\") pod \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") "
Jul 09 22:42:04.125018 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.124956    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-token\") pod \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") "
Jul 09 22:42:04.125018 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.124971    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-credential-socket\") pod \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") "
Jul 09 22:42:04.125018 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.124990    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-workload-socket\") pod \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") "
Jul 09 22:42:04.125352 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.125026    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-data\") pod \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") "
Jul 09 22:42:04.125352 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.125076    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-envoy\") pod \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\" (UID: \"3ffa25a3-7e2f-4c7c-92fc-8310a9960797\") "
Jul 09 22:42:04.125352 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.125269    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3ffa25a3-7e2f-4c7c-92fc-8310a9960797" (UID: "3ffa25a3-7e2f-4c7c-92fc-8310a9960797"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:42:04.125518 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.125385    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3ffa25a3-7e2f-4c7c-92fc-8310a9960797" (UID: "3ffa25a3-7e2f-4c7c-92fc-8310a9960797"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:42:04.125518 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.125400    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-workload-certs\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:42:04.125518 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.125400    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3ffa25a3-7e2f-4c7c-92fc-8310a9960797" (UID: "3ffa25a3-7e2f-4c7c-92fc-8310a9960797"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:42:04.125698 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.125675    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3ffa25a3-7e2f-4c7c-92fc-8310a9960797" (UID: "3ffa25a3-7e2f-4c7c-92fc-8310a9960797"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:42:04.125980 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.125960    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-data" (OuterVolumeSpecName: "istio-data") pod "3ffa25a3-7e2f-4c7c-92fc-8310a9960797" (UID: "3ffa25a3-7e2f-4c7c-92fc-8310a9960797"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:42:04.127312 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.127293    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3ffa25a3-7e2f-4c7c-92fc-8310a9960797" (UID: "3ffa25a3-7e2f-4c7c-92fc-8310a9960797"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 22:42:04.127403 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.127338    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3ffa25a3-7e2f-4c7c-92fc-8310a9960797" (UID: "3ffa25a3-7e2f-4c7c-92fc-8310a9960797"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:42:04.127403 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.127376    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-kube-api-access-s9sh5" (OuterVolumeSpecName: "kube-api-access-s9sh5") pod "3ffa25a3-7e2f-4c7c-92fc-8310a9960797" (UID: "3ffa25a3-7e2f-4c7c-92fc-8310a9960797"). InnerVolumeSpecName "kube-api-access-s9sh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:42:04.127568 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.127552    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-token" (OuterVolumeSpecName: "istio-token") pod "3ffa25a3-7e2f-4c7c-92fc-8310a9960797" (UID: "3ffa25a3-7e2f-4c7c-92fc-8310a9960797"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:42:04.226354 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.226323    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-podinfo\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:42:04.226354 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.226349    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istiod-ca-cert\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:42:04.226354 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.226358    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-token\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:42:04.226354 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.226366    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-credential-socket\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:42:04.226614 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.226374    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-workload-socket\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:42:04.226614 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.226382    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-data\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:42:04.226614 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.226390    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-istio-envoy\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:42:04.226614 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.226398    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9sh5\" (UniqueName: \"kubernetes.io/projected/3ffa25a3-7e2f-4c7c-92fc-8310a9960797-kube-api-access-s9sh5\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:42:04.667534 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.667498    2554 generic.go:356] "Generic (PLEG): container finished" podID="3ffa25a3-7e2f-4c7c-92fc-8310a9960797" containerID="9a464e1d194d76e041ab38766554a15f31093e9b49efb2fba02f5daa674fc329" exitCode=0
Jul 09 22:42:04.667702 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.667544    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"
Jul 09 22:42:04.667702 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.667586    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n" event={"ID":"3ffa25a3-7e2f-4c7c-92fc-8310a9960797","Type":"ContainerDied","Data":"9a464e1d194d76e041ab38766554a15f31093e9b49efb2fba02f5daa674fc329"}
Jul 09 22:42:04.667702 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.667643    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n" event={"ID":"3ffa25a3-7e2f-4c7c-92fc-8310a9960797","Type":"ContainerDied","Data":"929bf5819faacdac9a1bee5a16883240b268710680126e384d0b183153929b46"}
Jul 09 22:42:04.667702 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.667668    2554 scope.go:117] "RemoveContainer" containerID="9a464e1d194d76e041ab38766554a15f31093e9b49efb2fba02f5daa674fc329"
Jul 09 22:42:04.676542 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.676523    2554 scope.go:117] "RemoveContainer" containerID="8d0cc8d4ce2a8842a1172ed5532c03fee2a7b9ffac21cab7c0c4a2309a387332"
Jul 09 22:42:04.684155 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.684139    2554 scope.go:117] "RemoveContainer" containerID="9a464e1d194d76e041ab38766554a15f31093e9b49efb2fba02f5daa674fc329"
Jul 09 22:42:04.684383 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:42:04.684363    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a464e1d194d76e041ab38766554a15f31093e9b49efb2fba02f5daa674fc329\": container with ID starting with 9a464e1d194d76e041ab38766554a15f31093e9b49efb2fba02f5daa674fc329 not found: ID does not exist" containerID="9a464e1d194d76e041ab38766554a15f31093e9b49efb2fba02f5daa674fc329"
Jul 09 22:42:04.684435 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.684390    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a464e1d194d76e041ab38766554a15f31093e9b49efb2fba02f5daa674fc329"} err="failed to get container status \"9a464e1d194d76e041ab38766554a15f31093e9b49efb2fba02f5daa674fc329\": rpc error: code = NotFound desc = could not find container \"9a464e1d194d76e041ab38766554a15f31093e9b49efb2fba02f5daa674fc329\": container with ID starting with 9a464e1d194d76e041ab38766554a15f31093e9b49efb2fba02f5daa674fc329 not found: ID does not exist"
Jul 09 22:42:04.684435 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.684406    2554 scope.go:117] "RemoveContainer" containerID="8d0cc8d4ce2a8842a1172ed5532c03fee2a7b9ffac21cab7c0c4a2309a387332"
Jul 09 22:42:04.684615 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:42:04.684597    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d0cc8d4ce2a8842a1172ed5532c03fee2a7b9ffac21cab7c0c4a2309a387332\": container with ID starting with 8d0cc8d4ce2a8842a1172ed5532c03fee2a7b9ffac21cab7c0c4a2309a387332 not found: ID does not exist" containerID="8d0cc8d4ce2a8842a1172ed5532c03fee2a7b9ffac21cab7c0c4a2309a387332"
Jul 09 22:42:04.684656 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.684619    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d0cc8d4ce2a8842a1172ed5532c03fee2a7b9ffac21cab7c0c4a2309a387332"} err="failed to get container status \"8d0cc8d4ce2a8842a1172ed5532c03fee2a7b9ffac21cab7c0c4a2309a387332\": rpc error: code = NotFound desc = could not find container \"8d0cc8d4ce2a8842a1172ed5532c03fee2a7b9ffac21cab7c0c4a2309a387332\": container with ID starting with 8d0cc8d4ce2a8842a1172ed5532c03fee2a7b9ffac21cab7c0c4a2309a387332 not found: ID does not exist"
Jul 09 22:42:04.690102 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.690082    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"]
Jul 09 22:42:04.696476 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:04.696455    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f040043d-openshift-default-79886d8cb7-8mg2n"]
Jul 09 22:42:05.880898 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:05.880866    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ffa25a3-7e2f-4c7c-92fc-8310a9960797" path="/var/lib/kubelet/pods/3ffa25a3-7e2f-4c7c-92fc-8310a9960797/volumes"
Jul 09 22:42:08.439515 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:08.439467    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:08.516978 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:08.516940    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:09.132998 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:09.132963    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:15.326491 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:15.326458    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:15.397068 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:15.397013    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:15.508569 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:15.508537    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:21.452649 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:21.452607    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:26.044233 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:26.044198    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:26.516742 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:26.516701    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:33.234022 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:33.233983    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:47.491318 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:47.491288    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:53.413645 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:53.413613    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:53.481163 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:53.481134    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:53.797411 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:53.797319    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:54.118660 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:54.118625    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:54.525523 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:54.525441    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:56.864068 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:56.864010    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:56.925829 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:56.925799    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"]
Jul 09 22:42:56.926161 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:56.926148    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adb720dd-982c-485d-be48-a46c67cc90e9" containerName="maas-api"
Jul 09 22:42:56.926214 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:56.926164    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="adb720dd-982c-485d-be48-a46c67cc90e9" containerName="maas-api"
Jul 09 22:42:56.926214 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:56.926174    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ffa25a3-7e2f-4c7c-92fc-8310a9960797" containerName="istio-proxy"
Jul 09 22:42:56.926214 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:56.926180    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ffa25a3-7e2f-4c7c-92fc-8310a9960797" containerName="istio-proxy"
Jul 09 22:42:56.926214 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:56.926187    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ffa25a3-7e2f-4c7c-92fc-8310a9960797" containerName="istio-proxy"
Jul 09 22:42:56.926214 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:56.926192    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ffa25a3-7e2f-4c7c-92fc-8310a9960797" containerName="istio-proxy"
Jul 09 22:42:56.926391 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:56.926240    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ffa25a3-7e2f-4c7c-92fc-8310a9960797" containerName="istio-proxy"
Jul 09 22:42:56.926391 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:56.926250    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="adb720dd-982c-485d-be48-a46c67cc90e9" containerName="maas-api"
Jul 09 22:42:56.929086 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:56.929069    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"
Jul 09 22:42:56.931839 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:56.931820    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-0295ed-serving-cert\""
Jul 09 22:42:56.940609 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:56.940588    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"]
Jul 09 22:42:56.989349 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:56.989319    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-maas-api-tls\") pod \"maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk\" (UID: \"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"
Jul 09 22:42:56.989490 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:56.989353    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk\" (UID: \"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"
Jul 09 22:42:56.989490 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:56.989394    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkb5q\" (UniqueName: \"kubernetes.io/projected/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-kube-api-access-dkb5q\") pod \"maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk\" (UID: \"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"
Jul 09 22:42:57.030425 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:57.030387    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:57.090413 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:57.090382    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-maas-api-tls\") pod \"maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk\" (UID: \"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"
Jul 09 22:42:57.090413 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:57.090413    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk\" (UID: \"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"
Jul 09 22:42:57.090623 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:57.090435    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkb5q\" (UniqueName: \"kubernetes.io/projected/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-kube-api-access-dkb5q\") pod \"maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk\" (UID: \"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"
Jul 09 22:42:57.091058 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:57.091016    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk\" (UID: \"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"
Jul 09 22:42:57.092847 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:57.092828    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-maas-api-tls\") pod \"maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk\" (UID: \"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"
Jul 09 22:42:57.099451 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:57.099423    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkb5q\" (UniqueName: \"kubernetes.io/projected/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-kube-api-access-dkb5q\") pod \"maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk\" (UID: \"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"
Jul 09 22:42:57.130847 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:57.130768    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:57.235869 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:57.235839    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:57.239693 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:57.239671    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"
Jul 09 22:42:57.391746 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:57.391718    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"]
Jul 09 22:42:57.393662 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:42:57.393637    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1b56c7_fb61_4219_8dec_88a7e3fcb4ce.slice/crio-d5773ee917b9f7673582e0ef38f2b735bac899742c8ad097e7e1ddc6d92926fa WatchSource:0}: Error finding container d5773ee917b9f7673582e0ef38f2b735bac899742c8ad097e7e1ddc6d92926fa: Status 404 returned error can't find the container with id d5773ee917b9f7673582e0ef38f2b735bac899742c8ad097e7e1ddc6d92926fa
Jul 09 22:42:57.395413 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:57.395396    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:42:57.653966 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:57.653886    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:57.758152 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:57.758116    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:42:57.918003 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:57.917919    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk" event={"ID":"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce","Type":"ContainerStarted","Data":"d5773ee917b9f7673582e0ef38f2b735bac899742c8ad097e7e1ddc6d92926fa"}
Jul 09 22:42:58.924012 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:58.923973    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk" event={"ID":"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce","Type":"ContainerStarted","Data":"8e16b0b76eeedb370a9ee69a45117db3901a9ab332fe2e049a754d822e19ff63"}
Jul 09 22:42:58.924428 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:58.924048    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"
Jul 09 22:42:58.944136 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:42:58.944090    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk" podStartSLOduration=1.876804039 podStartE2EDuration="2.944073712s" totalImagesPullingTime="1.067269673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:42:58.942754976 +0000 UTC m=+2041.616753802" watchObservedRunningTime="2026-07-09 22:42:58.944073712 +0000 UTC m=+2041.618072515"
Jul 09 22:43:01.494733 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:01.494703    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:43:01.677077 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:01.676978    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:43:01.968495 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:01.968465    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"]
Jul 09 22:43:01.968850 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:01.968836    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ffa25a3-7e2f-4c7c-92fc-8310a9960797" containerName="istio-proxy"
Jul 09 22:43:01.971659 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:01.971639    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:01.974290 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:01.974271    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c31bfc-openshift-default-dockercfg-27rpc\""
Jul 09 22:43:01.989077 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:01.989016    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"]
Jul 09 22:43:02.009164 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.009135    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:43:02.034099 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.034062    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-istio-data\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.034279 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.034114    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-istio-envoy\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.034279 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.034144    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xchql\" (UniqueName: \"kubernetes.io/projected/63fb5e76-020a-4988-a712-d5e690474c80-kube-api-access-xchql\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.034279 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.034166    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63fb5e76-020a-4988-a712-d5e690474c80-istio-podinfo\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.034279 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.034200    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-workload-certs\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.034279 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.034228    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63fb5e76-020a-4988-a712-d5e690474c80-istio-token\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.034279 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.034249    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-credential-socket\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.034279 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.034271    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-workload-socket\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.034536 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.034322    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63fb5e76-020a-4988-a712-d5e690474c80-istiod-ca-cert\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.135229 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.135193    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-istio-data\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.135229 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.135232    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-istio-envoy\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.135487 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.135256    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xchql\" (UniqueName: \"kubernetes.io/projected/63fb5e76-020a-4988-a712-d5e690474c80-kube-api-access-xchql\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.135487 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.135275    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63fb5e76-020a-4988-a712-d5e690474c80-istio-podinfo\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.135487 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.135292    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-workload-certs\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.135487 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.135314    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63fb5e76-020a-4988-a712-d5e690474c80-istio-token\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.135487 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.135342    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-credential-socket\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.135487 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.135366    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-workload-socket\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.135487 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.135382    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63fb5e76-020a-4988-a712-d5e690474c80-istiod-ca-cert\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.135807 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.135657    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-istio-data\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.135807 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.135704    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-workload-certs\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.135912 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.135886    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-workload-socket\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.135982 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.135962    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-credential-socket\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.136121 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.136105    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63fb5e76-020a-4988-a712-d5e690474c80-istiod-ca-cert\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.137689 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.137670    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-istio-envoy\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.137869 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.137849    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63fb5e76-020a-4988-a712-d5e690474c80-istio-podinfo\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.143906 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.143881    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63fb5e76-020a-4988-a712-d5e690474c80-istio-token\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.144268 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.144251    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xchql\" (UniqueName: \"kubernetes.io/projected/63fb5e76-020a-4988-a712-d5e690474c80-kube-api-access-xchql\") pod \"e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") " pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.282178 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.282090    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:02.423716 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.423691    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"]
Jul 09 22:43:02.425591 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:43:02.425558    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63fb5e76_020a_4988_a712_d5e690474c80.slice/crio-94df0026527d5ee724941386dafa3f8794c650919b9c9581eff4a60c1ecb0c3a WatchSource:0}: Error finding container 94df0026527d5ee724941386dafa3f8794c650919b9c9581eff4a60c1ecb0c3a: Status 404 returned error can't find the container with id 94df0026527d5ee724941386dafa3f8794c650919b9c9581eff4a60c1ecb0c3a
Jul 09 22:43:02.427838 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.427805    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:43:02.427936 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.427877    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:43:02.427936 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.427923    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:43:02.434004 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.433969    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:43:02.943933 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.943901    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj" event={"ID":"63fb5e76-020a-4988-a712-d5e690474c80","Type":"ContainerStarted","Data":"0f4b5b1602d848c1b50a14fe0634cbe1728fd4b4acea66a0208b77019a0e194b"}
Jul 09 22:43:02.944382 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.943953    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj" event={"ID":"63fb5e76-020a-4988-a712-d5e690474c80","Type":"ContainerStarted","Data":"94df0026527d5ee724941386dafa3f8794c650919b9c9581eff4a60c1ecb0c3a"}
Jul 09 22:43:02.969293 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:02.969244    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj" podStartSLOduration=1.969228256 podStartE2EDuration="1.969228256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:43:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:43:02.968984325 +0000 UTC m=+2045.642983129" watchObservedRunningTime="2026-07-09 22:43:02.969228256 +0000 UTC m=+2045.643227057"
Jul 09 22:43:03.283148 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:03.283062    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:03.288006 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:03.287976    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:03.949099 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:03.949069    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:03.950189 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:03.950166    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:04.934344 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:04.934316    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"
Jul 09 22:43:06.030337 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.030302    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:43:06.100783 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.100750    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"]
Jul 09 22:43:06.106137 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.106104    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"
Jul 09 22:43:06.109661 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.109638    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-c31bfc-serving-cert\""
Jul 09 22:43:06.121623 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.121597    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"]
Jul 09 22:43:06.137639 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.137615    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:43:06.167946 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.167911    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfkfq\" (UniqueName: \"kubernetes.io/projected/cc2bff97-8cbf-4e50-ab97-49037825b633-kube-api-access-dfkfq\") pod \"maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p\" (UID: \"cc2bff97-8cbf-4e50-ab97-49037825b633\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"
Jul 09 22:43:06.168145 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.168003    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc2bff97-8cbf-4e50-ab97-49037825b633-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p\" (UID: \"cc2bff97-8cbf-4e50-ab97-49037825b633\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"
Jul 09 22:43:06.168145 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.168068    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc2bff97-8cbf-4e50-ab97-49037825b633-maas-api-tls\") pod \"maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p\" (UID: \"cc2bff97-8cbf-4e50-ab97-49037825b633\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"
Jul 09 22:43:06.213181 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.213137    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:43:06.268788 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.268747    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfkfq\" (UniqueName: \"kubernetes.io/projected/cc2bff97-8cbf-4e50-ab97-49037825b633-kube-api-access-dfkfq\") pod \"maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p\" (UID: \"cc2bff97-8cbf-4e50-ab97-49037825b633\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"
Jul 09 22:43:06.268973 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.268803    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc2bff97-8cbf-4e50-ab97-49037825b633-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p\" (UID: \"cc2bff97-8cbf-4e50-ab97-49037825b633\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"
Jul 09 22:43:06.268973 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.268832    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc2bff97-8cbf-4e50-ab97-49037825b633-maas-api-tls\") pod \"maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p\" (UID: \"cc2bff97-8cbf-4e50-ab97-49037825b633\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"
Jul 09 22:43:06.268973 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:43:06.268933    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-serving-cert: secret "maas-api-e2e-inf-b-c31bfc-serving-cert" not found
Jul 09 22:43:06.269116 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:43:06.268995    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc2bff97-8cbf-4e50-ab97-49037825b633-maas-api-tls podName:cc2bff97-8cbf-4e50-ab97-49037825b633 nodeName:}" failed. No retries permitted until 2026-07-09 22:43:06.768980076 +0000 UTC m=+2049.442978857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cc2bff97-8cbf-4e50-ab97-49037825b633-maas-api-tls") pod "maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p" (UID: "cc2bff97-8cbf-4e50-ab97-49037825b633") : secret "maas-api-e2e-inf-b-c31bfc-serving-cert" not found
Jul 09 22:43:06.269526 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.269507    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc2bff97-8cbf-4e50-ab97-49037825b633-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p\" (UID: \"cc2bff97-8cbf-4e50-ab97-49037825b633\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"
Jul 09 22:43:06.283370 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.283300    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfkfq\" (UniqueName: \"kubernetes.io/projected/cc2bff97-8cbf-4e50-ab97-49037825b633-kube-api-access-dfkfq\") pod \"maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p\" (UID: \"cc2bff97-8cbf-4e50-ab97-49037825b633\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"
Jul 09 22:43:06.340672 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.340633    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:43:06.774870 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.774828    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc2bff97-8cbf-4e50-ab97-49037825b633-maas-api-tls\") pod \"maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p\" (UID: \"cc2bff97-8cbf-4e50-ab97-49037825b633\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"
Jul 09 22:43:06.777303 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.777273    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc2bff97-8cbf-4e50-ab97-49037825b633-maas-api-tls\") pod \"maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p\" (UID: \"cc2bff97-8cbf-4e50-ab97-49037825b633\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"
Jul 09 22:43:06.789263 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.789233    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:43:06.888086 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:06.888020    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:43:07.017131 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:07.017102    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"
Jul 09 22:43:07.155559 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:07.155530    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"]
Jul 09 22:43:07.157026 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:43:07.156998    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc2bff97_8cbf_4e50_ab97_49037825b633.slice/crio-2e42199a549bcdbf9f2e63c1886542d1b501efc185170423aa64947c1a252f0c WatchSource:0}: Error finding container 2e42199a549bcdbf9f2e63c1886542d1b501efc185170423aa64947c1a252f0c: Status 404 returned error can't find the container with id 2e42199a549bcdbf9f2e63c1886542d1b501efc185170423aa64947c1a252f0c
Jul 09 22:43:07.971424 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:07.971335    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p" event={"ID":"cc2bff97-8cbf-4e50-ab97-49037825b633","Type":"ContainerStarted","Data":"c8a1f960a8a92fa1a2b14fd5c1d9f5024b7916af8ac46c0a0bfad68bbc5645ca"}
Jul 09 22:43:07.971424 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:07.971397    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p" event={"ID":"cc2bff97-8cbf-4e50-ab97-49037825b633","Type":"ContainerStarted","Data":"2e42199a549bcdbf9f2e63c1886542d1b501efc185170423aa64947c1a252f0c"}
Jul 09 22:43:07.971614 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:07.971465    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"
Jul 09 22:43:07.989806 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:07.989759    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p" podStartSLOduration=1.4474817 podStartE2EDuration="1.989745164s" totalImagesPullingTime="542.263464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:43:07.987736245 +0000 UTC m=+2050.661735073" watchObservedRunningTime="2026-07-09 22:43:07.989745164 +0000 UTC m=+2050.663743966"
Jul 09 22:43:10.502090 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:10.502046    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:43:13.981861 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:13.981832    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"
Jul 09 22:43:18.488977 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:18.488933    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:43:18.588739 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:18.588706    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:43:19.991251 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:19.991160    2554 patch_prober.go:28] interesting pod/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 22:43:19.991251 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:19.991239    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj" podUID="63fb5e76-020a-4988-a712-d5e690474c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 22:43:22.045988 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:22.045949    2554 generic.go:356] "Generic (PLEG): container finished" podID="63fb5e76-020a-4988-a712-d5e690474c80" containerID="0f4b5b1602d848c1b50a14fe0634cbe1728fd4b4acea66a0208b77019a0e194b" exitCode=0
Jul 09 22:43:22.045988 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:22.045991    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj" event={"ID":"63fb5e76-020a-4988-a712-d5e690474c80","Type":"ContainerDied","Data":"0f4b5b1602d848c1b50a14fe0634cbe1728fd4b4acea66a0208b77019a0e194b"}
Jul 09 22:43:22.046466 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:22.046392    2554 scope.go:117] "RemoveContainer" containerID="0f4b5b1602d848c1b50a14fe0634cbe1728fd4b4acea66a0208b77019a0e194b"
Jul 09 22:43:22.047445 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:22.047412    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:43:22.047520 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:22.047503    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:43:22.047569 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:22.047554    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:43:23.055566 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:23.055524    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj" event={"ID":"63fb5e76-020a-4988-a712-d5e690474c80","Type":"ContainerStarted","Data":"ea127ec408bc02a37f23badbedf484840daf87648437edc3f2404a8fd4b88680"}
Jul 09 22:43:23.283064 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:23.282999    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:23.283314 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:23.283288    2554 patch_prober.go:28] interesting pod/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 09 22:43:23.283374 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:23.283353    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj" podUID="63fb5e76-020a-4988-a712-d5e690474c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 09 22:43:24.282524 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:24.282491    2554 patch_prober.go:28] interesting pod/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 09 22:43:24.282914 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:24.282553    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj" podUID="63fb5e76-020a-4988-a712-d5e690474c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 09 22:43:25.283205 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:25.283161    2554 patch_prober.go:28] interesting pod/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 09 22:43:25.283622 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:25.283226    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj" podUID="63fb5e76-020a-4988-a712-d5e690474c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 09 22:43:26.282784 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:26.282740    2554 patch_prober.go:28] interesting pod/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 09 22:43:26.282962 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:26.282803    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj" podUID="63fb5e76-020a-4988-a712-d5e690474c80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 09 22:43:27.286333 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:27.286300    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:27.286779 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:27.286583    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:27.287190 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:27.287174    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:43:27.661188 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:27.661156    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:43:27.763500 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:27.763467    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:43:31.123143 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:43:31.123108    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:44:03.134611 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:03.134573    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:44:24.267281 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:24.267234    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:44:25.231645 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:25.231614    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:44:25.509824 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:25.509728    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:44:25.979931 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:25.979896    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:44:26.262049 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:26.261932    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:44:26.355156 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:26.355121    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:44:26.516488 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:26.516407    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"]
Jul 09 22:44:26.516947 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:26.516701    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk" podUID="eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce" containerName="maas-api" containerID="cri-o://8e16b0b76eeedb370a9ee69a45117db3901a9ab332fe2e049a754d822e19ff63" gracePeriod=30
Jul 09 22:44:26.546408 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:26.546379    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:44:26.777818 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:26.777759    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"
Jul 09 22:44:26.867876 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:26.867849    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-openshift-service-ca\") pod \"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce\" (UID: \"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce\") "
Jul 09 22:44:26.868076 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:26.867883    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkb5q\" (UniqueName: \"kubernetes.io/projected/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-kube-api-access-dkb5q\") pod \"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce\" (UID: \"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce\") "
Jul 09 22:44:26.868076 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:26.867923    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-maas-api-tls\") pod \"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce\" (UID: \"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce\") "
Jul 09 22:44:26.868268 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:26.868241    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce" (UID: "eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:44:26.870065 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:26.870027    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce" (UID: "eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:44:26.870065 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:26.870024    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-kube-api-access-dkb5q" (OuterVolumeSpecName: "kube-api-access-dkb5q") pod "eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce" (UID: "eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce"). InnerVolumeSpecName "kube-api-access-dkb5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:44:26.969489 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:26.969456    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-maas-api-tls\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:44:26.969489 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:26.969486    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-openshift-service-ca\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:44:26.969489 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:26.969495    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkb5q\" (UniqueName: \"kubernetes.io/projected/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce-kube-api-access-dkb5q\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:44:27.372373 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:27.372340    2554 generic.go:356] "Generic (PLEG): container finished" podID="eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce" containerID="8e16b0b76eeedb370a9ee69a45117db3901a9ab332fe2e049a754d822e19ff63" exitCode=0
Jul 09 22:44:27.372557 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:27.372389    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"
Jul 09 22:44:27.372557 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:27.372430    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk" event={"ID":"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce","Type":"ContainerDied","Data":"8e16b0b76eeedb370a9ee69a45117db3901a9ab332fe2e049a754d822e19ff63"}
Jul 09 22:44:27.372557 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:27.372482    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk" event={"ID":"eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce","Type":"ContainerDied","Data":"d5773ee917b9f7673582e0ef38f2b735bac899742c8ad097e7e1ddc6d92926fa"}
Jul 09 22:44:27.372557 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:27.372506    2554 scope.go:117] "RemoveContainer" containerID="8e16b0b76eeedb370a9ee69a45117db3901a9ab332fe2e049a754d822e19ff63"
Jul 09 22:44:27.383833 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:27.383801    2554 scope.go:117] "RemoveContainer" containerID="8e16b0b76eeedb370a9ee69a45117db3901a9ab332fe2e049a754d822e19ff63"
Jul 09 22:44:27.384268 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:44:27.384241    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e16b0b76eeedb370a9ee69a45117db3901a9ab332fe2e049a754d822e19ff63\": container with ID starting with 8e16b0b76eeedb370a9ee69a45117db3901a9ab332fe2e049a754d822e19ff63 not found: ID does not exist" containerID="8e16b0b76eeedb370a9ee69a45117db3901a9ab332fe2e049a754d822e19ff63"
Jul 09 22:44:27.384367 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:27.384288    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e16b0b76eeedb370a9ee69a45117db3901a9ab332fe2e049a754d822e19ff63"} err="failed to get container status \"8e16b0b76eeedb370a9ee69a45117db3901a9ab332fe2e049a754d822e19ff63\": rpc error: code = NotFound desc = could not find container \"8e16b0b76eeedb370a9ee69a45117db3901a9ab332fe2e049a754d822e19ff63\": container with ID starting with 8e16b0b76eeedb370a9ee69a45117db3901a9ab332fe2e049a754d822e19ff63 not found: ID does not exist"
Jul 09 22:44:27.395249 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:27.395222    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"]
Jul 09 22:44:27.399235 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:27.399213    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0295ed-54967d97d9-bdfqk"]
Jul 09 22:44:27.881965 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:27.881930    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce" path="/var/lib/kubelet/pods/eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce/volumes"
Jul 09 22:44:30.997915 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:44:30.997879    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:08.325059 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:08.324997    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:09.746865 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:09.746834    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:09.859293 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:09.859264    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"]
Jul 09 22:45:09.859543 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:09.859517    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p" podUID="cc2bff97-8cbf-4e50-ab97-49037825b633" containerName="maas-api" containerID="cri-o://c8a1f960a8a92fa1a2b14fd5c1d9f5024b7916af8ac46c0a0bfad68bbc5645ca" gracePeriod=30
Jul 09 22:45:09.890443 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:09.890412    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:10.100823 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.100801    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"
Jul 09 22:45:10.234579 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.234540    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc2bff97-8cbf-4e50-ab97-49037825b633-maas-api-tls\") pod \"cc2bff97-8cbf-4e50-ab97-49037825b633\" (UID: \"cc2bff97-8cbf-4e50-ab97-49037825b633\") "
Jul 09 22:45:10.234749 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.234594    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc2bff97-8cbf-4e50-ab97-49037825b633-openshift-service-ca\") pod \"cc2bff97-8cbf-4e50-ab97-49037825b633\" (UID: \"cc2bff97-8cbf-4e50-ab97-49037825b633\") "
Jul 09 22:45:10.234749 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.234617    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfkfq\" (UniqueName: \"kubernetes.io/projected/cc2bff97-8cbf-4e50-ab97-49037825b633-kube-api-access-dfkfq\") pod \"cc2bff97-8cbf-4e50-ab97-49037825b633\" (UID: \"cc2bff97-8cbf-4e50-ab97-49037825b633\") "
Jul 09 22:45:10.235026 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.235000    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc2bff97-8cbf-4e50-ab97-49037825b633-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cc2bff97-8cbf-4e50-ab97-49037825b633" (UID: "cc2bff97-8cbf-4e50-ab97-49037825b633"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:45:10.236673 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.236650    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc2bff97-8cbf-4e50-ab97-49037825b633-kube-api-access-dfkfq" (OuterVolumeSpecName: "kube-api-access-dfkfq") pod "cc2bff97-8cbf-4e50-ab97-49037825b633" (UID: "cc2bff97-8cbf-4e50-ab97-49037825b633"). InnerVolumeSpecName "kube-api-access-dfkfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:45:10.236783 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.236681    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc2bff97-8cbf-4e50-ab97-49037825b633-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cc2bff97-8cbf-4e50-ab97-49037825b633" (UID: "cc2bff97-8cbf-4e50-ab97-49037825b633"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:45:10.336080 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.335981    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc2bff97-8cbf-4e50-ab97-49037825b633-maas-api-tls\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:10.336080 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.336010    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc2bff97-8cbf-4e50-ab97-49037825b633-openshift-service-ca\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:10.336080 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.336020    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfkfq\" (UniqueName: \"kubernetes.io/projected/cc2bff97-8cbf-4e50-ab97-49037825b633-kube-api-access-dfkfq\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:10.578366 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.578333    2554 generic.go:356] "Generic (PLEG): container finished" podID="cc2bff97-8cbf-4e50-ab97-49037825b633" containerID="c8a1f960a8a92fa1a2b14fd5c1d9f5024b7916af8ac46c0a0bfad68bbc5645ca" exitCode=0
Jul 09 22:45:10.578366 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.578370    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p" event={"ID":"cc2bff97-8cbf-4e50-ab97-49037825b633","Type":"ContainerDied","Data":"c8a1f960a8a92fa1a2b14fd5c1d9f5024b7916af8ac46c0a0bfad68bbc5645ca"}
Jul 09 22:45:10.578571 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.578376    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"
Jul 09 22:45:10.578571 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.578408    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p" event={"ID":"cc2bff97-8cbf-4e50-ab97-49037825b633","Type":"ContainerDied","Data":"2e42199a549bcdbf9f2e63c1886542d1b501efc185170423aa64947c1a252f0c"}
Jul 09 22:45:10.578571 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.578428    2554 scope.go:117] "RemoveContainer" containerID="c8a1f960a8a92fa1a2b14fd5c1d9f5024b7916af8ac46c0a0bfad68bbc5645ca"
Jul 09 22:45:10.587108 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.587090    2554 scope.go:117] "RemoveContainer" containerID="c8a1f960a8a92fa1a2b14fd5c1d9f5024b7916af8ac46c0a0bfad68bbc5645ca"
Jul 09 22:45:10.587352 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:45:10.587335    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8a1f960a8a92fa1a2b14fd5c1d9f5024b7916af8ac46c0a0bfad68bbc5645ca\": container with ID starting with c8a1f960a8a92fa1a2b14fd5c1d9f5024b7916af8ac46c0a0bfad68bbc5645ca not found: ID does not exist" containerID="c8a1f960a8a92fa1a2b14fd5c1d9f5024b7916af8ac46c0a0bfad68bbc5645ca"
Jul 09 22:45:10.587397 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.587359    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8a1f960a8a92fa1a2b14fd5c1d9f5024b7916af8ac46c0a0bfad68bbc5645ca"} err="failed to get container status \"c8a1f960a8a92fa1a2b14fd5c1d9f5024b7916af8ac46c0a0bfad68bbc5645ca\": rpc error: code = NotFound desc = could not find container \"c8a1f960a8a92fa1a2b14fd5c1d9f5024b7916af8ac46c0a0bfad68bbc5645ca\": container with ID starting with c8a1f960a8a92fa1a2b14fd5c1d9f5024b7916af8ac46c0a0bfad68bbc5645ca not found: ID does not exist"
Jul 09 22:45:10.599955 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.599930    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"]
Jul 09 22:45:10.606228 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:10.606207    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c31bfc-7bbf6dc8cc-qkk2p"]
Jul 09 22:45:11.882144 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:11.882113    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc2bff97-8cbf-4e50-ab97-49037825b633" path="/var/lib/kubelet/pods/cc2bff97-8cbf-4e50-ab97-49037825b633/volumes"
Jul 09 22:45:15.521049 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:15.521010    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:15.627811 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:15.627775    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:15.784683 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:15.784596    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"]
Jul 09 22:45:15.784837 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:15.784799    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj" podUID="63fb5e76-020a-4988-a712-d5e690474c80" containerName="istio-proxy" containerID="cri-o://ea127ec408bc02a37f23badbedf484840daf87648437edc3f2404a8fd4b88680" gracePeriod=30
Jul 09 22:45:15.804811 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:15.804777    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:16.120189 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:16.120147    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:16.512383 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:16.512298    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:16.761286 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:16.761253    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:17.199940 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:17.199907    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:19.557699 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.557662    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:19.638582 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.638548    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"]
Jul 09 22:45:19.638923 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.638908    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc2bff97-8cbf-4e50-ab97-49037825b633" containerName="maas-api"
Jul 09 22:45:19.638976 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.638925    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc2bff97-8cbf-4e50-ab97-49037825b633" containerName="maas-api"
Jul 09 22:45:19.638976 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.638943    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce" containerName="maas-api"
Jul 09 22:45:19.638976 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.638950    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce" containerName="maas-api"
Jul 09 22:45:19.639162 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.639006    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc2bff97-8cbf-4e50-ab97-49037825b633" containerName="maas-api"
Jul 09 22:45:19.639162 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.639016    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb1b56c7-fb61-4219-8dec-88a7e3fcb4ce" containerName="maas-api"
Jul 09 22:45:19.643268 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.643248    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"
Jul 09 22:45:19.645819 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.645798    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-ce834b-serving-cert\""
Jul 09 22:45:19.663400 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.663366    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:19.665285 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.665259    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"]
Jul 09 22:45:19.758178 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.758146    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:19.819245 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.819167    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lrdz\" (UniqueName: \"kubernetes.io/projected/4c48b54c-e268-4485-a321-8219e43cdf3b-kube-api-access-2lrdz\") pod \"maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp\" (UID: \"4c48b54c-e268-4485-a321-8219e43cdf3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"
Jul 09 22:45:19.819245 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.819219    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c48b54c-e268-4485-a321-8219e43cdf3b-maas-api-tls\") pod \"maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp\" (UID: \"4c48b54c-e268-4485-a321-8219e43cdf3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"
Jul 09 22:45:19.819421 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.819287    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c48b54c-e268-4485-a321-8219e43cdf3b-openshift-service-ca\") pod \"maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp\" (UID: \"4c48b54c-e268-4485-a321-8219e43cdf3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"
Jul 09 22:45:19.884893 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.884855    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:19.920571 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.920532    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c48b54c-e268-4485-a321-8219e43cdf3b-maas-api-tls\") pod \"maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp\" (UID: \"4c48b54c-e268-4485-a321-8219e43cdf3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"
Jul 09 22:45:19.920752 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.920596    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c48b54c-e268-4485-a321-8219e43cdf3b-openshift-service-ca\") pod \"maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp\" (UID: \"4c48b54c-e268-4485-a321-8219e43cdf3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"
Jul 09 22:45:19.920752 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.920656    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lrdz\" (UniqueName: \"kubernetes.io/projected/4c48b54c-e268-4485-a321-8219e43cdf3b-kube-api-access-2lrdz\") pod \"maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp\" (UID: \"4c48b54c-e268-4485-a321-8219e43cdf3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"
Jul 09 22:45:19.921288 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.921263    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c48b54c-e268-4485-a321-8219e43cdf3b-openshift-service-ca\") pod \"maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp\" (UID: \"4c48b54c-e268-4485-a321-8219e43cdf3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"
Jul 09 22:45:19.922963 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.922945    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c48b54c-e268-4485-a321-8219e43cdf3b-maas-api-tls\") pod \"maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp\" (UID: \"4c48b54c-e268-4485-a321-8219e43cdf3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"
Jul 09 22:45:19.932879 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.932859    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lrdz\" (UniqueName: \"kubernetes.io/projected/4c48b54c-e268-4485-a321-8219e43cdf3b-kube-api-access-2lrdz\") pod \"maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp\" (UID: \"4c48b54c-e268-4485-a321-8219e43cdf3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"
Jul 09 22:45:19.952964 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:19.952939    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"
Jul 09 22:45:20.087671 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:20.087646    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"]
Jul 09 22:45:20.089376 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:45:20.089347    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c48b54c_e268_4485_a321_8219e43cdf3b.slice/crio-3fedc15741faf53b9fcf10395787a53e78e89beb07c4c8270d142adb2880ed1e WatchSource:0}: Error finding container 3fedc15741faf53b9fcf10395787a53e78e89beb07c4c8270d142adb2880ed1e: Status 404 returned error can't find the container with id 3fedc15741faf53b9fcf10395787a53e78e89beb07c4c8270d142adb2880ed1e
Jul 09 22:45:20.241423 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:20.241393    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:20.342486 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:20.342405    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:20.628012 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:20.627981    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp" event={"ID":"4c48b54c-e268-4485-a321-8219e43cdf3b","Type":"ContainerStarted","Data":"f5bcd29be5ab2c5defb43d0e5b554f0e7a3eb862f714e834bae8e7a39e9ab679"}
Jul 09 22:45:20.628432 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:20.628053    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp" event={"ID":"4c48b54c-e268-4485-a321-8219e43cdf3b","Type":"ContainerStarted","Data":"3fedc15741faf53b9fcf10395787a53e78e89beb07c4c8270d142adb2880ed1e"}
Jul 09 22:45:20.628432 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:20.628108    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"
Jul 09 22:45:20.648815 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:20.648755    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp" podStartSLOduration=1.201424205 podStartE2EDuration="1.648734403s" totalImagesPullingTime="447.310198ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:45:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:45:20.648217407 +0000 UTC m=+2183.322216210" watchObservedRunningTime="2026-07-09 22:45:20.648734403 +0000 UTC m=+2183.322733207"
Jul 09 22:45:21.028145 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.028122    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:45:21.131142 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.131107    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-workload-socket\") pod \"63fb5e76-020a-4988-a712-d5e690474c80\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") "
Jul 09 22:45:21.131300 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.131173    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63fb5e76-020a-4988-a712-d5e690474c80-istiod-ca-cert\") pod \"63fb5e76-020a-4988-a712-d5e690474c80\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") "
Jul 09 22:45:21.131300 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.131205    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-istio-envoy\") pod \"63fb5e76-020a-4988-a712-d5e690474c80\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") "
Jul 09 22:45:21.131300 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.131231    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63fb5e76-020a-4988-a712-d5e690474c80-istio-podinfo\") pod \"63fb5e76-020a-4988-a712-d5e690474c80\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") "
Jul 09 22:45:21.131300 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.131260    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-credential-socket\") pod \"63fb5e76-020a-4988-a712-d5e690474c80\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") "
Jul 09 22:45:21.131476 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.131346    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-workload-certs\") pod \"63fb5e76-020a-4988-a712-d5e690474c80\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") "
Jul 09 22:45:21.131476 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.131363    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "63fb5e76-020a-4988-a712-d5e690474c80" (UID: "63fb5e76-020a-4988-a712-d5e690474c80"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:45:21.131476 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.131394    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63fb5e76-020a-4988-a712-d5e690474c80-istio-token\") pod \"63fb5e76-020a-4988-a712-d5e690474c80\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") "
Jul 09 22:45:21.131476 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.131423    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-istio-data\") pod \"63fb5e76-020a-4988-a712-d5e690474c80\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") "
Jul 09 22:45:21.131476 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.131446    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xchql\" (UniqueName: \"kubernetes.io/projected/63fb5e76-020a-4988-a712-d5e690474c80-kube-api-access-xchql\") pod \"63fb5e76-020a-4988-a712-d5e690474c80\" (UID: \"63fb5e76-020a-4988-a712-d5e690474c80\") "
Jul 09 22:45:21.131726 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.131591    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "63fb5e76-020a-4988-a712-d5e690474c80" (UID: "63fb5e76-020a-4988-a712-d5e690474c80"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:45:21.131726 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.131713    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63fb5e76-020a-4988-a712-d5e690474c80-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "63fb5e76-020a-4988-a712-d5e690474c80" (UID: "63fb5e76-020a-4988-a712-d5e690474c80"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:45:21.131834 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.131726    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-credential-socket\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:21.131834 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.131742    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-workload-socket\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:21.131947 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.131864    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "63fb5e76-020a-4988-a712-d5e690474c80" (UID: "63fb5e76-020a-4988-a712-d5e690474c80"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:45:21.132363 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.132331    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-istio-data" (OuterVolumeSpecName: "istio-data") pod "63fb5e76-020a-4988-a712-d5e690474c80" (UID: "63fb5e76-020a-4988-a712-d5e690474c80"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:45:21.133642 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.133616    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "63fb5e76-020a-4988-a712-d5e690474c80" (UID: "63fb5e76-020a-4988-a712-d5e690474c80"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:45:21.133715 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.133625    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63fb5e76-020a-4988-a712-d5e690474c80-kube-api-access-xchql" (OuterVolumeSpecName: "kube-api-access-xchql") pod "63fb5e76-020a-4988-a712-d5e690474c80" (UID: "63fb5e76-020a-4988-a712-d5e690474c80"). InnerVolumeSpecName "kube-api-access-xchql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:45:21.133908 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.133880    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63fb5e76-020a-4988-a712-d5e690474c80-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "63fb5e76-020a-4988-a712-d5e690474c80" (UID: "63fb5e76-020a-4988-a712-d5e690474c80"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 22:45:21.134013 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.133883    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63fb5e76-020a-4988-a712-d5e690474c80-istio-token" (OuterVolumeSpecName: "istio-token") pod "63fb5e76-020a-4988-a712-d5e690474c80" (UID: "63fb5e76-020a-4988-a712-d5e690474c80"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:45:21.233219 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.233140    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63fb5e76-020a-4988-a712-d5e690474c80-istio-podinfo\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:21.233219 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.233165    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-workload-certs\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:21.233219 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.233175    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63fb5e76-020a-4988-a712-d5e690474c80-istio-token\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:21.233219 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.233182    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-istio-data\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:21.233219 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.233191    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xchql\" (UniqueName: \"kubernetes.io/projected/63fb5e76-020a-4988-a712-d5e690474c80-kube-api-access-xchql\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:21.233219 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.233200    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63fb5e76-020a-4988-a712-d5e690474c80-istiod-ca-cert\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:21.233219 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.233208    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63fb5e76-020a-4988-a712-d5e690474c80-istio-envoy\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:21.634228 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.634194    2554 generic.go:356] "Generic (PLEG): container finished" podID="63fb5e76-020a-4988-a712-d5e690474c80" containerID="ea127ec408bc02a37f23badbedf484840daf87648437edc3f2404a8fd4b88680" exitCode=0
Jul 09 22:45:21.634624 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.634245    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"
Jul 09 22:45:21.634624 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.634277    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj" event={"ID":"63fb5e76-020a-4988-a712-d5e690474c80","Type":"ContainerDied","Data":"ea127ec408bc02a37f23badbedf484840daf87648437edc3f2404a8fd4b88680"}
Jul 09 22:45:21.634624 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.634334    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj" event={"ID":"63fb5e76-020a-4988-a712-d5e690474c80","Type":"ContainerDied","Data":"94df0026527d5ee724941386dafa3f8794c650919b9c9581eff4a60c1ecb0c3a"}
Jul 09 22:45:21.634624 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.634369    2554 scope.go:117] "RemoveContainer" containerID="ea127ec408bc02a37f23badbedf484840daf87648437edc3f2404a8fd4b88680"
Jul 09 22:45:21.643593 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.643575    2554 scope.go:117] "RemoveContainer" containerID="0f4b5b1602d848c1b50a14fe0634cbe1728fd4b4acea66a0208b77019a0e194b"
Jul 09 22:45:21.651285 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.651260    2554 scope.go:117] "RemoveContainer" containerID="ea127ec408bc02a37f23badbedf484840daf87648437edc3f2404a8fd4b88680"
Jul 09 22:45:21.651535 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:45:21.651516    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea127ec408bc02a37f23badbedf484840daf87648437edc3f2404a8fd4b88680\": container with ID starting with ea127ec408bc02a37f23badbedf484840daf87648437edc3f2404a8fd4b88680 not found: ID does not exist" containerID="ea127ec408bc02a37f23badbedf484840daf87648437edc3f2404a8fd4b88680"
Jul 09 22:45:21.651610 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.651543    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea127ec408bc02a37f23badbedf484840daf87648437edc3f2404a8fd4b88680"} err="failed to get container status \"ea127ec408bc02a37f23badbedf484840daf87648437edc3f2404a8fd4b88680\": rpc error: code = NotFound desc = could not find container \"ea127ec408bc02a37f23badbedf484840daf87648437edc3f2404a8fd4b88680\": container with ID starting with ea127ec408bc02a37f23badbedf484840daf87648437edc3f2404a8fd4b88680 not found: ID does not exist"
Jul 09 22:45:21.651610 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.651560    2554 scope.go:117] "RemoveContainer" containerID="0f4b5b1602d848c1b50a14fe0634cbe1728fd4b4acea66a0208b77019a0e194b"
Jul 09 22:45:21.651814 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:45:21.651794    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f4b5b1602d848c1b50a14fe0634cbe1728fd4b4acea66a0208b77019a0e194b\": container with ID starting with 0f4b5b1602d848c1b50a14fe0634cbe1728fd4b4acea66a0208b77019a0e194b not found: ID does not exist" containerID="0f4b5b1602d848c1b50a14fe0634cbe1728fd4b4acea66a0208b77019a0e194b"
Jul 09 22:45:21.651860 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.651818    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f4b5b1602d848c1b50a14fe0634cbe1728fd4b4acea66a0208b77019a0e194b"} err="failed to get container status \"0f4b5b1602d848c1b50a14fe0634cbe1728fd4b4acea66a0208b77019a0e194b\": rpc error: code = NotFound desc = could not find container \"0f4b5b1602d848c1b50a14fe0634cbe1728fd4b4acea66a0208b77019a0e194b\": container with ID starting with 0f4b5b1602d848c1b50a14fe0634cbe1728fd4b4acea66a0208b77019a0e194b not found: ID does not exist"
Jul 09 22:45:21.662234 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.662208    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"]
Jul 09 22:45:21.667083 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.667056    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c31bfc-openshift-default-65b8d5478c-qqswj"]
Jul 09 22:45:21.881560 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:21.881531    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63fb5e76-020a-4988-a712-d5e690474c80" path="/var/lib/kubelet/pods/63fb5e76-020a-4988-a712-d5e690474c80/volumes"
Jul 09 22:45:24.054167 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.054134    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:24.601343 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.601306    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:24.831082 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.831047    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"]
Jul 09 22:45:24.831371 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.831352    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63fb5e76-020a-4988-a712-d5e690474c80" containerName="istio-proxy"
Jul 09 22:45:24.831371 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.831367    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="63fb5e76-020a-4988-a712-d5e690474c80" containerName="istio-proxy"
Jul 09 22:45:24.831517 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.831380    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63fb5e76-020a-4988-a712-d5e690474c80" containerName="istio-proxy"
Jul 09 22:45:24.831517 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.831385    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="63fb5e76-020a-4988-a712-d5e690474c80" containerName="istio-proxy"
Jul 09 22:45:24.831517 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.831448    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="63fb5e76-020a-4988-a712-d5e690474c80" containerName="istio-proxy"
Jul 09 22:45:24.835828 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.835811    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:24.839229 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.839207    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-0a9101-openshift-default-dockercfg-d28px\""
Jul 09 22:45:24.847849 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.847829    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"]
Jul 09 22:45:24.860277 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.860218    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:24.959923 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.959873    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-workload-socket\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:24.959923 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.959928    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-istio-envoy\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:24.960144 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.959954    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-istio-data\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:24.960144 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.960003    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dab36368-ff91-475c-be5a-84e0043d2467-istio-podinfo\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:24.960144 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.960063    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-credential-socket\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:24.960144 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.960087    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-workload-certs\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:24.960144 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.960110    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dab36368-ff91-475c-be5a-84e0043d2467-istio-token\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:24.960144 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.960135    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dab36368-ff91-475c-be5a-84e0043d2467-istiod-ca-cert\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:24.960356 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:24.960206    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tsmq\" (UniqueName: \"kubernetes.io/projected/dab36368-ff91-475c-be5a-84e0043d2467-kube-api-access-2tsmq\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.061335 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.061287    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-istio-envoy\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.061335 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.061338    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-istio-data\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.061906 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.061359    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dab36368-ff91-475c-be5a-84e0043d2467-istio-podinfo\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.061906 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.061466    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-credential-socket\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.061906 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.061520    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-workload-certs\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.061906 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.061563    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dab36368-ff91-475c-be5a-84e0043d2467-istio-token\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.061906 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.061594    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dab36368-ff91-475c-be5a-84e0043d2467-istiod-ca-cert\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.061906 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.061672    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tsmq\" (UniqueName: \"kubernetes.io/projected/dab36368-ff91-475c-be5a-84e0043d2467-kube-api-access-2tsmq\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.061906 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.061709    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-istio-data\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.061906 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.061728    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-workload-socket\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.062352 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.062137    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-workload-certs\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.062352 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.062156    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-workload-socket\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.062352 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.062163    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-credential-socket\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.062578 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.062377    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dab36368-ff91-475c-be5a-84e0043d2467-istiod-ca-cert\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.063848 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.063826    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-istio-envoy\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.063960 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.063931    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dab36368-ff91-475c-be5a-84e0043d2467-istio-podinfo\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.065135 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.065112    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:25.069610 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.069585    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dab36368-ff91-475c-be5a-84e0043d2467-istio-token\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.070370 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.070351    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tsmq\" (UniqueName: \"kubernetes.io/projected/dab36368-ff91-475c-be5a-84e0043d2467-kube-api-access-2tsmq\") pod \"e2e-api-b-0a9101-openshift-default-687b46646f-pb25k\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") " pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.148515 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.148429    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:25.285220 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.285194    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"]
Jul 09 22:45:25.286867 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:45:25.286839    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab36368_ff91_475c_be5a_84e0043d2467.slice/crio-f3807073d521b2222dcb8eb83db397a94ecb919d8aaa962261d4b2bb682c5519 WatchSource:0}: Error finding container f3807073d521b2222dcb8eb83db397a94ecb919d8aaa962261d4b2bb682c5519: Status 404 returned error can't find the container with id f3807073d521b2222dcb8eb83db397a94ecb919d8aaa962261d4b2bb682c5519
Jul 09 22:45:25.289105 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.289074    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:45:25.289202 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.289137    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:45:25.289202 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.289165    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:45:25.656410 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.656374    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k" event={"ID":"dab36368-ff91-475c-be5a-84e0043d2467","Type":"ContainerStarted","Data":"6e3baff973dc3e80ff30a0f82ced26ba2644bc0fe737b9249f9de945089c8ebf"}
Jul 09 22:45:25.656596 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.656430    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k" event={"ID":"dab36368-ff91-475c-be5a-84e0043d2467","Type":"ContainerStarted","Data":"f3807073d521b2222dcb8eb83db397a94ecb919d8aaa962261d4b2bb682c5519"}
Jul 09 22:45:25.684910 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:25.684841    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k" podStartSLOduration=1.684820618 podStartE2EDuration="1.684820618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:45:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:45:25.681329235 +0000 UTC m=+2188.355328038" watchObservedRunningTime="2026-07-09 22:45:25.684820618 +0000 UTC m=+2188.358819421"
Jul 09 22:45:26.149003 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:26.148966    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:26.153954 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:26.153928    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:26.639971 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:26.639941    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"
Jul 09 22:45:26.661830 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:26.661800    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:26.662750 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:26.662733    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:27.602772 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:27.602736    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:27.701617 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:27.701583    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:28.170251 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:28.170210    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:28.272617 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:28.272580    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:28.576535 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:28.576461    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"]
Jul 09 22:45:28.576886 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:28.576872    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="63fb5e76-020a-4988-a712-d5e690474c80" containerName="istio-proxy"
Jul 09 22:45:28.579939 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:28.579922    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"
Jul 09 22:45:28.582838 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:28.582815    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-0a9101-serving-cert\""
Jul 09 22:45:28.591841 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:28.591814    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"]
Jul 09 22:45:28.611586 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:28.611556    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:28.697330 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:28.697295    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b994f39e-f3c0-4b69-b2eb-262553ca888e-maas-api-tls\") pod \"maas-api-e2e-api-b-0a9101-859f4c5646-bzt79\" (UID: \"b994f39e-f3c0-4b69-b2eb-262553ca888e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"
Jul 09 22:45:28.697498 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:28.697355    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b994f39e-f3c0-4b69-b2eb-262553ca888e-openshift-service-ca\") pod \"maas-api-e2e-api-b-0a9101-859f4c5646-bzt79\" (UID: \"b994f39e-f3c0-4b69-b2eb-262553ca888e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"
Jul 09 22:45:28.697498 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:28.697473    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5sv7\" (UniqueName: \"kubernetes.io/projected/b994f39e-f3c0-4b69-b2eb-262553ca888e-kube-api-access-m5sv7\") pod \"maas-api-e2e-api-b-0a9101-859f4c5646-bzt79\" (UID: \"b994f39e-f3c0-4b69-b2eb-262553ca888e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"
Jul 09 22:45:28.798793 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:28.798763    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5sv7\" (UniqueName: \"kubernetes.io/projected/b994f39e-f3c0-4b69-b2eb-262553ca888e-kube-api-access-m5sv7\") pod \"maas-api-e2e-api-b-0a9101-859f4c5646-bzt79\" (UID: \"b994f39e-f3c0-4b69-b2eb-262553ca888e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"
Jul 09 22:45:28.798793 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:28.798797    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b994f39e-f3c0-4b69-b2eb-262553ca888e-maas-api-tls\") pod \"maas-api-e2e-api-b-0a9101-859f4c5646-bzt79\" (UID: \"b994f39e-f3c0-4b69-b2eb-262553ca888e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"
Jul 09 22:45:28.799074 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:28.798861    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b994f39e-f3c0-4b69-b2eb-262553ca888e-openshift-service-ca\") pod \"maas-api-e2e-api-b-0a9101-859f4c5646-bzt79\" (UID: \"b994f39e-f3c0-4b69-b2eb-262553ca888e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"
Jul 09 22:45:28.799147 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:45:28.799076    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-serving-cert: secret "maas-api-e2e-api-b-0a9101-serving-cert" not found
Jul 09 22:45:28.799205 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:45:28.799180    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b994f39e-f3c0-4b69-b2eb-262553ca888e-maas-api-tls podName:b994f39e-f3c0-4b69-b2eb-262553ca888e nodeName:}" failed. No retries permitted until 2026-07-09 22:45:29.299156481 +0000 UTC m=+2191.973155279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b994f39e-f3c0-4b69-b2eb-262553ca888e-maas-api-tls") pod "maas-api-e2e-api-b-0a9101-859f4c5646-bzt79" (UID: "b994f39e-f3c0-4b69-b2eb-262553ca888e") : secret "maas-api-e2e-api-b-0a9101-serving-cert" not found
Jul 09 22:45:28.799565 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:28.799541    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b994f39e-f3c0-4b69-b2eb-262553ca888e-openshift-service-ca\") pod \"maas-api-e2e-api-b-0a9101-859f4c5646-bzt79\" (UID: \"b994f39e-f3c0-4b69-b2eb-262553ca888e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"
Jul 09 22:45:28.810593 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:28.810570    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5sv7\" (UniqueName: \"kubernetes.io/projected/b994f39e-f3c0-4b69-b2eb-262553ca888e-kube-api-access-m5sv7\") pod \"maas-api-e2e-api-b-0a9101-859f4c5646-bzt79\" (UID: \"b994f39e-f3c0-4b69-b2eb-262553ca888e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"
Jul 09 22:45:29.184931 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:29.184896    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:29.284307 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:29.284273    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:29.303403 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:29.303374    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b994f39e-f3c0-4b69-b2eb-262553ca888e-maas-api-tls\") pod \"maas-api-e2e-api-b-0a9101-859f4c5646-bzt79\" (UID: \"b994f39e-f3c0-4b69-b2eb-262553ca888e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"
Jul 09 22:45:29.303548 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:45:29.303514    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-serving-cert: secret "maas-api-e2e-api-b-0a9101-serving-cert" not found
Jul 09 22:45:29.303591 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:45:29.303571    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b994f39e-f3c0-4b69-b2eb-262553ca888e-maas-api-tls podName:b994f39e-f3c0-4b69-b2eb-262553ca888e nodeName:}" failed. No retries permitted until 2026-07-09 22:45:30.303556413 +0000 UTC m=+2192.977555194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b994f39e-f3c0-4b69-b2eb-262553ca888e-maas-api-tls") pod "maas-api-e2e-api-b-0a9101-859f4c5646-bzt79" (UID: "b994f39e-f3c0-4b69-b2eb-262553ca888e") : secret "maas-api-e2e-api-b-0a9101-serving-cert" not found
Jul 09 22:45:29.563129 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:29.563043    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:30.311394 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:30.311359    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b994f39e-f3c0-4b69-b2eb-262553ca888e-maas-api-tls\") pod \"maas-api-e2e-api-b-0a9101-859f4c5646-bzt79\" (UID: \"b994f39e-f3c0-4b69-b2eb-262553ca888e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"
Jul 09 22:45:30.313908 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:30.313881    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b994f39e-f3c0-4b69-b2eb-262553ca888e-maas-api-tls\") pod \"maas-api-e2e-api-b-0a9101-859f4c5646-bzt79\" (UID: \"b994f39e-f3c0-4b69-b2eb-262553ca888e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"
Jul 09 22:45:30.391850 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:30.391819    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"
Jul 09 22:45:30.524077 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:30.524023    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"]
Jul 09 22:45:30.526140 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:45:30.526117    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb994f39e_f3c0_4b69_b2eb_262553ca888e.slice/crio-231bd5e3892111fca62df31cecb4134081182c4195b349073f25f48cc76e0895 WatchSource:0}: Error finding container 231bd5e3892111fca62df31cecb4134081182c4195b349073f25f48cc76e0895: Status 404 returned error can't find the container with id 231bd5e3892111fca62df31cecb4134081182c4195b349073f25f48cc76e0895
Jul 09 22:45:30.681188 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:30.681157    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79" event={"ID":"b994f39e-f3c0-4b69-b2eb-262553ca888e","Type":"ContainerStarted","Data":"231bd5e3892111fca62df31cecb4134081182c4195b349073f25f48cc76e0895"}
Jul 09 22:45:31.687508 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:31.687459    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79" event={"ID":"b994f39e-f3c0-4b69-b2eb-262553ca888e","Type":"ContainerStarted","Data":"7d7154e976578dab8dc976744decc63db3030bc46626f036e960e4c93b259625"}
Jul 09 22:45:31.687925 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:31.687539    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"
Jul 09 22:45:32.136475 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:32.136438    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:37.698746 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:37.698714    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"
Jul 09 22:45:37.719079 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:37.719004    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79" podStartSLOduration=9.436284786 podStartE2EDuration="9.718987476s" totalImagesPullingTime="282.70269ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:45:31.752470117 +0000 UTC m=+2194.426468937" watchObservedRunningTime="2026-07-09 22:45:37.718987476 +0000 UTC m=+2200.392986278"
Jul 09 22:45:40.332507 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:40.332466    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:40.672876 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:40.672842    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:40.859078 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:40.859019    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:40.959251 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:40.959152    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:41.215075 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.214975    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"]
Jul 09 22:45:41.215242 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.215204    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp" podUID="4c48b54c-e268-4485-a321-8219e43cdf3b" containerName="maas-api" containerID="cri-o://f5bcd29be5ab2c5defb43d0e5b554f0e7a3eb862f714e834bae8e7a39e9ab679" gracePeriod=30
Jul 09 22:45:41.277660 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.277618    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:41.500340 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.500316    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"
Jul 09 22:45:41.612695 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.612660    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c48b54c-e268-4485-a321-8219e43cdf3b-openshift-service-ca\") pod \"4c48b54c-e268-4485-a321-8219e43cdf3b\" (UID: \"4c48b54c-e268-4485-a321-8219e43cdf3b\") "
Jul 09 22:45:41.612887 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.612703    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lrdz\" (UniqueName: \"kubernetes.io/projected/4c48b54c-e268-4485-a321-8219e43cdf3b-kube-api-access-2lrdz\") pod \"4c48b54c-e268-4485-a321-8219e43cdf3b\" (UID: \"4c48b54c-e268-4485-a321-8219e43cdf3b\") "
Jul 09 22:45:41.612887 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.612722    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c48b54c-e268-4485-a321-8219e43cdf3b-maas-api-tls\") pod \"4c48b54c-e268-4485-a321-8219e43cdf3b\" (UID: \"4c48b54c-e268-4485-a321-8219e43cdf3b\") "
Jul 09 22:45:41.613018 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.612978    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c48b54c-e268-4485-a321-8219e43cdf3b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4c48b54c-e268-4485-a321-8219e43cdf3b" (UID: "4c48b54c-e268-4485-a321-8219e43cdf3b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:45:41.613129 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.613095    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c48b54c-e268-4485-a321-8219e43cdf3b-openshift-service-ca\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:41.614804 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.614782    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c48b54c-e268-4485-a321-8219e43cdf3b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4c48b54c-e268-4485-a321-8219e43cdf3b" (UID: "4c48b54c-e268-4485-a321-8219e43cdf3b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:45:41.614909 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.614815    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c48b54c-e268-4485-a321-8219e43cdf3b-kube-api-access-2lrdz" (OuterVolumeSpecName: "kube-api-access-2lrdz") pod "4c48b54c-e268-4485-a321-8219e43cdf3b" (UID: "4c48b54c-e268-4485-a321-8219e43cdf3b"). InnerVolumeSpecName "kube-api-access-2lrdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:45:41.713480 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.713430    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lrdz\" (UniqueName: \"kubernetes.io/projected/4c48b54c-e268-4485-a321-8219e43cdf3b-kube-api-access-2lrdz\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:41.713480 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.713473    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c48b54c-e268-4485-a321-8219e43cdf3b-maas-api-tls\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:41.740528 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.740450    2554 generic.go:356] "Generic (PLEG): container finished" podID="4c48b54c-e268-4485-a321-8219e43cdf3b" containerID="f5bcd29be5ab2c5defb43d0e5b554f0e7a3eb862f714e834bae8e7a39e9ab679" exitCode=0
Jul 09 22:45:41.740528 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.740495    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"
Jul 09 22:45:41.740695 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.740537    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp" event={"ID":"4c48b54c-e268-4485-a321-8219e43cdf3b","Type":"ContainerDied","Data":"f5bcd29be5ab2c5defb43d0e5b554f0e7a3eb862f714e834bae8e7a39e9ab679"}
Jul 09 22:45:41.740695 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.740601    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp" event={"ID":"4c48b54c-e268-4485-a321-8219e43cdf3b","Type":"ContainerDied","Data":"3fedc15741faf53b9fcf10395787a53e78e89beb07c4c8270d142adb2880ed1e"}
Jul 09 22:45:41.740695 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.740623    2554 scope.go:117] "RemoveContainer" containerID="f5bcd29be5ab2c5defb43d0e5b554f0e7a3eb862f714e834bae8e7a39e9ab679"
Jul 09 22:45:41.762089 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.758680    2554 scope.go:117] "RemoveContainer" containerID="f5bcd29be5ab2c5defb43d0e5b554f0e7a3eb862f714e834bae8e7a39e9ab679"
Jul 09 22:45:41.765137 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:45:41.765093    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5bcd29be5ab2c5defb43d0e5b554f0e7a3eb862f714e834bae8e7a39e9ab679\": container with ID starting with f5bcd29be5ab2c5defb43d0e5b554f0e7a3eb862f714e834bae8e7a39e9ab679 not found: ID does not exist" containerID="f5bcd29be5ab2c5defb43d0e5b554f0e7a3eb862f714e834bae8e7a39e9ab679"
Jul 09 22:45:41.765277 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.765137    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5bcd29be5ab2c5defb43d0e5b554f0e7a3eb862f714e834bae8e7a39e9ab679"} err="failed to get container status \"f5bcd29be5ab2c5defb43d0e5b554f0e7a3eb862f714e834bae8e7a39e9ab679\": rpc error: code = NotFound desc = could not find container \"f5bcd29be5ab2c5defb43d0e5b554f0e7a3eb862f714e834bae8e7a39e9ab679\": container with ID starting with f5bcd29be5ab2c5defb43d0e5b554f0e7a3eb862f714e834bae8e7a39e9ab679 not found: ID does not exist"
Jul 09 22:45:41.778487 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.778464    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"]
Jul 09 22:45:41.781627 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.781606    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ce834b-7f4445d644-ghlxp"]
Jul 09 22:45:41.882367 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:41.882331    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c48b54c-e268-4485-a321-8219e43cdf3b" path="/var/lib/kubelet/pods/4c48b54c-e268-4485-a321-8219e43cdf3b/volumes"
Jul 09 22:45:44.757781 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:44.757750    2554 generic.go:356] "Generic (PLEG): container finished" podID="dab36368-ff91-475c-be5a-84e0043d2467" containerID="6e3baff973dc3e80ff30a0f82ced26ba2644bc0fe737b9249f9de945089c8ebf" exitCode=0
Jul 09 22:45:44.758166 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:44.757811    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k" event={"ID":"dab36368-ff91-475c-be5a-84e0043d2467","Type":"ContainerDied","Data":"6e3baff973dc3e80ff30a0f82ced26ba2644bc0fe737b9249f9de945089c8ebf"}
Jul 09 22:45:44.758221 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:44.758202    2554 scope.go:117] "RemoveContainer" containerID="6e3baff973dc3e80ff30a0f82ced26ba2644bc0fe737b9249f9de945089c8ebf"
Jul 09 22:45:44.759281 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:44.759253    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:45:44.759354 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:44.759318    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:45:44.759391 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:44.759354    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 22:45:45.769023 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:45.768980    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k" event={"ID":"dab36368-ff91-475c-be5a-84e0043d2467","Type":"ContainerStarted","Data":"0728bf9e749c89ccfbaa87d518a0fe64405ed317e4b7c0361b6da1620fb20882"}
Jul 09 22:45:46.149713 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:46.149672    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:46.149912 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:46.149799    2554 patch_prober.go:28] interesting pod/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 09 22:45:46.149912 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:46.149843    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k" podUID="dab36368-ff91-475c-be5a-84e0043d2467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 09 22:45:46.728839 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:46.728788    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:46.881498 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:46.881468    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:47.036363 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:47.036251    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:47.149617 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:47.149165    2554 patch_prober.go:28] interesting pod/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 09 22:45:47.149617 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:47.149225    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k" podUID="dab36368-ff91-475c-be5a-84e0043d2467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 09 22:45:47.316144 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:47.316014    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:47.564889 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:47.564857    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:47.918616 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:47.918586    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:48.047049 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.046999    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:48.147421 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.147379    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:48.149518 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.149481    2554 patch_prober.go:28] interesting pod/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 09 22:45:48.149680 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.149563    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k" podUID="dab36368-ff91-475c-be5a-84e0043d2467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 09 22:45:48.355994 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.355949    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"]
Jul 09 22:45:48.356511 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.356479    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79" podUID="b994f39e-f3c0-4b69-b2eb-262553ca888e" containerName="maas-api" containerID="cri-o://7d7154e976578dab8dc976744decc63db3030bc46626f036e960e4c93b259625" gracePeriod=30
Jul 09 22:45:48.391545 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.391220    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:48.629927 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.629905    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"
Jul 09 22:45:48.691253 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.691223    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b994f39e-f3c0-4b69-b2eb-262553ca888e-openshift-service-ca\") pod \"b994f39e-f3c0-4b69-b2eb-262553ca888e\" (UID: \"b994f39e-f3c0-4b69-b2eb-262553ca888e\") "
Jul 09 22:45:48.691452 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.691264    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5sv7\" (UniqueName: \"kubernetes.io/projected/b994f39e-f3c0-4b69-b2eb-262553ca888e-kube-api-access-m5sv7\") pod \"b994f39e-f3c0-4b69-b2eb-262553ca888e\" (UID: \"b994f39e-f3c0-4b69-b2eb-262553ca888e\") "
Jul 09 22:45:48.691452 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.691417    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b994f39e-f3c0-4b69-b2eb-262553ca888e-maas-api-tls\") pod \"b994f39e-f3c0-4b69-b2eb-262553ca888e\" (UID: \"b994f39e-f3c0-4b69-b2eb-262553ca888e\") "
Jul 09 22:45:48.691615 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.691592    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b994f39e-f3c0-4b69-b2eb-262553ca888e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b994f39e-f3c0-4b69-b2eb-262553ca888e" (UID: "b994f39e-f3c0-4b69-b2eb-262553ca888e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:45:48.691726 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.691709    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b994f39e-f3c0-4b69-b2eb-262553ca888e-openshift-service-ca\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:48.693284 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.693264    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b994f39e-f3c0-4b69-b2eb-262553ca888e-kube-api-access-m5sv7" (OuterVolumeSpecName: "kube-api-access-m5sv7") pod "b994f39e-f3c0-4b69-b2eb-262553ca888e" (UID: "b994f39e-f3c0-4b69-b2eb-262553ca888e"). InnerVolumeSpecName "kube-api-access-m5sv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:45:48.693360 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.693345    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b994f39e-f3c0-4b69-b2eb-262553ca888e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b994f39e-f3c0-4b69-b2eb-262553ca888e" (UID: "b994f39e-f3c0-4b69-b2eb-262553ca888e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:45:48.788179 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.788141    2554 generic.go:356] "Generic (PLEG): container finished" podID="b994f39e-f3c0-4b69-b2eb-262553ca888e" containerID="7d7154e976578dab8dc976744decc63db3030bc46626f036e960e4c93b259625" exitCode=0
Jul 09 22:45:48.788368 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.788191    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"
Jul 09 22:45:48.788368 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.788229    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79" event={"ID":"b994f39e-f3c0-4b69-b2eb-262553ca888e","Type":"ContainerDied","Data":"7d7154e976578dab8dc976744decc63db3030bc46626f036e960e4c93b259625"}
Jul 09 22:45:48.788368 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.788283    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79" event={"ID":"b994f39e-f3c0-4b69-b2eb-262553ca888e","Type":"ContainerDied","Data":"231bd5e3892111fca62df31cecb4134081182c4195b349073f25f48cc76e0895"}
Jul 09 22:45:48.788368 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.788308    2554 scope.go:117] "RemoveContainer" containerID="7d7154e976578dab8dc976744decc63db3030bc46626f036e960e4c93b259625"
Jul 09 22:45:48.792411 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.792378    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b994f39e-f3c0-4b69-b2eb-262553ca888e-maas-api-tls\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:48.792529 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.792407    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5sv7\" (UniqueName: \"kubernetes.io/projected/b994f39e-f3c0-4b69-b2eb-262553ca888e-kube-api-access-m5sv7\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:48.797212 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.797196    2554 scope.go:117] "RemoveContainer" containerID="7d7154e976578dab8dc976744decc63db3030bc46626f036e960e4c93b259625"
Jul 09 22:45:48.797438 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:45:48.797423    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d7154e976578dab8dc976744decc63db3030bc46626f036e960e4c93b259625\": container with ID starting with 7d7154e976578dab8dc976744decc63db3030bc46626f036e960e4c93b259625 not found: ID does not exist" containerID="7d7154e976578dab8dc976744decc63db3030bc46626f036e960e4c93b259625"
Jul 09 22:45:48.797492 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.797446    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d7154e976578dab8dc976744decc63db3030bc46626f036e960e4c93b259625"} err="failed to get container status \"7d7154e976578dab8dc976744decc63db3030bc46626f036e960e4c93b259625\": rpc error: code = NotFound desc = could not find container \"7d7154e976578dab8dc976744decc63db3030bc46626f036e960e4c93b259625\": container with ID starting with 7d7154e976578dab8dc976744decc63db3030bc46626f036e960e4c93b259625 not found: ID does not exist"
Jul 09 22:45:48.811661 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.811637    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"]
Jul 09 22:45:48.817075 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:48.817052    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0a9101-859f4c5646-bzt79"]
Jul 09 22:45:49.149274 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:49.149231    2554 patch_prober.go:28] interesting pod/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 09 22:45:49.149771 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:49.149310    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k" podUID="dab36368-ff91-475c-be5a-84e0043d2467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 09 22:45:49.880885 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:49.880851    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b994f39e-f3c0-4b69-b2eb-262553ca888e" path="/var/lib/kubelet/pods/b994f39e-f3c0-4b69-b2eb-262553ca888e/volumes"
Jul 09 22:45:50.153092 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:50.152996    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:50.153485 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:50.153469    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:50.154309 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:50.154288    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:53.978772 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:53.978735    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:54.089138 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:54.089098    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:54.237512 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:54.237436    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"]
Jul 09 22:45:54.237661 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:54.237629    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k" podUID="dab36368-ff91-475c-be5a-84e0043d2467" containerName="istio-proxy" containerID="cri-o://0728bf9e749c89ccfbaa87d518a0fe64405ed317e4b7c0361b6da1620fb20882" gracePeriod=30
Jul 09 22:45:54.262398 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:54.262368    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:54.480501 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:54.480473    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:54.818951 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:54.818917    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:55.162086 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:55.162028    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:55.536090 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:55.535976    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:57.808611 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:57.808570    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:57.906733 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:57.906702    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:57.927729 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:57.927701    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"]
Jul 09 22:45:57.928020 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:57.928006    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c48b54c-e268-4485-a321-8219e43cdf3b" containerName="maas-api"
Jul 09 22:45:57.928085 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:57.928023    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c48b54c-e268-4485-a321-8219e43cdf3b" containerName="maas-api"
Jul 09 22:45:57.928085 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:57.928047    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b994f39e-f3c0-4b69-b2eb-262553ca888e" containerName="maas-api"
Jul 09 22:45:57.928085 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:57.928053    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b994f39e-f3c0-4b69-b2eb-262553ca888e" containerName="maas-api"
Jul 09 22:45:57.928180 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:57.928128    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c48b54c-e268-4485-a321-8219e43cdf3b" containerName="maas-api"
Jul 09 22:45:57.928180 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:57.928137    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b994f39e-f3c0-4b69-b2eb-262553ca888e" containerName="maas-api"
Jul 09 22:45:57.932579 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:57.932563    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"
Jul 09 22:45:57.935516 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:57.935492    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-a70a31-serving-cert\""
Jul 09 22:45:57.943243 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:57.943221    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"]
Jul 09 22:45:58.022238 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.022210    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:58.074501 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.074411    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b14b21bb-7a98-4a14-977a-56502bc7d347-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7\" (UID: \"b14b21bb-7a98-4a14-977a-56502bc7d347\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"
Jul 09 22:45:58.074501 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.074464    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9l5n\" (UniqueName: \"kubernetes.io/projected/b14b21bb-7a98-4a14-977a-56502bc7d347-kube-api-access-f9l5n\") pod \"maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7\" (UID: \"b14b21bb-7a98-4a14-977a-56502bc7d347\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"
Jul 09 22:45:58.074695 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.074548    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b14b21bb-7a98-4a14-977a-56502bc7d347-maas-api-tls\") pod \"maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7\" (UID: \"b14b21bb-7a98-4a14-977a-56502bc7d347\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"
Jul 09 22:45:58.154903 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.154872    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:58.174980 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.174956    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b14b21bb-7a98-4a14-977a-56502bc7d347-maas-api-tls\") pod \"maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7\" (UID: \"b14b21bb-7a98-4a14-977a-56502bc7d347\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"
Jul 09 22:45:58.175193 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.175018    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b14b21bb-7a98-4a14-977a-56502bc7d347-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7\" (UID: \"b14b21bb-7a98-4a14-977a-56502bc7d347\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"
Jul 09 22:45:58.175193 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.175083    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9l5n\" (UniqueName: \"kubernetes.io/projected/b14b21bb-7a98-4a14-977a-56502bc7d347-kube-api-access-f9l5n\") pod \"maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7\" (UID: \"b14b21bb-7a98-4a14-977a-56502bc7d347\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"
Jul 09 22:45:58.175652 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.175629    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b14b21bb-7a98-4a14-977a-56502bc7d347-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7\" (UID: \"b14b21bb-7a98-4a14-977a-56502bc7d347\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"
Jul 09 22:45:58.177390 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.177373    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b14b21bb-7a98-4a14-977a-56502bc7d347-maas-api-tls\") pod \"maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7\" (UID: \"b14b21bb-7a98-4a14-977a-56502bc7d347\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"
Jul 09 22:45:58.188282 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.188166    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9l5n\" (UniqueName: \"kubernetes.io/projected/b14b21bb-7a98-4a14-977a-56502bc7d347-kube-api-access-f9l5n\") pod \"maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7\" (UID: \"b14b21bb-7a98-4a14-977a-56502bc7d347\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"
Jul 09 22:45:58.241948 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.241909    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"
Jul 09 22:45:58.377766 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.377745    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"]
Jul 09 22:45:58.379569 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:45:58.379543    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14b21bb_7a98_4a14_977a_56502bc7d347.slice/crio-99e913a7af21fa72da0e81a8ee6c0f5df861bb608f34de31cfb001dcfd37d4d4 WatchSource:0}: Error finding container 99e913a7af21fa72da0e81a8ee6c0f5df861bb608f34de31cfb001dcfd37d4d4: Status 404 returned error can't find the container with id 99e913a7af21fa72da0e81a8ee6c0f5df861bb608f34de31cfb001dcfd37d4d4
Jul 09 22:45:58.583357 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.583276    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:58.685960 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.685924    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:45:58.841455 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.841354    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7" event={"ID":"b14b21bb-7a98-4a14-977a-56502bc7d347","Type":"ContainerStarted","Data":"2f4f959fd4aa7adc053da33f71a58d8ebddb494957405da7c14767e5ba72f32f"}
Jul 09 22:45:58.841455 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.841416    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7" event={"ID":"b14b21bb-7a98-4a14-977a-56502bc7d347","Type":"ContainerStarted","Data":"99e913a7af21fa72da0e81a8ee6c0f5df861bb608f34de31cfb001dcfd37d4d4"}
Jul 09 22:45:58.841857 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.841459    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"
Jul 09 22:45:58.861237 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:58.861179    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7" podStartSLOduration=1.556288517 podStartE2EDuration="1.861163016s" totalImagesPullingTime="304.874499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:45:58.859688809 +0000 UTC m=+2221.533687612" watchObservedRunningTime="2026-07-09 22:45:58.861163016 +0000 UTC m=+2221.535161822"
Jul 09 22:45:59.499829 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.499779    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:59.588478 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.588443    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-workload-certs\") pod \"dab36368-ff91-475c-be5a-84e0043d2467\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") "
Jul 09 22:45:59.588718 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.588487    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-credential-socket\") pod \"dab36368-ff91-475c-be5a-84e0043d2467\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") "
Jul 09 22:45:59.588718 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.588540    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tsmq\" (UniqueName: \"kubernetes.io/projected/dab36368-ff91-475c-be5a-84e0043d2467-kube-api-access-2tsmq\") pod \"dab36368-ff91-475c-be5a-84e0043d2467\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") "
Jul 09 22:45:59.588718 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.588592    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dab36368-ff91-475c-be5a-84e0043d2467-istiod-ca-cert\") pod \"dab36368-ff91-475c-be5a-84e0043d2467\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") "
Jul 09 22:45:59.588718 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.588619    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-istio-data\") pod \"dab36368-ff91-475c-be5a-84e0043d2467\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") "
Jul 09 22:45:59.588718 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.588657    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dab36368-ff91-475c-be5a-84e0043d2467-istio-token\") pod \"dab36368-ff91-475c-be5a-84e0043d2467\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") "
Jul 09 22:45:59.588989 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.588758    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dab36368-ff91-475c-be5a-84e0043d2467-istio-podinfo\") pod \"dab36368-ff91-475c-be5a-84e0043d2467\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") "
Jul 09 22:45:59.588989 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.588804    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-workload-socket\") pod \"dab36368-ff91-475c-be5a-84e0043d2467\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") "
Jul 09 22:45:59.588989 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.588808    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dab36368-ff91-475c-be5a-84e0043d2467" (UID: "dab36368-ff91-475c-be5a-84e0043d2467"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:45:59.588989 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.588797    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dab36368-ff91-475c-be5a-84e0043d2467" (UID: "dab36368-ff91-475c-be5a-84e0043d2467"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:45:59.588989 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.588834    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-istio-envoy\") pod \"dab36368-ff91-475c-be5a-84e0043d2467\" (UID: \"dab36368-ff91-475c-be5a-84e0043d2467\") "
Jul 09 22:45:59.589283 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.589057    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dab36368-ff91-475c-be5a-84e0043d2467-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dab36368-ff91-475c-be5a-84e0043d2467" (UID: "dab36368-ff91-475c-be5a-84e0043d2467"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:45:59.589283 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.589068    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dab36368-ff91-475c-be5a-84e0043d2467" (UID: "dab36368-ff91-475c-be5a-84e0043d2467"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:45:59.589283 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.589225    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dab36368-ff91-475c-be5a-84e0043d2467-istiod-ca-cert\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:59.589283 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.589243    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-workload-socket\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:59.589283 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.589255    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-workload-certs\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:59.589283 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.589268    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-credential-socket\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:59.589612 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.589589    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-istio-data" (OuterVolumeSpecName: "istio-data") pod "dab36368-ff91-475c-be5a-84e0043d2467" (UID: "dab36368-ff91-475c-be5a-84e0043d2467"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:45:59.590920 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.590899    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dab36368-ff91-475c-be5a-84e0043d2467-istio-token" (OuterVolumeSpecName: "istio-token") pod "dab36368-ff91-475c-be5a-84e0043d2467" (UID: "dab36368-ff91-475c-be5a-84e0043d2467"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:45:59.591001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.590934    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dab36368-ff91-475c-be5a-84e0043d2467" (UID: "dab36368-ff91-475c-be5a-84e0043d2467"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:45:59.591001 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.590938    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dab36368-ff91-475c-be5a-84e0043d2467-kube-api-access-2tsmq" (OuterVolumeSpecName: "kube-api-access-2tsmq") pod "dab36368-ff91-475c-be5a-84e0043d2467" (UID: "dab36368-ff91-475c-be5a-84e0043d2467"). InnerVolumeSpecName "kube-api-access-2tsmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:45:59.591279 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.591263    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dab36368-ff91-475c-be5a-84e0043d2467-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dab36368-ff91-475c-be5a-84e0043d2467" (UID: "dab36368-ff91-475c-be5a-84e0043d2467"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 22:45:59.689886 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.689853    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tsmq\" (UniqueName: \"kubernetes.io/projected/dab36368-ff91-475c-be5a-84e0043d2467-kube-api-access-2tsmq\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:59.689886 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.689880    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-istio-data\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:59.689886 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.689889    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dab36368-ff91-475c-be5a-84e0043d2467-istio-token\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:59.690153 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.689897    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dab36368-ff91-475c-be5a-84e0043d2467-istio-podinfo\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:59.690153 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.689905    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dab36368-ff91-475c-be5a-84e0043d2467-istio-envoy\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:45:59.847483 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.847451    2554 generic.go:356] "Generic (PLEG): container finished" podID="dab36368-ff91-475c-be5a-84e0043d2467" containerID="0728bf9e749c89ccfbaa87d518a0fe64405ed317e4b7c0361b6da1620fb20882" exitCode=0
Jul 09 22:45:59.847873 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.847505    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"
Jul 09 22:45:59.847873 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.847537    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k" event={"ID":"dab36368-ff91-475c-be5a-84e0043d2467","Type":"ContainerDied","Data":"0728bf9e749c89ccfbaa87d518a0fe64405ed317e4b7c0361b6da1620fb20882"}
Jul 09 22:45:59.847873 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.847594    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k" event={"ID":"dab36368-ff91-475c-be5a-84e0043d2467","Type":"ContainerDied","Data":"f3807073d521b2222dcb8eb83db397a94ecb919d8aaa962261d4b2bb682c5519"}
Jul 09 22:45:59.847873 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.847622    2554 scope.go:117] "RemoveContainer" containerID="0728bf9e749c89ccfbaa87d518a0fe64405ed317e4b7c0361b6da1620fb20882"
Jul 09 22:45:59.864993 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.864966    2554 scope.go:117] "RemoveContainer" containerID="6e3baff973dc3e80ff30a0f82ced26ba2644bc0fe737b9249f9de945089c8ebf"
Jul 09 22:45:59.873108 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.873080    2554 scope.go:117] "RemoveContainer" containerID="0728bf9e749c89ccfbaa87d518a0fe64405ed317e4b7c0361b6da1620fb20882"
Jul 09 22:45:59.873376 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:45:59.873349    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0728bf9e749c89ccfbaa87d518a0fe64405ed317e4b7c0361b6da1620fb20882\": container with ID starting with 0728bf9e749c89ccfbaa87d518a0fe64405ed317e4b7c0361b6da1620fb20882 not found: ID does not exist" containerID="0728bf9e749c89ccfbaa87d518a0fe64405ed317e4b7c0361b6da1620fb20882"
Jul 09 22:45:59.873459 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.873383    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0728bf9e749c89ccfbaa87d518a0fe64405ed317e4b7c0361b6da1620fb20882"} err="failed to get container status \"0728bf9e749c89ccfbaa87d518a0fe64405ed317e4b7c0361b6da1620fb20882\": rpc error: code = NotFound desc = could not find container \"0728bf9e749c89ccfbaa87d518a0fe64405ed317e4b7c0361b6da1620fb20882\": container with ID starting with 0728bf9e749c89ccfbaa87d518a0fe64405ed317e4b7c0361b6da1620fb20882 not found: ID does not exist"
Jul 09 22:45:59.873459 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.873399    2554 scope.go:117] "RemoveContainer" containerID="6e3baff973dc3e80ff30a0f82ced26ba2644bc0fe737b9249f9de945089c8ebf"
Jul 09 22:45:59.873626 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:45:59.873612    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e3baff973dc3e80ff30a0f82ced26ba2644bc0fe737b9249f9de945089c8ebf\": container with ID starting with 6e3baff973dc3e80ff30a0f82ced26ba2644bc0fe737b9249f9de945089c8ebf not found: ID does not exist" containerID="6e3baff973dc3e80ff30a0f82ced26ba2644bc0fe737b9249f9de945089c8ebf"
Jul 09 22:45:59.873664 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.873629    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e3baff973dc3e80ff30a0f82ced26ba2644bc0fe737b9249f9de945089c8ebf"} err="failed to get container status \"6e3baff973dc3e80ff30a0f82ced26ba2644bc0fe737b9249f9de945089c8ebf\": rpc error: code = NotFound desc = could not find container \"6e3baff973dc3e80ff30a0f82ced26ba2644bc0fe737b9249f9de945089c8ebf\": container with ID starting with 6e3baff973dc3e80ff30a0f82ced26ba2644bc0fe737b9249f9de945089c8ebf not found: ID does not exist"
Jul 09 22:45:59.882775 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.882754    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"]
Jul 09 22:45:59.887531 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:45:59.887509    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-0a9101-openshift-default-687b46646f-pb25k"]
Jul 09 22:46:01.881788 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:01.881760    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dab36368-ff91-475c-be5a-84e0043d2467" path="/var/lib/kubelet/pods/dab36368-ff91-475c-be5a-84e0043d2467/volumes"
Jul 09 22:46:02.300290 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:02.300176    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:46:02.613646 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:02.613608    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:46:02.946127 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:02.946023    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:46:03.045927 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:03.045892    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:46:04.854395 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:04.854364    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"
Jul 09 22:46:05.822646 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:05.822610    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:46:05.936115 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:05.936078    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"]
Jul 09 22:46:05.936835 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:05.936809    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab36368-ff91-475c-be5a-84e0043d2467" containerName="istio-proxy"
Jul 09 22:46:05.936835 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:05.936833    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab36368-ff91-475c-be5a-84e0043d2467" containerName="istio-proxy"
Jul 09 22:46:05.937025 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:05.937013    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="dab36368-ff91-475c-be5a-84e0043d2467" containerName="istio-proxy"
Jul 09 22:46:05.937167 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:05.937153    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="dab36368-ff91-475c-be5a-84e0043d2467" containerName="istio-proxy"
Jul 09 22:46:05.941110 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:05.941087    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"
Jul 09 22:46:05.944353 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:05.944255    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-d3fb60-serving-cert\""
Jul 09 22:46:05.945131 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:05.945107    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:46:05.979346 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:05.979319    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"]
Jul 09 22:46:06.047180 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:06.047146    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4aea45d5-332e-4331-9c5b-c186510e28c7-maas-api-tls\") pod \"maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb\" (UID: \"4aea45d5-332e-4331-9c5b-c186510e28c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"
Jul 09 22:46:06.047387 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:06.047274    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj2rd\" (UniqueName: \"kubernetes.io/projected/4aea45d5-332e-4331-9c5b-c186510e28c7-kube-api-access-fj2rd\") pod \"maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb\" (UID: \"4aea45d5-332e-4331-9c5b-c186510e28c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"
Jul 09 22:46:06.047387 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:06.047320    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4aea45d5-332e-4331-9c5b-c186510e28c7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb\" (UID: \"4aea45d5-332e-4331-9c5b-c186510e28c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"
Jul 09 22:46:06.075356 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:06.075281    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:46:06.148549 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:06.148507    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj2rd\" (UniqueName: \"kubernetes.io/projected/4aea45d5-332e-4331-9c5b-c186510e28c7-kube-api-access-fj2rd\") pod \"maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb\" (UID: \"4aea45d5-332e-4331-9c5b-c186510e28c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"
Jul 09 22:46:06.148734 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:06.148556    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4aea45d5-332e-4331-9c5b-c186510e28c7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb\" (UID: \"4aea45d5-332e-4331-9c5b-c186510e28c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"
Jul 09 22:46:06.148734 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:06.148625    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4aea45d5-332e-4331-9c5b-c186510e28c7-maas-api-tls\") pod \"maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb\" (UID: \"4aea45d5-332e-4331-9c5b-c186510e28c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"
Jul 09 22:46:06.148734 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:46:06.148722    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-serving-cert: secret "maas-api-e2e-shared-b-d3fb60-serving-cert" not found
Jul 09 22:46:06.148838 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:46:06.148778    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aea45d5-332e-4331-9c5b-c186510e28c7-maas-api-tls podName:4aea45d5-332e-4331-9c5b-c186510e28c7 nodeName:}" failed. No retries permitted until 2026-07-09 22:46:06.648763099 +0000 UTC m=+2229.322761880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4aea45d5-332e-4331-9c5b-c186510e28c7-maas-api-tls") pod "maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb" (UID: "4aea45d5-332e-4331-9c5b-c186510e28c7") : secret "maas-api-e2e-shared-b-d3fb60-serving-cert" not found
Jul 09 22:46:06.149305 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:06.149283    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4aea45d5-332e-4331-9c5b-c186510e28c7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb\" (UID: \"4aea45d5-332e-4331-9c5b-c186510e28c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"
Jul 09 22:46:06.157829 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:06.157806    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj2rd\" (UniqueName: \"kubernetes.io/projected/4aea45d5-332e-4331-9c5b-c186510e28c7-kube-api-access-fj2rd\") pod \"maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb\" (UID: \"4aea45d5-332e-4331-9c5b-c186510e28c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"
Jul 09 22:46:06.217466 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:06.217433    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:46:06.578818 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:06.578781    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:46:06.654185 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:06.654145    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4aea45d5-332e-4331-9c5b-c186510e28c7-maas-api-tls\") pod \"maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb\" (UID: \"4aea45d5-332e-4331-9c5b-c186510e28c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"
Jul 09 22:46:06.656683 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:06.656634    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4aea45d5-332e-4331-9c5b-c186510e28c7-maas-api-tls\") pod \"maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb\" (UID: \"4aea45d5-332e-4331-9c5b-c186510e28c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"
Jul 09 22:46:06.672360 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:06.672326    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:46:06.852378 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:06.852353    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"
Jul 09 22:46:06.987901 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:06.987877    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"]
Jul 09 22:46:06.989619 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:46:06.989594    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aea45d5_332e_4331_9c5b_c186510e28c7.slice/crio-106ea94045ea46e570d3f9034bb6d74eb0e9531d123870ffb75375b8ef9b3b71 WatchSource:0}: Error finding container 106ea94045ea46e570d3f9034bb6d74eb0e9531d123870ffb75375b8ef9b3b71: Status 404 returned error can't find the container with id 106ea94045ea46e570d3f9034bb6d74eb0e9531d123870ffb75375b8ef9b3b71
Jul 09 22:46:07.888794 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:07.888760    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb" event={"ID":"4aea45d5-332e-4331-9c5b-c186510e28c7","Type":"ContainerStarted","Data":"d90db9dea3d6e8fb50d0dd7f7edf02827b67459e638a3fbdd8d8b14551d59d6e"}
Jul 09 22:46:07.888972 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:07.888812    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb" event={"ID":"4aea45d5-332e-4331-9c5b-c186510e28c7","Type":"ContainerStarted","Data":"106ea94045ea46e570d3f9034bb6d74eb0e9531d123870ffb75375b8ef9b3b71"}
Jul 09 22:46:07.888972 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:07.888856    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"
Jul 09 22:46:07.907506 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:07.907457    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb" podStartSLOduration=2.11953172 podStartE2EDuration="2.907441935s" totalImagesPullingTime="787.910215ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:46:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:46:07.905668273 +0000 UTC m=+2230.579667097" watchObservedRunningTime="2026-07-09 22:46:07.907441935 +0000 UTC m=+2230.581440737"
Jul 09 22:46:10.294212 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:10.294163    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:46:13.898388 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:13.898359    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"
Jul 09 22:46:20.523606 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:20.523527    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:46:20.628972 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:20.628913    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:46:22.933705 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:22.933675    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:46:27.638296 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:27.638261    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:46:27.759884 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:27.759852    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:46:41.881721 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:46:41.881673    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:47:36.225843 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:47:36.225809    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:48:20.238649 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:48:20.238569    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:48:20.382668 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:48:20.382634    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:48:31.035293 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:48:31.035258    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:48:51.735560 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:48:51.735519    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:48:52.706976 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:48:52.706942    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:49:06.340015 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:49:06.339975    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:49:47.935782 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:49:47.935741    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:49:53.942656 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:49:53.942615    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:50:03.119157 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:50:03.119119    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:50:29.299687 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:50:29.299652    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:50:30.467199 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:50:30.467164    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:50:39.506280 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:50:39.506247    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:50:40.520556 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:50:40.520494    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:50:43.830215 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:50:43.830174    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:50:43.951584 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:50:43.951549    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:51:21.459158 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:51:21.459121    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:51:21.563691 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:51:21.563646    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:51:28.616909 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:51:28.616874    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:51:28.717138 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:51:28.717083    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:51:44.133702 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:51:44.133665    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:52:27.532231 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:27.532178    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:52:28.381873 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:28.381828    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:52:47.556758 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:47.556697    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:52:47.949561 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:47.949525    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:52:48.108929 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.108896    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:52:48.264028 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.263940    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:52:48.375862 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.375827    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"]
Jul 09 22:52:48.376066 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.376027    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7" podUID="b14b21bb-7a98-4a14-977a-56502bc7d347" containerName="maas-api" containerID="cri-o://2f4f959fd4aa7adc053da33f71a58d8ebddb494957405da7c14767e5ba72f32f" gracePeriod=30
Jul 09 22:52:48.411858 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.411830    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:52:48.623103 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.623081    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"
Jul 09 22:52:48.683886 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.683846    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b14b21bb-7a98-4a14-977a-56502bc7d347-openshift-service-ca\") pod \"b14b21bb-7a98-4a14-977a-56502bc7d347\" (UID: \"b14b21bb-7a98-4a14-977a-56502bc7d347\") "
Jul 09 22:52:48.683886 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.683885    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9l5n\" (UniqueName: \"kubernetes.io/projected/b14b21bb-7a98-4a14-977a-56502bc7d347-kube-api-access-f9l5n\") pod \"b14b21bb-7a98-4a14-977a-56502bc7d347\" (UID: \"b14b21bb-7a98-4a14-977a-56502bc7d347\") "
Jul 09 22:52:48.684132 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.683934    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b14b21bb-7a98-4a14-977a-56502bc7d347-maas-api-tls\") pod \"b14b21bb-7a98-4a14-977a-56502bc7d347\" (UID: \"b14b21bb-7a98-4a14-977a-56502bc7d347\") "
Jul 09 22:52:48.684228 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.684205    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b14b21bb-7a98-4a14-977a-56502bc7d347-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b14b21bb-7a98-4a14-977a-56502bc7d347" (UID: "b14b21bb-7a98-4a14-977a-56502bc7d347"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:52:48.684300 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.684279    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b14b21bb-7a98-4a14-977a-56502bc7d347-openshift-service-ca\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:52:48.686131 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.686091    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b14b21bb-7a98-4a14-977a-56502bc7d347-kube-api-access-f9l5n" (OuterVolumeSpecName: "kube-api-access-f9l5n") pod "b14b21bb-7a98-4a14-977a-56502bc7d347" (UID: "b14b21bb-7a98-4a14-977a-56502bc7d347"). InnerVolumeSpecName "kube-api-access-f9l5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:52:48.686244 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.686152    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b14b21bb-7a98-4a14-977a-56502bc7d347-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b14b21bb-7a98-4a14-977a-56502bc7d347" (UID: "b14b21bb-7a98-4a14-977a-56502bc7d347"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:52:48.784996 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.784951    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9l5n\" (UniqueName: \"kubernetes.io/projected/b14b21bb-7a98-4a14-977a-56502bc7d347-kube-api-access-f9l5n\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:52:48.784996 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.784986    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b14b21bb-7a98-4a14-977a-56502bc7d347-maas-api-tls\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:52:48.802081 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.801961    2554 generic.go:356] "Generic (PLEG): container finished" podID="b14b21bb-7a98-4a14-977a-56502bc7d347" containerID="2f4f959fd4aa7adc053da33f71a58d8ebddb494957405da7c14767e5ba72f32f" exitCode=0
Jul 09 22:52:48.802081 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.802011    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"
Jul 09 22:52:48.802081 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.802026    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7" event={"ID":"b14b21bb-7a98-4a14-977a-56502bc7d347","Type":"ContainerDied","Data":"2f4f959fd4aa7adc053da33f71a58d8ebddb494957405da7c14767e5ba72f32f"}
Jul 09 22:52:48.802330 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.802097    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7" event={"ID":"b14b21bb-7a98-4a14-977a-56502bc7d347","Type":"ContainerDied","Data":"99e913a7af21fa72da0e81a8ee6c0f5df861bb608f34de31cfb001dcfd37d4d4"}
Jul 09 22:52:48.802330 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.802124    2554 scope.go:117] "RemoveContainer" containerID="2f4f959fd4aa7adc053da33f71a58d8ebddb494957405da7c14767e5ba72f32f"
Jul 09 22:52:48.811377 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.811357    2554 scope.go:117] "RemoveContainer" containerID="2f4f959fd4aa7adc053da33f71a58d8ebddb494957405da7c14767e5ba72f32f"
Jul 09 22:52:48.811639 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:52:48.811622    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f4f959fd4aa7adc053da33f71a58d8ebddb494957405da7c14767e5ba72f32f\": container with ID starting with 2f4f959fd4aa7adc053da33f71a58d8ebddb494957405da7c14767e5ba72f32f not found: ID does not exist" containerID="2f4f959fd4aa7adc053da33f71a58d8ebddb494957405da7c14767e5ba72f32f"
Jul 09 22:52:48.811690 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.811646    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f4f959fd4aa7adc053da33f71a58d8ebddb494957405da7c14767e5ba72f32f"} err="failed to get container status \"2f4f959fd4aa7adc053da33f71a58d8ebddb494957405da7c14767e5ba72f32f\": rpc error: code = NotFound desc = could not find container \"2f4f959fd4aa7adc053da33f71a58d8ebddb494957405da7c14767e5ba72f32f\": container with ID starting with 2f4f959fd4aa7adc053da33f71a58d8ebddb494957405da7c14767e5ba72f32f not found: ID does not exist"
Jul 09 22:52:48.825836 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.825806    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"]
Jul 09 22:52:48.831112 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:48.831087    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a70a31-754f6846bf-2l4d7"]
Jul 09 22:52:49.881714 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:49.881678    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b14b21bb-7a98-4a14-977a-56502bc7d347" path="/var/lib/kubelet/pods/b14b21bb-7a98-4a14-977a-56502bc7d347/volumes"
Jul 09 22:52:54.269577 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:54.269537    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:52:54.338346 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:54.338302    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:52:54.549474 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:54.549390    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:52:54.763408 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:54.763376    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:52:54.960490 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:54.960456    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:52:55.335846 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:55.335761    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:52:55.436228 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:55.436199    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:52:55.563882 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:55.563845    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:52:55.772423 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:55.772393    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"]
Jul 09 22:52:55.772595 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:55.772575    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb" podUID="4aea45d5-332e-4331-9c5b-c186510e28c7" containerName="maas-api" containerID="cri-o://d90db9dea3d6e8fb50d0dd7f7edf02827b67459e638a3fbdd8d8b14551d59d6e" gracePeriod=30
Jul 09 22:52:55.811272 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:55.811242    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:52:56.015574 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.015550    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"
Jul 09 22:52:56.148305 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.148272    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4aea45d5-332e-4331-9c5b-c186510e28c7-maas-api-tls\") pod \"4aea45d5-332e-4331-9c5b-c186510e28c7\" (UID: \"4aea45d5-332e-4331-9c5b-c186510e28c7\") "
Jul 09 22:52:56.148518 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.148344    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4aea45d5-332e-4331-9c5b-c186510e28c7-openshift-service-ca\") pod \"4aea45d5-332e-4331-9c5b-c186510e28c7\" (UID: \"4aea45d5-332e-4331-9c5b-c186510e28c7\") "
Jul 09 22:52:56.148518 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.148451    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fj2rd\" (UniqueName: \"kubernetes.io/projected/4aea45d5-332e-4331-9c5b-c186510e28c7-kube-api-access-fj2rd\") pod \"4aea45d5-332e-4331-9c5b-c186510e28c7\" (UID: \"4aea45d5-332e-4331-9c5b-c186510e28c7\") "
Jul 09 22:52:56.148736 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.148716    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aea45d5-332e-4331-9c5b-c186510e28c7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4aea45d5-332e-4331-9c5b-c186510e28c7" (UID: "4aea45d5-332e-4331-9c5b-c186510e28c7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:52:56.150464 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.150445    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aea45d5-332e-4331-9c5b-c186510e28c7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4aea45d5-332e-4331-9c5b-c186510e28c7" (UID: "4aea45d5-332e-4331-9c5b-c186510e28c7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:52:56.150594 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.150575    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aea45d5-332e-4331-9c5b-c186510e28c7-kube-api-access-fj2rd" (OuterVolumeSpecName: "kube-api-access-fj2rd") pod "4aea45d5-332e-4331-9c5b-c186510e28c7" (UID: "4aea45d5-332e-4331-9c5b-c186510e28c7"). InnerVolumeSpecName "kube-api-access-fj2rd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:52:56.249229 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.249190    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fj2rd\" (UniqueName: \"kubernetes.io/projected/4aea45d5-332e-4331-9c5b-c186510e28c7-kube-api-access-fj2rd\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:52:56.249229 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.249223    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4aea45d5-332e-4331-9c5b-c186510e28c7-maas-api-tls\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:52:56.249229 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.249232    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4aea45d5-332e-4331-9c5b-c186510e28c7-openshift-service-ca\") on node \"ip-10-0-133-135.ec2.internal\" DevicePath \"\""
Jul 09 22:52:56.840912 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.840876    2554 generic.go:356] "Generic (PLEG): container finished" podID="4aea45d5-332e-4331-9c5b-c186510e28c7" containerID="d90db9dea3d6e8fb50d0dd7f7edf02827b67459e638a3fbdd8d8b14551d59d6e" exitCode=0
Jul 09 22:52:56.841362 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.840926    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"
Jul 09 22:52:56.841362 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.840963    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb" event={"ID":"4aea45d5-332e-4331-9c5b-c186510e28c7","Type":"ContainerDied","Data":"d90db9dea3d6e8fb50d0dd7f7edf02827b67459e638a3fbdd8d8b14551d59d6e"}
Jul 09 22:52:56.841362 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.841018    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb" event={"ID":"4aea45d5-332e-4331-9c5b-c186510e28c7","Type":"ContainerDied","Data":"106ea94045ea46e570d3f9034bb6d74eb0e9531d123870ffb75375b8ef9b3b71"}
Jul 09 22:52:56.841362 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.841061    2554 scope.go:117] "RemoveContainer" containerID="d90db9dea3d6e8fb50d0dd7f7edf02827b67459e638a3fbdd8d8b14551d59d6e"
Jul 09 22:52:56.849848 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.849826    2554 scope.go:117] "RemoveContainer" containerID="d90db9dea3d6e8fb50d0dd7f7edf02827b67459e638a3fbdd8d8b14551d59d6e"
Jul 09 22:52:56.852807 ip-10-0-133-135 kubenswrapper[2554]: E0709 22:52:56.850307    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d90db9dea3d6e8fb50d0dd7f7edf02827b67459e638a3fbdd8d8b14551d59d6e\": container with ID starting with d90db9dea3d6e8fb50d0dd7f7edf02827b67459e638a3fbdd8d8b14551d59d6e not found: ID does not exist" containerID="d90db9dea3d6e8fb50d0dd7f7edf02827b67459e638a3fbdd8d8b14551d59d6e"
Jul 09 22:52:56.852807 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.850341    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d90db9dea3d6e8fb50d0dd7f7edf02827b67459e638a3fbdd8d8b14551d59d6e"} err="failed to get container status \"d90db9dea3d6e8fb50d0dd7f7edf02827b67459e638a3fbdd8d8b14551d59d6e\": rpc error: code = NotFound desc = could not find container \"d90db9dea3d6e8fb50d0dd7f7edf02827b67459e638a3fbdd8d8b14551d59d6e\": container with ID starting with d90db9dea3d6e8fb50d0dd7f7edf02827b67459e638a3fbdd8d8b14551d59d6e not found: ID does not exist"
Jul 09 22:52:56.867419 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.867393    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"]
Jul 09 22:52:56.877753 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:56.877720    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d3fb60-6f56dbcf56-66bxb"]
Jul 09 22:52:57.881741 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:52:57.881710    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aea45d5-332e-4331-9c5b-c186510e28c7" path="/var/lib/kubelet/pods/4aea45d5-332e-4331-9c5b-c186510e28c7/volumes"
Jul 09 22:53:01.348321 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:01.348284    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:53:01.448259 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:01.448225    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:53:01.653167 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:01.653078    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:53:01.873450 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:01.873417    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:53:07.398875 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:07.398839    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-748d684877-flrs2_a1e3bdce-eda3-4178-88f6-8cef2fdc9be6/manager/0.log"
Jul 09 22:53:07.874249 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:07.874223    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b79867d65-jt9rr_4b203897-4c48-4966-b419-602f358b46c5/copy-manifests/0.log"
Jul 09 22:53:07.893715 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:07.893685    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b79867d65-jt9rr_4b203897-4c48-4966-b419-602f358b46c5/manager/0.log"
Jul 09 22:53:08.363451 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:08.363420    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5ff7bc6b84-6q99t_ab520d02-c135-4a02-9be5-7516742bfc4f/maas-api/0.log"
Jul 09 22:53:09.255479 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:09.255452    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx_a829c6ac-0431-4292-ae61-3f04bf864627/util/0.log"
Jul 09 22:53:09.262597 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:09.262577    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx_a829c6ac-0431-4292-ae61-3f04bf864627/pull/0.log"
Jul 09 22:53:09.269615 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:09.269593    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx_a829c6ac-0431-4292-ae61-3f04bf864627/extract/0.log"
Jul 09 22:53:09.384090 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:09.384061    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r_84dd133a-068b-4cf8-bc9b-123b31f9a6d3/util/0.log"
Jul 09 22:53:09.391236 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:09.391215    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r_84dd133a-068b-4cf8-bc9b-123b31f9a6d3/pull/0.log"
Jul 09 22:53:09.398749 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:09.398727    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r_84dd133a-068b-4cf8-bc9b-123b31f9a6d3/extract/0.log"
Jul 09 22:53:09.513252 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:09.513166    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n_727ad24e-f4b3-44a2-865f-04e46b8a212d/util/0.log"
Jul 09 22:53:09.524498 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:09.524478    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n_727ad24e-f4b3-44a2-865f-04e46b8a212d/pull/0.log"
Jul 09 22:53:09.536496 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:09.536473    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n_727ad24e-f4b3-44a2-865f-04e46b8a212d/extract/0.log"
Jul 09 22:53:09.656572 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:09.656545    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj_1055509c-1ff4-4754-aa5a-7b9452267fdd/util/0.log"
Jul 09 22:53:09.671069 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:09.671026    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj_1055509c-1ff4-4754-aa5a-7b9452267fdd/pull/0.log"
Jul 09 22:53:09.681731 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:09.681704    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj_1055509c-1ff4-4754-aa5a-7b9452267fdd/extract/0.log"
Jul 09 22:53:11.062063 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:11.062018    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ls9vh_65d27310-b6ff-4e20-9465-6ec24fb40d3c/istio-proxy/0.log"
Jul 09 22:53:11.183606 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:11.183575    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hx5z4_74f625ff-aaf7-4f68-92ba-491fc6e10bdb/discovery/0.log"
Jul 09 22:53:12.245545 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:12.245513    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-klb4g_caf12037-07e5-49e2-a101-49df8909f3bb/main/0.log"
Jul 09 22:53:12.594351 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:12.594320    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqv5ht_66f1e5f0-1928-42b5-9bb8-3c780f20775e/main/0.log"
Jul 09 22:53:12.707048 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:12.707011    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-96zdw_ff8230fe-3cc8-46bb-9d6f-6ad6a53e6d6e/main/0.log"
Jul 09 22:53:16.568094 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:16.568057    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:53:16.700059 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:16.699987    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log" limit=1024
Jul 09 22:53:19.459858 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:19.459822    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bjslv_fdeb3831-73cd-4aa5-8c33-6ef51d2b58b8/global-pull-secret-syncer/0.log"
Jul 09 22:53:19.659510 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:19.659480    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gl8zs_070b7889-a211-4188-860f-ba36d9e5e7a4/konnectivity-agent/0.log"
Jul 09 22:53:19.762689 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:19.762609    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-135.ec2.internal_7850db39ed65d429ad5a6c9d967e5873/haproxy/0.log"
Jul 09 22:53:24.579021 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:24.578983    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx_a829c6ac-0431-4292-ae61-3f04bf864627/extract/0.log"
Jul 09 22:53:24.605472 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:24.605442    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx_a829c6ac-0431-4292-ae61-3f04bf864627/util/0.log"
Jul 09 22:53:24.630449 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:24.630424    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kg6vx_a829c6ac-0431-4292-ae61-3f04bf864627/pull/0.log"
Jul 09 22:53:24.660505 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:24.660475    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r_84dd133a-068b-4cf8-bc9b-123b31f9a6d3/extract/0.log"
Jul 09 22:53:24.684976 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:24.684949    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r_84dd133a-068b-4cf8-bc9b-123b31f9a6d3/util/0.log"
Jul 09 22:53:24.712021 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:24.711992    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fp8r_84dd133a-068b-4cf8-bc9b-123b31f9a6d3/pull/0.log"
Jul 09 22:53:24.742079 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:24.742029    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n_727ad24e-f4b3-44a2-865f-04e46b8a212d/extract/0.log"
Jul 09 22:53:24.768428 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:24.768400    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n_727ad24e-f4b3-44a2-865f-04e46b8a212d/util/0.log"
Jul 09 22:53:24.797989 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:24.797964    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w547n_727ad24e-f4b3-44a2-865f-04e46b8a212d/pull/0.log"
Jul 09 22:53:24.831624 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:24.831534    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj_1055509c-1ff4-4754-aa5a-7b9452267fdd/extract/0.log"
Jul 09 22:53:24.856911 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:24.856885    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj_1055509c-1ff4-4754-aa5a-7b9452267fdd/util/0.log"
Jul 09 22:53:24.883411 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:24.883385    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16rjbj_1055509c-1ff4-4754-aa5a-7b9452267fdd/pull/0.log"
Jul 09 22:53:27.995620 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:27.995555    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-c4ff5757-rm994_0d4b3db8-8daf-4bd6-a938-a68a47da69b4/metrics-server/0.log"
Jul 09 22:53:28.163961 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:28.163930    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pqxrk_fbab2393-0bcd-4cb1-a727-f07df4240ff1/node-exporter/0.log"
Jul 09 22:53:28.189752 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:28.189724    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pqxrk_fbab2393-0bcd-4cb1-a727-f07df4240ff1/kube-rbac-proxy/0.log"
Jul 09 22:53:28.218828 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:28.218802    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pqxrk_fbab2393-0bcd-4cb1-a727-f07df4240ff1/init-textfile/0.log"
Jul 09 22:53:30.242321 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.242285    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"]
Jul 09 22:53:30.242709 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.242602    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab36368-ff91-475c-be5a-84e0043d2467" containerName="istio-proxy"
Jul 09 22:53:30.242709 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.242614    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab36368-ff91-475c-be5a-84e0043d2467" containerName="istio-proxy"
Jul 09 22:53:30.242709 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.242622    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b14b21bb-7a98-4a14-977a-56502bc7d347" containerName="maas-api"
Jul 09 22:53:30.242709 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.242628    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b14b21bb-7a98-4a14-977a-56502bc7d347" containerName="maas-api"
Jul 09 22:53:30.242709 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.242642    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aea45d5-332e-4331-9c5b-c186510e28c7" containerName="maas-api"
Jul 09 22:53:30.242709 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.242647    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aea45d5-332e-4331-9c5b-c186510e28c7" containerName="maas-api"
Jul 09 22:53:30.242709 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.242702    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b14b21bb-7a98-4a14-977a-56502bc7d347" containerName="maas-api"
Jul 09 22:53:30.242930 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.242713    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aea45d5-332e-4331-9c5b-c186510e28c7" containerName="maas-api"
Jul 09 22:53:30.245892 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.245872    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:30.248515 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.248488    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t249s\"/\"kube-root-ca.crt\""
Jul 09 22:53:30.248515 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.248497    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t249s\"/\"default-dockercfg-5q4rk\""
Jul 09 22:53:30.249402 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.249386    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t249s\"/\"openshift-service-ca.crt\""
Jul 09 22:53:30.254183 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.254161    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"]
Jul 09 22:53:30.340568 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.340532    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd776714-4d06-44f6-af63-949cea3be867-lib-modules\") pod \"perf-node-gather-daemonset-zqpkv\" (UID: \"bd776714-4d06-44f6-af63-949cea3be867\") " pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:30.340568 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.340569    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bd776714-4d06-44f6-af63-949cea3be867-podres\") pod \"perf-node-gather-daemonset-zqpkv\" (UID: \"bd776714-4d06-44f6-af63-949cea3be867\") " pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:30.340792 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.340587    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsnn9\" (UniqueName: \"kubernetes.io/projected/bd776714-4d06-44f6-af63-949cea3be867-kube-api-access-gsnn9\") pod \"perf-node-gather-daemonset-zqpkv\" (UID: \"bd776714-4d06-44f6-af63-949cea3be867\") " pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:30.340792 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.340609    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd776714-4d06-44f6-af63-949cea3be867-sys\") pod \"perf-node-gather-daemonset-zqpkv\" (UID: \"bd776714-4d06-44f6-af63-949cea3be867\") " pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:30.340792 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.340653    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bd776714-4d06-44f6-af63-949cea3be867-proc\") pod \"perf-node-gather-daemonset-zqpkv\" (UID: \"bd776714-4d06-44f6-af63-949cea3be867\") " pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:30.441440 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.441403    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd776714-4d06-44f6-af63-949cea3be867-sys\") pod \"perf-node-gather-daemonset-zqpkv\" (UID: \"bd776714-4d06-44f6-af63-949cea3be867\") " pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:30.441440 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.441446    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bd776714-4d06-44f6-af63-949cea3be867-proc\") pod \"perf-node-gather-daemonset-zqpkv\" (UID: \"bd776714-4d06-44f6-af63-949cea3be867\") " pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:30.441695 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.441534    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd776714-4d06-44f6-af63-949cea3be867-lib-modules\") pod \"perf-node-gather-daemonset-zqpkv\" (UID: \"bd776714-4d06-44f6-af63-949cea3be867\") " pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:30.441695 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.441535    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd776714-4d06-44f6-af63-949cea3be867-sys\") pod \"perf-node-gather-daemonset-zqpkv\" (UID: \"bd776714-4d06-44f6-af63-949cea3be867\") " pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:30.441695 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.441577    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bd776714-4d06-44f6-af63-949cea3be867-podres\") pod \"perf-node-gather-daemonset-zqpkv\" (UID: \"bd776714-4d06-44f6-af63-949cea3be867\") " pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:30.441695 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.441597    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsnn9\" (UniqueName: \"kubernetes.io/projected/bd776714-4d06-44f6-af63-949cea3be867-kube-api-access-gsnn9\") pod \"perf-node-gather-daemonset-zqpkv\" (UID: \"bd776714-4d06-44f6-af63-949cea3be867\") " pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:30.441695 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.441596    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bd776714-4d06-44f6-af63-949cea3be867-proc\") pod \"perf-node-gather-daemonset-zqpkv\" (UID: \"bd776714-4d06-44f6-af63-949cea3be867\") " pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:30.441695 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.441653    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd776714-4d06-44f6-af63-949cea3be867-lib-modules\") pod \"perf-node-gather-daemonset-zqpkv\" (UID: \"bd776714-4d06-44f6-af63-949cea3be867\") " pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:30.441914 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.441700    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bd776714-4d06-44f6-af63-949cea3be867-podres\") pod \"perf-node-gather-daemonset-zqpkv\" (UID: \"bd776714-4d06-44f6-af63-949cea3be867\") " pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:30.451257 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.451229    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsnn9\" (UniqueName: \"kubernetes.io/projected/bd776714-4d06-44f6-af63-949cea3be867-kube-api-access-gsnn9\") pod \"perf-node-gather-daemonset-zqpkv\" (UID: \"bd776714-4d06-44f6-af63-949cea3be867\") " pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:30.555876 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.555776    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:30.710385 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:30.710355    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"]
Jul 09 22:53:30.712678 ip-10-0-133-135 kubenswrapper[2554]: W0709 22:53:30.712649    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbd776714_4d06_44f6_af63_949cea3be867.slice/crio-89424de3c25b6f4d863ed8c87bf4d810106d857c476b8e2e88876f2f42c81545 WatchSource:0}: Error finding container 89424de3c25b6f4d863ed8c87bf4d810106d857c476b8e2e88876f2f42c81545: Status 404 returned error can't find the container with id 89424de3c25b6f4d863ed8c87bf4d810106d857c476b8e2e88876f2f42c81545
Jul 09 22:53:31.001199 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:31.001163    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv" event={"ID":"bd776714-4d06-44f6-af63-949cea3be867","Type":"ContainerStarted","Data":"5acf8a8a358eecb8e0e11f38f8f74ca073e2de7a852d19b500d323074171c8a2"}
Jul 09 22:53:31.001397 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:31.001233    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv" event={"ID":"bd776714-4d06-44f6-af63-949cea3be867","Type":"ContainerStarted","Data":"89424de3c25b6f4d863ed8c87bf4d810106d857c476b8e2e88876f2f42c81545"}
Jul 09 22:53:31.001397 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:31.001260    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:31.028130 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:31.028068    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv" podStartSLOduration=1.028052998 podStartE2EDuration="1.028052998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:53:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:53:31.026834904 +0000 UTC m=+2673.700833720" watchObservedRunningTime="2026-07-09 22:53:31.028052998 +0000 UTC m=+2673.702051791"
Jul 09 22:53:31.398012 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:31.397985    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-22clr_8533bddc-6dd5-49ee-ab8e-990178daec0f/download-server/0.log"
Jul 09 22:53:33.157825 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:33.157787    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5s9gq_7290a5ae-4fe0-445e-a11f-8133ff8187b3/dns/0.log"
Jul 09 22:53:33.189774 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:33.189749    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5s9gq_7290a5ae-4fe0-445e-a11f-8133ff8187b3/kube-rbac-proxy/0.log"
Jul 09 22:53:33.413269 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:33.413184    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lrllf_98bd9c1a-f8b0-4dfc-96da-9bf0dd354b61/dns-node-resolver/0.log"
Jul 09 22:53:34.131336 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:34.131305    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lmtn5_8ce766ac-353c-44b3-8c68-5c6e6b2bccc3/node-ca/0.log"
Jul 09 22:53:35.166196 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:35.166165    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ls9vh_65d27310-b6ff-4e20-9465-6ec24fb40d3c/istio-proxy/0.log"
Jul 09 22:53:35.356341 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:35.356310    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hx5z4_74f625ff-aaf7-4f68-92ba-491fc6e10bdb/discovery/0.log"
Jul 09 22:53:36.490371 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:36.490344    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bcbkx_848e09e1-8367-4db5-8f25-6378d3eb7bc8/serve-healthcheck-canary/0.log"
Jul 09 22:53:37.015393 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:37.015365    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t249s/perf-node-gather-daemonset-zqpkv"
Jul 09 22:53:37.173138 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:37.173112    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k5db4_c3e37b9f-0808-4c6c-8819-4f24ae43ce45/kube-rbac-proxy/0.log"
Jul 09 22:53:37.208514 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:37.208482    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k5db4_c3e37b9f-0808-4c6c-8819-4f24ae43ce45/exporter/0.log"
Jul 09 22:53:37.242525 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:37.242497    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k5db4_c3e37b9f-0808-4c6c-8819-4f24ae43ce45/extractor/0.log"
Jul 09 22:53:40.116080 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:40.116021    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-748d684877-flrs2_a1e3bdce-eda3-4178-88f6-8cef2fdc9be6/manager/0.log"
Jul 09 22:53:40.395683 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:40.395651    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b79867d65-jt9rr_4b203897-4c48-4966-b419-602f358b46c5/manager/0.log"
Jul 09 22:53:40.416770 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:40.416741    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b79867d65-jt9rr_4b203897-4c48-4966-b419-602f358b46c5/copy-manifests/0.log"
Jul 09 22:53:41.010429 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:41.010397    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ls9vh_65d27310-b6ff-4e20-9465-6ec24fb40d3c/istio-proxy/0.log"
Jul 09 22:53:41.199301 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:41.199267    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hx5z4_74f625ff-aaf7-4f68-92ba-491fc6e10bdb/discovery/0.log"
Jul 09 22:53:41.777430 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:41.777342    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55bc84657b-n885t_ab7198eb-154e-4261-91b3-bc549ac5312f/manager/0.log"
Jul 09 22:53:42.736902 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:42.736873    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ls9vh_65d27310-b6ff-4e20-9465-6ec24fb40d3c/istio-proxy/0.log"
Jul 09 22:53:42.923594 ip-10-0-133-135 kubenswrapper[2554]: I0709 22:53:42.923559    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hx5z4_74f625ff-aaf7-4f68-92ba-491fc6e10bdb/discovery/0.log"