Jul 07 15:40:41.726158 ip-10-0-138-64 systemd[1]: Starting Kubernetes Kubelet... Jul 07 15:40:42.145489 ip-10-0-138-64 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 15:40:42.145489 ip-10-0-138-64 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 15:40:42.145489 ip-10-0-138-64 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 15:40:42.145489 ip-10-0-138-64 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 15:40:42.145489 ip-10-0-138-64 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 15:40:42.147567 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.147481 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 15:40:42.155751 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155727 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:40:42.155751 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155747 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:40:42.155751 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155751 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:40:42.155751 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155754 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155757 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155760 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155764 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155767 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155772 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155775 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155778 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155780 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155783 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155785 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155788 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155791 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155794 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155798 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155802 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155805 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155808 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155811 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:40:42.155902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155814 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155816 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155819 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155822 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155825 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155827 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155838 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155841 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155844 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155846 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155863 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155866 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155868 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155871 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155874 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155877 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155880 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155882 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155885 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155887 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:40:42.156347 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155890 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155892 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155895 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155898 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155900 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155903 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155905 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155909 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155913 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155916 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155919 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155923 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155926 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155928 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155931 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155934 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155937 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155939 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155942 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:40:42.156832 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155945 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155947 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155950 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155952 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155955 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155957 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155959 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155962 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155965 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155968 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155971 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155974 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155976 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155980 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155984 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155987 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155990 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155992 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155995 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:40:42.157309 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155997 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.155999 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156002 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156004 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156007 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156009 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156011 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156014 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156016 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156018 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156021 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156023 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156025 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156028 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156030 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156033 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156035 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156038 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156040 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156774 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:40:42.157766 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156781 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156786 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156789 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156792 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156794 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156798 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156802 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156806 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156808 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156811 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156814 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156817 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156820 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156823 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156827 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156829 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156832 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156836 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156839 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:40:42.158280 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156841 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156844 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156847 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156866 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156869 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156871 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156874 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156876 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156879 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156882 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156884 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156886 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156889 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156891 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156895 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156898 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156901 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156903 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156905 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156908 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:40:42.158752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156911 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156913 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156916 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156919 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156922 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156925 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156928 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156930 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156932 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156935 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156937 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156940 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156942 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156944 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156947 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156949 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156951 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156954 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156956 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156959 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:40:42.159264 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156961 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156964 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156966 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156968 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156971 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156973 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156976 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156979 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156981 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156984 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156986 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156989 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156991 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156995 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.156998 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157000 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157003 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157006 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157008 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157010 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:40:42.159752 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157013 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157015 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157018 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157020 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157023 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157025 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157027 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157030 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157032 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157035 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157037 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157040 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157042 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157044 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157047 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157049 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157051 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157054 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157057 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:40:42.160286 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157466 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157471 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157473 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157476 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157479 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157482 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157484 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157486 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157489 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157491 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157495 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157498 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157500 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157502 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157505 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157507 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157510 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157512 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157514 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:40:42.160753 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157517 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157519 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157521 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157524 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157527 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157530 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157532 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157535 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157539 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157542 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157547 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157550 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157553 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157556 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157559 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157561 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157564 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157567 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157570 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157572 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:40:42.161227 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157575 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157577 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157580 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157582 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157586 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157588 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157591 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157593 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157596 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157598 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157601 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157603 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157606 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157608 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157610 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157613 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157615 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157618 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157620 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157623 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:40:42.161754 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157627 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157629 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157632 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157634 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157637 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157639 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157642 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157644 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157647 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157649 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157652 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157654 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157657 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157659 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157662 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157664 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157666 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157669 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157673 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157675 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:40:42.162253 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157677 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157680 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157682 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157685 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157687 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157690 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157692 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157694 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157698 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157701 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157704 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157707 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157711 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157713 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157716 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157721 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157724 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157727 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157730 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:40:42.162765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.157733 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157810 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157818 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157825 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157829 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157833 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157836 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157840 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157845 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157862 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157866 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157870 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157873 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157876 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157879 2572 flags.go:64] FLAG: --cgroup-root="" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157883 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157886 2572 flags.go:64] FLAG: --client-ca-file="" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157888 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157891 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157896 2572 flags.go:64] FLAG: --cluster-domain="" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157899 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157902 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157905 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157908 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 15:40:42.163238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157912 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157923 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157928 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157932 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157935 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157938 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157940 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157943 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157946 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157951 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157954 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157957 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157959 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157962 2572 flags.go:64] FLAG: --enable-server="true" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157965 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157969 2572 flags.go:64] FLAG: --event-burst="100" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157972 2572 flags.go:64] FLAG: --event-qps="50" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157976 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157979 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157982 2572 flags.go:64] FLAG: --eviction-hard="" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157987 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157990 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157993 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157995 2572 flags.go:64] FLAG: --eviction-soft="" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.157998 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 15:40:42.163804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158001 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158004 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158006 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158009 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158014 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158017 2572 flags.go:64] FLAG: --feature-gates="" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158020 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158023 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158027 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158030 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158033 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158036 2572 flags.go:64] FLAG: --help="false" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158039 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158042 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158045 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158048 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158051 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158054 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158057 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158060 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158063 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158065 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158068 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158071 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 15:40:42.164435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158074 2572 flags.go:64] FLAG: --kube-reserved="" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158077 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158079 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158082 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158086 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158088 2572 flags.go:64] FLAG: --lock-file="" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158091 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158094 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158096 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158101 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158104 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158107 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158112 2572 flags.go:64] FLAG: --logging-format="text" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158114 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158118 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158120 2572 flags.go:64] FLAG: --manifest-url="" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158126 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158131 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158134 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158138 2572 flags.go:64] FLAG: --max-pods="110" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158141 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158144 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158146 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158150 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158153 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 15:40:42.165068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158156 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158159 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158166 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158169 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158172 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158175 2572 flags.go:64] FLAG: --pod-cidr="" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158177 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158183 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158185 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158188 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158191 2572 flags.go:64] FLAG: --port="10250" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158194 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158198 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c32c67b213a604ba" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158201 2572 flags.go:64] FLAG: --qos-reserved="" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158203 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158206 2572 flags.go:64] FLAG: --register-node="true" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158209 2572 flags.go:64] FLAG: --register-with-taints="" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158212 2572 flags.go:64] FLAG: --registry-burst="10" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158215 2572 flags.go:64] FLAG: --registry-qps="5" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158219 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158222 2572 flags.go:64] FLAG: --reserved-memory="" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158226 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158229 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158231 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158235 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 15:40:42.165686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158238 2572 flags.go:64] FLAG: --runonce="false" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158241 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158243 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158246 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158249 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158252 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158255 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158258 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158266 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158269 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158271 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158275 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158277 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158280 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158283 2572 flags.go:64] FLAG: --system-cgroups="" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158286 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158292 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158294 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158297 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158302 2572 flags.go:64] FLAG: --tls-min-version="" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158305 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158307 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158310 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158313 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158316 2572 flags.go:64] FLAG: --v="2" Jul 07 15:40:42.166364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158320 2572 flags.go:64] FLAG: --version="false" Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158325 2572 flags.go:64] FLAG: --vmodule="" Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158329 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.158332 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158449 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158452 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158456 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158459 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158462 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158465 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158467 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158470 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158472 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158475 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158477 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158480 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158483 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158485 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158487 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158490 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:40:42.166993 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158492 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158495 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158497 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158500 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158503 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158505 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158508 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158510 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158513 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158515 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158518 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158520 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158522 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158527 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158529 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158532 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158534 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158536 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158541 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:40:42.167489 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158543 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158546 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158548 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158551 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158553 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158555 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158558 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158560 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158563 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158565 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158568 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158570 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158572 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158575 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158578 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158580 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158584 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158588 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158590 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158593 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:40:42.167969 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158596 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158599 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158602 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158605 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158608 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158610 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158614 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158616 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158619 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158621 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158625 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158630 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158632 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158635 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158637 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158640 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158643 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158646 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158649 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:40:42.168442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158652 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158654 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158656 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158659 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158661 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158664 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158666 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158669 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158671 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158673 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158676 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158678 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158681 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158683 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158686 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158688 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158691 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158693 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158695 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158699 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158702 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:40:42.168936 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158704 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:40:42.169442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158707 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:40:42.169442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158709 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:40:42.169442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.158713 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:40:42.169442 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.159584 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 15:40:42.169442 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.166582 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 15:40:42.169442 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.166601 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 15:40:42.169442 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.166622 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 15:40:42.169442 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.166628 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 15:40:42.169442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166687 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:40:42.169442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166693 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:40:42.169442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166696 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:40:42.169442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166701 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:40:42.169442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166705 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:40:42.169442 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166708 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166711 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166714 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166717 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166720 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166722 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166740 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166743 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166746 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166749 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166752 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166755 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166758 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166762 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166765 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166767 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166769 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166772 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166774 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166777 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:40:42.169787 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166781 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166785 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166788 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166791 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166795 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166798 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166800 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166803 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166806 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166809 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166811 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166814 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166817 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166819 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166822 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166824 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166827 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166829 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166832 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166834 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:40:42.170387 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166837 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166840 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166842 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166845 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166847 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166866 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166870 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166872 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166875 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166878 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166880 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166883 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166885 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166888 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166890 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166893 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166896 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166899 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166902 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:40:42.170905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166905 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166907 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166910 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166912 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166916 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166920 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166922 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166925 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166928 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166930 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166933 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166936 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166938 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166941 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166943 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166946 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166948 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166951 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166953 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:40:42.171367 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166955 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:40:42.171827 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166958 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:40:42.171827 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166961 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:40:42.171827 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166963 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:40:42.171827 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166966 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:40:42.171827 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166968 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:40:42.171827 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166971 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:40:42.171827 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166973 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:40:42.171827 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166976 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:40:42.171827 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166978 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:40:42.171827 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166982 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:40:42.171827 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166984 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:40:42.171827 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166987 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:40:42.171827 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166990 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:40:42.171827 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166992 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:40:42.171827 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.166994 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:40:42.172259 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.167000 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 15:40:42.172259 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167119 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:40:42.172259 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167124 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:40:42.172259 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167127 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:40:42.172259 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167130 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:40:42.172259 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167133 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:40:42.172259 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167136 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:40:42.172259 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167139 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:40:42.172259 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167142 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:40:42.172259 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167145 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:40:42.172259 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167147 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:40:42.172259 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167150 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:40:42.172259 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167153 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:40:42.172259 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167155 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:40:42.172259 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167157 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167160 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167162 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167165 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167167 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167170 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167172 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167175 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167178 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167180 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167183 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167185 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167187 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167191 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167193 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167196 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167198 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167200 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167203 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167205 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:40:42.172627 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167208 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167211 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167213 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167216 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167218 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167220 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167223 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167225 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167228 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167230 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167232 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167235 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167237 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167240 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167242 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167245 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167247 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167250 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167253 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167255 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:40:42.173119 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167257 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167260 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167262 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167265 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167267 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167270 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167273 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167275 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167277 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167280 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167283 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167285 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167287 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167289 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167292 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167294 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167297 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167299 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167301 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167304 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:40:42.173605 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167306 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167308 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167311 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167314 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167317 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167320 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167323 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167325 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167329 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167332 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167335 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167338 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167340 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167343 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167345 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167348 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167351 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167353 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167355 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:40:42.174133 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167358 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:40:42.174603 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167360 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:40:42.174603 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167363 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:40:42.174603 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167366 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:40:42.174603 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167369 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:40:42.174603 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167372 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:40:42.174603 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:42.167374 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:40:42.174603 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.167379 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 15:40:42.174603 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.167506 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 15:40:42.174603 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.169609 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 15:40:42.174603 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.171028 2572 server.go:1019] "Starting client certificate rotation" Jul 07 15:40:42.174603 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.171131 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 15:40:42.174603 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.171173 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 15:40:42.174923 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.174616 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 15:40:42.176208 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.176194 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 15:40:42.185646 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.185622 2572 log.go:25] "Validated CRI v1 runtime API" Jul 07 15:40:42.189649 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.189632 2572 log.go:25] "Validated CRI v1 image API" Jul 07 15:40:42.190505 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.190488 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 15:40:42.192976 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.192953 2572 fs.go:135] Filesystem UUIDs: map[1463f690-bd95-44c4-b336-41ce56bd913d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 82fa3fd0-065f-454c-9364-62bfe16a1dba:/dev/nvme0n1p4] Jul 07 15:40:42.193037 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.192975 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 15:40:42.199009 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.198869 2572 manager.go:216] Machine: {Timestamp:2026-07-07 15:40:42.197460906 +0000 UTC m=+0.347321405 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091887 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27e5e37fa800353ebae41075abcb1c SystemUUID:ec27e5e3-7fa8-0035-3eba-e41075abcb1c BootID:b78c02ea-351d-4bef-8467-d33ec2479898 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:47:d7:bb:eb:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:47:d7:bb:eb:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:ea:d3:23:73:77 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 15:40:42.199009 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.199004 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 15:40:42.199118 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.199094 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 15:40:42.202759 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.202725 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 15:40:42.202936 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.202763 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-64.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 15:40:42.203765 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.203748 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 15:40:42.204216 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.204204 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 15:40:42.204250 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.204221 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 15:40:42.204250 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.204230 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 15:40:42.204880 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.204870 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 15:40:42.206255 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.206244 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 15:40:42.209969 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.209955 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 07 15:40:42.210264 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.210254 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 15:40:42.210296 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.210286 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 07 15:40:42.210326 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.210297 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 15:40:42.210326 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.210312 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 15:40:42.210326 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.210322 2572 kubelet.go:398] "Adding apiserver pod source" Jul 07 15:40:42.210410 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.210332 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 15:40:42.210700 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.210688 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 15:40:42.210744 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.210706 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 15:40:42.212899 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.212882 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 15:40:42.214743 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.214728 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 15:40:42.214785 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.214775 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 15:40:42.216172 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.216158 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 15:40:42.216222 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.216177 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 15:40:42.216222 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.216183 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 15:40:42.216222 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.216188 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 15:40:42.216222 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.216198 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 15:40:42.216222 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.216204 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 15:40:42.216222 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.216212 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 15:40:42.216222 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.216217 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 15:40:42.216222 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.216224 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 15:40:42.216415 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.216230 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 15:40:42.216415 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.216239 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 15:40:42.216415 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.216244 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 15:40:42.216959 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.216950 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 15:40:42.216995 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.216960 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 15:40:42.220658 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.220642 2572 server.go:1268] "Started kubelet" Jul 07 15:40:42.220759 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.220726 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 15:40:42.220805 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.220743 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 15:40:42.220805 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.220781 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 15:40:42.221578 ip-10-0-138-64 systemd[1]: Started Kubernetes Kubelet. Jul 07 15:40:42.222283 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.222254 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 15:40:42.222341 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.222255 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 15:40:42.222395 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.222331 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-64.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 15:40:42.222593 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.222580 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 15:40:42.226609 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.226572 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-698kc" Jul 07 15:40:42.227317 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.227300 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 07 15:40:42.228540 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.228509 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 15:40:42.230714 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.230701 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 15:40:42.230770 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.230715 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 15:40:42.230822 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.230777 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-64.ec2.internal\" not found" Jul 07 15:40:42.231383 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.230130 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-64.ec2.internal.18c00c2d8d318fb5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-64.ec2.internal,UID:ip-10-0-138-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-64.ec2.internal,},FirstTimestamp:2026-07-07 15:40:42.220613557 +0000 UTC m=+0.370474054,LastTimestamp:2026-07-07 15:40:42.220613557 +0000 UTC m=+0.370474054,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-64.ec2.internal,}" Jul 07 15:40:42.231383 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.231307 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 15:40:42.231383 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.231362 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 15:40:42.231383 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.231375 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 15:40:42.231782 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.231490 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 07 15:40:42.231782 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.231498 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 07 15:40:42.231782 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.231755 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 15:40:42.231782 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.231769 2572 factory.go:55] Registering systemd factory Jul 07 15:40:42.231782 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.231778 2572 factory.go:223] Registration of the systemd container factory successfully Jul 07 15:40:42.232012 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.231980 2572 factory.go:153] Registering CRI-O factory Jul 07 15:40:42.232012 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.231989 2572 factory.go:223] Registration of the crio container factory successfully Jul 07 15:40:42.232012 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.232006 2572 factory.go:103] Registering Raw factory Jul 07 15:40:42.232140 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.232018 2572 manager.go:1196] Started watching for new ooms in manager Jul 07 15:40:42.232381 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.232369 2572 manager.go:349] Starting recovery of all containers Jul 07 15:40:42.233489 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.233466 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-698kc" Jul 07 15:40:42.240948 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.240778 2572 manager.go:354] Recovery completed Jul 07 15:40:42.242252 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.242221 2572 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 07 15:40:42.244701 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.244682 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:40:42.245735 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.245719 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:40:42.247437 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.247416 2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-64.ec2.internal\" not found" node="ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.247785 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.247772 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:40:42.247831 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.247803 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:40:42.247831 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.247816 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:40:42.248391 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.248378 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 15:40:42.248391 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.248390 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 15:40:42.248489 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.248406 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 07 15:40:42.248489 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.248382 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:40:42.249119 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.249106 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:40:42.249168 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.249131 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:40:42.249168 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.249141 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:40:42.249568 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.249556 2572 policy_none.go:49] "None policy: Start" Jul 07 15:40:42.249605 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.249574 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 15:40:42.249605 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.249584 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 15:40:42.250669 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.250658 2572 policy_none.go:47] "Start" Jul 07 15:40:42.290636 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.290615 2572 manager.go:337] "Starting Device Plugin manager" Jul 07 15:40:42.290774 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.290659 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 15:40:42.290774 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.290669 2572 server.go:87] "Starting device plugin registration server" Jul 07 15:40:42.290947 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.290935 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 15:40:42.291008 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.290947 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 15:40:42.291057 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.291018 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 15:40:42.291110 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.291096 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 15:40:42.291110 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.291106 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 15:40:42.291727 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.291706 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 15:40:42.291832 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.291753 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-64.ec2.internal\" not found" Jul 07 15:40:42.369507 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.369463 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 15:40:42.370915 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.370897 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 15:40:42.370998 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.370942 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 15:40:42.370998 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.370968 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 15:40:42.371090 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.371010 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 15:40:42.374130 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.374104 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:40:42.391197 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.391164 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:40:42.393465 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.393446 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:40:42.393538 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.393482 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:40:42.393538 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.393497 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:40:42.393538 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.393526 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.401940 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.401887 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.401940 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.401925 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-64.ec2.internal\": node \"ip-10-0-138-64.ec2.internal\" not found" Jul 07 15:40:42.421907 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.421883 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-64.ec2.internal\" not found" Jul 07 15:40:42.471131 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.471082 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-64.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal"] Jul 07 15:40:42.471202 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.471172 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:40:42.472238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.472222 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:40:42.472309 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.472255 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:40:42.472309 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.472270 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:40:42.473676 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.473664 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:40:42.473794 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.473780 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.473832 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.473812 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:40:42.474530 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.474510 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:40:42.474630 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.474537 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:40:42.474630 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.474547 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:40:42.475198 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.475181 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:40:42.475245 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.475217 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:40:42.475245 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.475233 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:40:42.476563 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.476551 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.476605 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.476578 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:40:42.477293 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.477265 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:40:42.477293 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.477292 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:40:42.477418 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.477302 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:40:42.499624 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.499598 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-64.ec2.internal\" not found" node="ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.504147 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.504130 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-64.ec2.internal\" not found" node="ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.522019 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.521993 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-64.ec2.internal\" not found" Jul 07 15:40:42.533268 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.533240 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebdd5e05e05144f286c0cddaebd117a9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal\" (UID: \"ebdd5e05e05144f286c0cddaebd117a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.533354 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.533272 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/929bfad889b023d7ee3168f8319c1420-config\") pod \"kube-apiserver-proxy-ip-10-0-138-64.ec2.internal\" (UID: \"929bfad889b023d7ee3168f8319c1420\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.533354 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.533289 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ebdd5e05e05144f286c0cddaebd117a9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal\" (UID: \"ebdd5e05e05144f286c0cddaebd117a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.622445 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.622411 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-64.ec2.internal\" not found" Jul 07 15:40:42.633811 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.633784 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/929bfad889b023d7ee3168f8319c1420-config\") pod \"kube-apiserver-proxy-ip-10-0-138-64.ec2.internal\" (UID: \"929bfad889b023d7ee3168f8319c1420\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.633908 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.633818 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/929bfad889b023d7ee3168f8319c1420-config\") pod \"kube-apiserver-proxy-ip-10-0-138-64.ec2.internal\" (UID: \"929bfad889b023d7ee3168f8319c1420\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.633908 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.633896 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ebdd5e05e05144f286c0cddaebd117a9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal\" (UID: \"ebdd5e05e05144f286c0cddaebd117a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.633987 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.633915 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebdd5e05e05144f286c0cddaebd117a9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal\" (UID: \"ebdd5e05e05144f286c0cddaebd117a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.633987 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.633963 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebdd5e05e05144f286c0cddaebd117a9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal\" (UID: \"ebdd5e05e05144f286c0cddaebd117a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.634101 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.633982 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ebdd5e05e05144f286c0cddaebd117a9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal\" (UID: \"ebdd5e05e05144f286c0cddaebd117a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.723295 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.723230 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-64.ec2.internal\" not found" Jul 07 15:40:42.803705 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.803681 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.807940 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:42.807644 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal" Jul 07 15:40:42.823786 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.823760 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-64.ec2.internal\" not found" Jul 07 15:40:42.924349 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:42.924304 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-64.ec2.internal\" not found" Jul 07 15:40:43.025446 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:43.025360 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-64.ec2.internal\" not found" Jul 07 15:40:43.125719 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:43.125685 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-64.ec2.internal\" not found" Jul 07 15:40:43.171280 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:43.171245 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 15:40:43.171965 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:43.171405 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 15:40:43.171965 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:43.171466 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 15:40:43.225780 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:43.225747 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-64.ec2.internal\" not found" Jul 07 15:40:43.235522 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:43.235457 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 15:35:42 +0000 UTC" deadline="2028-02-20 23:06:11.371546424 +0000 UTC" Jul 07 15:40:43.235522 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:43.235509 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14239h25m28.136042376s" Jul 07 15:40:43.326680 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:43.326604 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-64.ec2.internal\" not found" Jul 07 15:40:43.359689 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:43.359655 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebdd5e05e05144f286c0cddaebd117a9.slice/crio-0f5b4b0d0749316ae245201618a719dc9e82321ea41819b2683e727b889e7f29 WatchSource:0}: Error finding container 0f5b4b0d0749316ae245201618a719dc9e82321ea41819b2683e727b889e7f29: Status 404 returned error can't find the container with id 0f5b4b0d0749316ae245201618a719dc9e82321ea41819b2683e727b889e7f29 Jul 07 15:40:43.360086 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:43.360059 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod929bfad889b023d7ee3168f8319c1420.slice/crio-1d6d2077ac671d22e15605a84eaddb96cf4d8ca0e017910112d0521686c23565 WatchSource:0}: Error finding container 1d6d2077ac671d22e15605a84eaddb96cf4d8ca0e017910112d0521686c23565: Status 404 returned error can't find the container with id 1d6d2077ac671d22e15605a84eaddb96cf4d8ca0e017910112d0521686c23565 Jul 07 15:40:43.366622 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:43.366605 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:40:43.376646 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:43.376572 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-64.ec2.internal" event={"ID":"929bfad889b023d7ee3168f8319c1420","Type":"ContainerStarted","Data":"1d6d2077ac671d22e15605a84eaddb96cf4d8ca0e017910112d0521686c23565"} Jul 07 15:40:43.377749 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:43.377726 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal" event={"ID":"ebdd5e05e05144f286c0cddaebd117a9","Type":"ContainerStarted","Data":"0f5b4b0d0749316ae245201618a719dc9e82321ea41819b2683e727b889e7f29"} Jul 07 15:40:43.427093 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:43.427056 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-64.ec2.internal\" not found" Jul 07 15:40:43.533714 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:43.533670 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-64.ec2.internal\" not found" Jul 07 15:40:43.634508 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:43.634469 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-64.ec2.internal\" not found" Jul 07 15:40:43.639516 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:43.639497 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:40:43.689351 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:43.689313 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:40:43.731955 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:43.731909 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal" Jul 07 15:40:43.743239 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:43.743209 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 15:40:43.744181 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:43.744165 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-64.ec2.internal" Jul 07 15:40:43.753421 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:43.753394 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 15:40:44.212941 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.212905 2572 apiserver.go:52] "Watching apiserver" Jul 07 15:40:44.223518 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.223426 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 15:40:44.224793 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.224758 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-gc7w8","openshift-multus/multus-additional-cni-plugins-7qvp4","openshift-multus/multus-c28px","openshift-dns/node-resolver-9m9rt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal","openshift-multus/network-metrics-daemon-nsxgh","openshift-network-diagnostics/network-check-target-hppz7","openshift-network-operator/iptables-alerter-q8srj","openshift-ovn-kubernetes/ovnkube-node-bmlhg","kube-system/global-pull-secret-syncer-4q4t9","kube-system/konnectivity-agent-5nrjp","kube-system/kube-apiserver-proxy-ip-10-0-138-64.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9","openshift-cluster-node-tuning-operator/tuned-bxjmc"] Jul 07 15:40:44.226346 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.226317 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:40:44.226473 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.226407 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:40:44.227635 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.227608 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5nrjp" Jul 07 15:40:44.228809 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.228786 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c28px" Jul 07 15:40:44.229982 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.229960 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9m9rt" Jul 07 15:40:44.231239 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.231219 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 15:40:44.231355 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.231330 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.234018 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.233498 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:40:44.234018 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.233587 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:40:44.235234 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.235209 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.236775 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.236747 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.238244 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.238223 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.239848 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.239825 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:44.239966 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.239918 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:40:44.241485 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241462 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5904914-177d-4c1f-9be3-a3f3ef40c391-tmp-dir\") pod \"node-resolver-9m9rt\" (UID: \"b5904914-177d-4c1f-9be3-a3f3ef40c391\") " pod="openshift-dns/node-resolver-9m9rt" Jul 07 15:40:44.241582 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241499 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-modprobe-d\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.241582 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241526 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-cni-binary-copy\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.241582 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241555 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-os-release\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.241698 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-var-lib-cni-bin\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.241698 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241633 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-multus-conf-dir\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.241698 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241690 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-multus-socket-dir-parent\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.241826 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241723 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-run-k8s-cni-cncf-io\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.241826 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241752 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-multus-daemon-config\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.241826 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241778 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-sys\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.241826 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241802 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gc7w8" Jul 07 15:40:44.241826 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241806 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvkxt\" (UniqueName: \"kubernetes.io/projected/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-kube-api-access-mvkxt\") pod \"network-metrics-daemon-nsxgh\" (UID: \"867e35ee-0f3c-4d9f-8485-b3b5d60790cc\") " pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:40:44.242046 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241830 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/708dd8c4-5687-42c0-b485-ec5cd5e0c8cd-konnectivity-ca\") pod \"konnectivity-agent-5nrjp\" (UID: \"708dd8c4-5687-42c0-b485-ec5cd5e0c8cd\") " pod="kube-system/konnectivity-agent-5nrjp" Jul 07 15:40:44.242046 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241855 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-var-lib-kubelet\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.242046 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-run-multus-certs\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.242046 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241933 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2wj6\" (UniqueName: \"kubernetes.io/projected/b5904914-177d-4c1f-9be3-a3f3ef40c391-kube-api-access-b2wj6\") pod \"node-resolver-9m9rt\" (UID: \"b5904914-177d-4c1f-9be3-a3f3ef40c391\") " pod="openshift-dns/node-resolver-9m9rt" Jul 07 15:40:44.242046 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241957 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-run\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.242046 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.241980 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-var-lib-kubelet\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.242046 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242004 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-host\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.242046 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242037 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-sysconfig\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.242317 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242061 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr2fc\" (UniqueName: \"kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc\") pod \"network-check-target-hppz7\" (UID: \"44176831-53af-4b36-aaeb-1b05e789dc01\") " pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:40:44.242317 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-system-cni-dir\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.242317 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242111 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-multus-cni-dir\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.242317 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242133 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-cnibin\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.242317 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242156 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-hostroot\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.242317 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242182 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvszg\" (UniqueName: \"kubernetes.io/projected/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-kube-api-access-tvszg\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.242317 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242209 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/867230a6-3253-4bf0-8427-191d66ebdcf3-tmp\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.242317 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242240 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-kubernetes\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.242317 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242265 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-sysctl-d\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.242317 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242289 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-lib-modules\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.242317 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242312 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jrgz\" (UniqueName: \"kubernetes.io/projected/867230a6-3253-4bf0-8427-191d66ebdcf3-kube-api-access-7jrgz\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.242922 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242342 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs\") pod \"network-metrics-daemon-nsxgh\" (UID: \"867e35ee-0f3c-4d9f-8485-b3b5d60790cc\") " pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:40:44.242922 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242375 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-run-netns\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.242922 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242400 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/708dd8c4-5687-42c0-b485-ec5cd5e0c8cd-agent-certs\") pod \"konnectivity-agent-5nrjp\" (UID: \"708dd8c4-5687-42c0-b485-ec5cd5e0c8cd\") " pod="kube-system/konnectivity-agent-5nrjp" Jul 07 15:40:44.242922 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242424 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-var-lib-cni-multus\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.242922 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242451 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-etc-kubernetes\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.242922 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242487 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b5904914-177d-4c1f-9be3-a3f3ef40c391-hosts-file\") pod \"node-resolver-9m9rt\" (UID: \"b5904914-177d-4c1f-9be3-a3f3ef40c391\") " pod="openshift-dns/node-resolver-9m9rt" Jul 07 15:40:44.242922 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242511 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-sysctl-conf\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.242922 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242542 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-systemd\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.242922 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242568 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-tuned\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.242922 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.242613 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 15:40:44.245349 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.244661 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q8srj" Jul 07 15:40:44.245349 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.245297 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kzc4f\"" Jul 07 15:40:44.245469 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.245364 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 15:40:44.246076 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.245900 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 15:40:44.258732 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.258705 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6s466\"" Jul 07 15:40:44.263926 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.263901 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rtzwd\"" Jul 07 15:40:44.264280 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.264262 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:40:44.264412 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.264395 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 15:40:44.264493 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.264479 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 15:40:44.264666 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.264651 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 15:40:44.264725 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.264687 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 15:40:44.264840 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.264826 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 15:40:44.264877 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.264869 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 15:40:44.265365 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.264266 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f67x4\"" Jul 07 15:40:44.265365 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.265069 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 15:40:44.265365 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.265092 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 15:40:44.265365 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.265092 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 15:40:44.265365 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.265093 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 15:40:44.265365 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.265238 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 15:40:44.265365 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.265251 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p5w4m\"" Jul 07 15:40:44.265365 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.265262 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 15:40:44.265365 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.265309 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gx9k2\"" Jul 07 15:40:44.265365 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.265317 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 15:40:44.266030 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.265397 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 15:40:44.266030 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.265445 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 15:40:44.266030 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.265539 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8p26p\"" Jul 07 15:40:44.266030 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.265633 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 15:40:44.266030 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.265868 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 15:40:44.266619 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.266602 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 15:40:44.267353 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.267331 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 15:40:44.267570 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.267550 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 15:40:44.267676 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.267554 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g5qgl\"" Jul 07 15:40:44.267676 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.267631 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:40:44.267810 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.267774 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 15:40:44.267918 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.267899 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 15:40:44.272374 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.272347 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lk648\"" Jul 07 15:40:44.282927 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.282668 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 15:40:44.301931 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.301897 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:40:44.329195 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.329154 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z2qrf" Jul 07 15:40:44.332584 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.332562 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 15:40:44.338817 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.338790 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z2qrf" Jul 07 15:40:44.342796 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.342769 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08005bdf-60d5-48a3-91b2-21181c3ae482-system-cni-dir\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.342912 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.342811 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-run-ovn\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.342912 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.342838 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-cni-bin\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.343046 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.342909 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-socket-dir\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.343046 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.342954 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-kubernetes\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.343046 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.342982 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-sysctl-d\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.343046 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343010 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-registration-dir\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.343046 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343038 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-run-netns\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.343294 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343061 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/708dd8c4-5687-42c0-b485-ec5cd5e0c8cd-agent-certs\") pod \"konnectivity-agent-5nrjp\" (UID: \"708dd8c4-5687-42c0-b485-ec5cd5e0c8cd\") " pod="kube-system/konnectivity-agent-5nrjp" Jul 07 15:40:44.343294 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343085 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-var-lib-cni-multus\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.343294 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343095 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-kubernetes\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.343294 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343108 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-etc-kubernetes\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.343294 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343152 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-etc-kubernetes\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.343294 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343159 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b5904914-177d-4c1f-9be3-a3f3ef40c391-hosts-file\") pod \"node-resolver-9m9rt\" (UID: \"b5904914-177d-4c1f-9be3-a3f3ef40c391\") " pod="openshift-dns/node-resolver-9m9rt" Jul 07 15:40:44.343294 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343152 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-sysctl-d\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.343294 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343189 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-var-lib-cni-multus\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.343294 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343193 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqls8\" (UniqueName: \"kubernetes.io/projected/adceffcc-f1d1-4820-9c62-80f1d029dc3a-kube-api-access-dqls8\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.343294 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343155 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-run-netns\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.343294 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343213 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b5904914-177d-4c1f-9be3-a3f3ef40c391-hosts-file\") pod \"node-resolver-9m9rt\" (UID: \"b5904914-177d-4c1f-9be3-a3f3ef40c391\") " pod="openshift-dns/node-resolver-9m9rt" Jul 07 15:40:44.343294 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343234 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-device-dir\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.343294 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343257 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret\") pod \"global-pull-secret-syncer-4q4t9\" (UID: \"bd011bd6-abd7-4719-add3-7ba16ed962df\") " pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:44.343294 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343276 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-sysctl-conf\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.343294 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343297 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ed969f9-3b82-4f68-9c80-c173622b368e-iptables-alerter-script\") pod \"iptables-alerter-q8srj\" (UID: \"8ed969f9-3b82-4f68-9c80-c173622b368e\") " pod="openshift-network-operator/iptables-alerter-q8srj" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343323 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-var-lib-openvswitch\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343345 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-modprobe-d\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343365 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-cni-binary-copy\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343388 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-os-release\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343412 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-sys\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343422 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-sysctl-conf\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343437 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-node-log\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343463 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-multus-socket-dir-parent\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343488 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08005bdf-60d5-48a3-91b2-21181c3ae482-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343513 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2wj6\" (UniqueName: \"kubernetes.io/projected/b5904914-177d-4c1f-9be3-a3f3ef40c391-kube-api-access-b2wj6\") pod \"node-resolver-9m9rt\" (UID: \"b5904914-177d-4c1f-9be3-a3f3ef40c391\") " pod="openshift-dns/node-resolver-9m9rt" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343537 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-os-release\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343540 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-run\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343549 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343577 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-slash\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343583 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-sys\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343584 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-run\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/adceffcc-f1d1-4820-9c62-80f1d029dc3a-ovn-node-metrics-cert\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.344136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343514 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-modprobe-d\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343657 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-multus-socket-dir-parent\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343745 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz9jt\" (UniqueName: \"kubernetes.io/projected/0741b689-975b-467a-9288-53cd119c0791-kube-api-access-kz9jt\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343778 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-sysconfig\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343805 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2fc\" (UniqueName: \"kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc\") pod \"network-check-target-hppz7\" (UID: \"44176831-53af-4b36-aaeb-1b05e789dc01\") " pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343833 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-sysconfig\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343881 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-multus-cni-dir\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343908 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-cnibin\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343932 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-hostroot\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343957 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvszg\" (UniqueName: \"kubernetes.io/projected/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-kube-api-access-tvszg\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343980 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/867230a6-3253-4bf0-8427-191d66ebdcf3-tmp\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.343997 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-multus-cni-dir\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344003 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-lib-modules\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344039 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs\") pod \"network-metrics-daemon-nsxgh\" (UID: \"867e35ee-0f3c-4d9f-8485-b3b5d60790cc\") " pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344054 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-hostroot\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08005bdf-60d5-48a3-91b2-21181c3ae482-cnibin\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344083 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-cni-binary-copy\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344109 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-lib-modules\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.344967 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.344143 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:40:44.346093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344174 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-cnibin\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.346093 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.344235 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs podName:867e35ee-0f3c-4d9f-8485-b3b5d60790cc nodeName:}" failed. No retries permitted until 2026-07-07 15:40:44.844196907 +0000 UTC m=+2.994057423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs") pod "network-metrics-daemon-nsxgh" (UID: "867e35ee-0f3c-4d9f-8485-b3b5d60790cc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:40:44.346093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344257 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08005bdf-60d5-48a3-91b2-21181c3ae482-os-release\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.346093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344284 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-kubelet\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.346093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344308 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-log-socket\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.346093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344337 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-sys-fs\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.346093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344363 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-systemd\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.346093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344388 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-tuned\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.346093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344417 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08005bdf-60d5-48a3-91b2-21181c3ae482-cni-binary-copy\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.346093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344429 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-systemd\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.346093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344443 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-run-systemd\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.346093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344471 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.346093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344508 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5904914-177d-4c1f-9be3-a3f3ef40c391-tmp-dir\") pod \"node-resolver-9m9rt\" (UID: \"b5904914-177d-4c1f-9be3-a3f3ef40c391\") " pod="openshift-dns/node-resolver-9m9rt" Jul 07 15:40:44.346093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344588 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-var-lib-cni-bin\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.346093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344643 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-var-lib-cni-bin\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.346093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344661 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-multus-conf-dir\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.346904 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344692 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-multus-daemon-config\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.346904 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344718 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwg8g\" (UniqueName: \"kubernetes.io/projected/8ed969f9-3b82-4f68-9c80-c173622b368e-kube-api-access-gwg8g\") pod \"iptables-alerter-q8srj\" (UID: \"8ed969f9-3b82-4f68-9c80-c173622b368e\") " pod="openshift-network-operator/iptables-alerter-q8srj" Jul 07 15:40:44.346904 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344745 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c99g8\" (UniqueName: \"kubernetes.io/projected/08005bdf-60d5-48a3-91b2-21181c3ae482-kube-api-access-c99g8\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.346904 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344747 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-multus-conf-dir\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.346904 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344763 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5904914-177d-4c1f-9be3-a3f3ef40c391-tmp-dir\") pod \"node-resolver-9m9rt\" (UID: \"b5904914-177d-4c1f-9be3-a3f3ef40c391\") " pod="openshift-dns/node-resolver-9m9rt" Jul 07 15:40:44.346904 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344799 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-systemd-units\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.346904 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344825 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-run-k8s-cni-cncf-io\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.346904 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344842 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvkxt\" (UniqueName: \"kubernetes.io/projected/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-kube-api-access-mvkxt\") pod \"network-metrics-daemon-nsxgh\" (UID: \"867e35ee-0f3c-4d9f-8485-b3b5d60790cc\") " pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:40:44.346904 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344872 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5253cd9-19e7-49d4-aaa6-5885489984fa-host\") pod \"node-ca-gc7w8\" (UID: \"e5253cd9-19e7-49d4-aaa6-5885489984fa\") " pod="openshift-image-registry/node-ca-gc7w8" Jul 07 15:40:44.346904 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344888 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5253cd9-19e7-49d4-aaa6-5885489984fa-serviceca\") pod \"node-ca-gc7w8\" (UID: \"e5253cd9-19e7-49d4-aaa6-5885489984fa\") " pod="openshift-image-registry/node-ca-gc7w8" Jul 07 15:40:44.346904 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344903 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-run-netns\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.346904 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344901 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-run-k8s-cni-cncf-io\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.346904 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.344932 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-etc-openvswitch\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.346904 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345037 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-run-openvswitch\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.346904 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345065 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.346904 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345093 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgxfg\" (UniqueName: \"kubernetes.io/projected/e5253cd9-19e7-49d4-aaa6-5885489984fa-kube-api-access-vgxfg\") pod \"node-ca-gc7w8\" (UID: \"e5253cd9-19e7-49d4-aaa6-5885489984fa\") " pod="openshift-image-registry/node-ca-gc7w8" Jul 07 15:40:44.346904 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345121 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-cni-netd\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.347776 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345154 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/adceffcc-f1d1-4820-9c62-80f1d029dc3a-ovnkube-config\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.347776 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345226 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/adceffcc-f1d1-4820-9c62-80f1d029dc3a-env-overrides\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.347776 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345249 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/adceffcc-f1d1-4820-9c62-80f1d029dc3a-ovnkube-script-lib\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.347776 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345248 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-multus-daemon-config\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.347776 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345273 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.347776 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345319 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bd011bd6-abd7-4719-add3-7ba16ed962df-kubelet-config\") pod \"global-pull-secret-syncer-4q4t9\" (UID: \"bd011bd6-abd7-4719-add3-7ba16ed962df\") " pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:44.347776 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345350 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/708dd8c4-5687-42c0-b485-ec5cd5e0c8cd-konnectivity-ca\") pod \"konnectivity-agent-5nrjp\" (UID: \"708dd8c4-5687-42c0-b485-ec5cd5e0c8cd\") " pod="kube-system/konnectivity-agent-5nrjp" Jul 07 15:40:44.347776 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345375 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-var-lib-kubelet\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.347776 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345402 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-run-multus-certs\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.347776 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345459 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-var-lib-kubelet\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.347776 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345484 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-host\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.347776 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345513 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/08005bdf-60d5-48a3-91b2-21181c3ae482-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.347776 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345542 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-etc-selinux\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.347776 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345573 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bd011bd6-abd7-4719-add3-7ba16ed962df-dbus\") pod \"global-pull-secret-syncer-4q4t9\" (UID: \"bd011bd6-abd7-4719-add3-7ba16ed962df\") " pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:44.347776 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345591 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/08005bdf-60d5-48a3-91b2-21181c3ae482-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.347776 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345607 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-system-cni-dir\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.347776 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345626 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jrgz\" (UniqueName: \"kubernetes.io/projected/867230a6-3253-4bf0-8427-191d66ebdcf3-kube-api-access-7jrgz\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.348668 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345641 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ed969f9-3b82-4f68-9c80-c173622b368e-host-slash\") pod \"iptables-alerter-q8srj\" (UID: \"8ed969f9-3b82-4f68-9c80-c173622b368e\") " pod="openshift-network-operator/iptables-alerter-q8srj" Jul 07 15:40:44.348668 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345704 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-host\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.348668 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345773 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-run-multus-certs\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.348668 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345822 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/867230a6-3253-4bf0-8427-191d66ebdcf3-var-lib-kubelet\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.348668 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345890 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-system-cni-dir\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.348668 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.345933 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-host-var-lib-kubelet\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.348668 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.346243 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/708dd8c4-5687-42c0-b485-ec5cd5e0c8cd-konnectivity-ca\") pod \"konnectivity-agent-5nrjp\" (UID: \"708dd8c4-5687-42c0-b485-ec5cd5e0c8cd\") " pod="kube-system/konnectivity-agent-5nrjp" Jul 07 15:40:44.348668 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.347620 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/708dd8c4-5687-42c0-b485-ec5cd5e0c8cd-agent-certs\") pod \"konnectivity-agent-5nrjp\" (UID: \"708dd8c4-5687-42c0-b485-ec5cd5e0c8cd\") " pod="kube-system/konnectivity-agent-5nrjp" Jul 07 15:40:44.348668 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.347725 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/867230a6-3253-4bf0-8427-191d66ebdcf3-tmp\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.350750 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.350701 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/867230a6-3253-4bf0-8427-191d66ebdcf3-etc-tuned\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.353044 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.352724 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:40:44.353044 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.352751 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:40:44.353044 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.352767 2572 projected.go:196] Error preparing data for projected volume kube-api-access-gr2fc for pod openshift-network-diagnostics/network-check-target-hppz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:40:44.353044 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.352843 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc podName:44176831-53af-4b36-aaeb-1b05e789dc01 nodeName:}" failed. No retries permitted until 2026-07-07 15:40:44.85282408 +0000 UTC m=+3.002684584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gr2fc" (UniqueName: "kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc") pod "network-check-target-hppz7" (UID: "44176831-53af-4b36-aaeb-1b05e789dc01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:40:44.356246 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.356219 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvszg\" (UniqueName: \"kubernetes.io/projected/14ccfca5-b744-4fdd-a95d-7da77f0be2a1-kube-api-access-tvszg\") pod \"multus-c28px\" (UID: \"14ccfca5-b744-4fdd-a95d-7da77f0be2a1\") " pod="openshift-multus/multus-c28px" Jul 07 15:40:44.360896 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.360836 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2wj6\" (UniqueName: \"kubernetes.io/projected/b5904914-177d-4c1f-9be3-a3f3ef40c391-kube-api-access-b2wj6\") pod \"node-resolver-9m9rt\" (UID: \"b5904914-177d-4c1f-9be3-a3f3ef40c391\") " pod="openshift-dns/node-resolver-9m9rt" Jul 07 15:40:44.360896 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.360836 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvkxt\" (UniqueName: \"kubernetes.io/projected/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-kube-api-access-mvkxt\") pod \"network-metrics-daemon-nsxgh\" (UID: \"867e35ee-0f3c-4d9f-8485-b3b5d60790cc\") " pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:40:44.362676 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.362651 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jrgz\" (UniqueName: \"kubernetes.io/projected/867230a6-3253-4bf0-8427-191d66ebdcf3-kube-api-access-7jrgz\") pod \"tuned-bxjmc\" (UID: \"867230a6-3253-4bf0-8427-191d66ebdcf3\") " pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.446472 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.446431 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-registration-dir\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.446472 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.446482 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqls8\" (UniqueName: \"kubernetes.io/projected/adceffcc-f1d1-4820-9c62-80f1d029dc3a-kube-api-access-dqls8\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.446756 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.446510 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-device-dir\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.446756 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.446550 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret\") pod \"global-pull-secret-syncer-4q4t9\" (UID: \"bd011bd6-abd7-4719-add3-7ba16ed962df\") " pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:44.446756 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.446568 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ed969f9-3b82-4f68-9c80-c173622b368e-iptables-alerter-script\") pod \"iptables-alerter-q8srj\" (UID: \"8ed969f9-3b82-4f68-9c80-c173622b368e\") " pod="openshift-network-operator/iptables-alerter-q8srj" Jul 07 15:40:44.446756 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.446586 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-registration-dir\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.446756 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.446618 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-device-dir\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.446756 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.446596 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-var-lib-openvswitch\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.446756 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.446655 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-var-lib-openvswitch\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.446756 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.446679 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:40:44.446756 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.446684 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-node-log\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.446756 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.446718 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08005bdf-60d5-48a3-91b2-21181c3ae482-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.446756 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.446742 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret podName:bd011bd6-abd7-4719-add3-7ba16ed962df nodeName:}" failed. No retries permitted until 2026-07-07 15:40:44.94672171 +0000 UTC m=+3.096582210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret") pod "global-pull-secret-syncer-4q4t9" (UID: "bd011bd6-abd7-4719-add3-7ba16ed962df") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:40:44.447243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.446782 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-node-log\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.446803 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-slash\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.446833 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/adceffcc-f1d1-4820-9c62-80f1d029dc3a-ovn-node-metrics-cert\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.446905 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-slash\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.446937 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz9jt\" (UniqueName: \"kubernetes.io/projected/0741b689-975b-467a-9288-53cd119c0791-kube-api-access-kz9jt\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.447243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447002 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08005bdf-60d5-48a3-91b2-21181c3ae482-cnibin\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.447243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447021 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08005bdf-60d5-48a3-91b2-21181c3ae482-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.447243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447041 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08005bdf-60d5-48a3-91b2-21181c3ae482-os-release\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.447243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447072 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-kubelet\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447101 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-log-socket\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447129 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-sys-fs\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.447243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447138 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08005bdf-60d5-48a3-91b2-21181c3ae482-os-release\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.447243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447074 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08005bdf-60d5-48a3-91b2-21181c3ae482-cnibin\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.447243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447162 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08005bdf-60d5-48a3-91b2-21181c3ae482-cni-binary-copy\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.447243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447192 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-run-systemd\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447204 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-kubelet\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447222 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447830 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447235 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ed969f9-3b82-4f68-9c80-c173622b368e-iptables-alerter-script\") pod \"iptables-alerter-q8srj\" (UID: \"8ed969f9-3b82-4f68-9c80-c173622b368e\") " pod="openshift-network-operator/iptables-alerter-q8srj" Jul 07 15:40:44.447830 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447250 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-sys-fs\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.447830 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447263 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwg8g\" (UniqueName: \"kubernetes.io/projected/8ed969f9-3b82-4f68-9c80-c173622b368e-kube-api-access-gwg8g\") pod \"iptables-alerter-q8srj\" (UID: \"8ed969f9-3b82-4f68-9c80-c173622b368e\") " pod="openshift-network-operator/iptables-alerter-q8srj" Jul 07 15:40:44.447830 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447295 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-log-socket\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447830 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447298 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c99g8\" (UniqueName: \"kubernetes.io/projected/08005bdf-60d5-48a3-91b2-21181c3ae482-kube-api-access-c99g8\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.447830 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447306 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447830 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447327 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-systemd-units\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447830 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447336 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-run-systemd\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447830 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447361 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5253cd9-19e7-49d4-aaa6-5885489984fa-host\") pod \"node-ca-gc7w8\" (UID: \"e5253cd9-19e7-49d4-aaa6-5885489984fa\") " pod="openshift-image-registry/node-ca-gc7w8" Jul 07 15:40:44.447830 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447390 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5253cd9-19e7-49d4-aaa6-5885489984fa-serviceca\") pod \"node-ca-gc7w8\" (UID: \"e5253cd9-19e7-49d4-aaa6-5885489984fa\") " pod="openshift-image-registry/node-ca-gc7w8" Jul 07 15:40:44.447830 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447439 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-run-netns\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447830 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447469 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-etc-openvswitch\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447830 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447491 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5253cd9-19e7-49d4-aaa6-5885489984fa-host\") pod \"node-ca-gc7w8\" (UID: \"e5253cd9-19e7-49d4-aaa6-5885489984fa\") " pod="openshift-image-registry/node-ca-gc7w8" Jul 07 15:40:44.447830 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447501 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-run-openvswitch\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447830 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447524 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-systemd-units\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447830 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447530 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.447830 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447562 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgxfg\" (UniqueName: \"kubernetes.io/projected/e5253cd9-19e7-49d4-aaa6-5885489984fa-kube-api-access-vgxfg\") pod \"node-ca-gc7w8\" (UID: \"e5253cd9-19e7-49d4-aaa6-5885489984fa\") " pod="openshift-image-registry/node-ca-gc7w8" Jul 07 15:40:44.448607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447571 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-run-netns\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.448607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447575 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.448607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447598 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-cni-netd\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.448607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-cni-netd\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.448607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447617 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-etc-openvswitch\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.448607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447622 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/adceffcc-f1d1-4820-9c62-80f1d029dc3a-ovnkube-config\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.448607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447667 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/adceffcc-f1d1-4820-9c62-80f1d029dc3a-env-overrides\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.448607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447696 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/adceffcc-f1d1-4820-9c62-80f1d029dc3a-ovnkube-script-lib\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.448607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447726 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.448607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447759 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bd011bd6-abd7-4719-add3-7ba16ed962df-kubelet-config\") pod \"global-pull-secret-syncer-4q4t9\" (UID: \"bd011bd6-abd7-4719-add3-7ba16ed962df\") " pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:44.448607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447795 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/08005bdf-60d5-48a3-91b2-21181c3ae482-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.448607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447811 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08005bdf-60d5-48a3-91b2-21181c3ae482-cni-binary-copy\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.448607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447827 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-etc-selinux\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.448607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447857 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bd011bd6-abd7-4719-add3-7ba16ed962df-dbus\") pod \"global-pull-secret-syncer-4q4t9\" (UID: \"bd011bd6-abd7-4719-add3-7ba16ed962df\") " pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:44.448607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447888 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/08005bdf-60d5-48a3-91b2-21181c3ae482-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.448607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447921 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ed969f9-3b82-4f68-9c80-c173622b368e-host-slash\") pod \"iptables-alerter-q8srj\" (UID: \"8ed969f9-3b82-4f68-9c80-c173622b368e\") " pod="openshift-network-operator/iptables-alerter-q8srj" Jul 07 15:40:44.448607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.447975 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08005bdf-60d5-48a3-91b2-21181c3ae482-system-cni-dir\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.449146 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.448004 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-run-ovn\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.449146 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.448035 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-cni-bin\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.449146 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.448100 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-socket-dir\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.449146 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.448101 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/adceffcc-f1d1-4820-9c62-80f1d029dc3a-ovnkube-config\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.449146 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.448381 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.449146 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.448449 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5253cd9-19e7-49d4-aaa6-5885489984fa-serviceca\") pod \"node-ca-gc7w8\" (UID: \"e5253cd9-19e7-49d4-aaa6-5885489984fa\") " pod="openshift-image-registry/node-ca-gc7w8" Jul 07 15:40:44.449146 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.448580 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-etc-selinux\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.449146 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.448711 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bd011bd6-abd7-4719-add3-7ba16ed962df-dbus\") pod \"global-pull-secret-syncer-4q4t9\" (UID: \"bd011bd6-abd7-4719-add3-7ba16ed962df\") " pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:44.449146 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.448979 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/adceffcc-f1d1-4820-9c62-80f1d029dc3a-ovnkube-script-lib\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.449146 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.448978 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/08005bdf-60d5-48a3-91b2-21181c3ae482-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.449146 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.448452 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bd011bd6-abd7-4719-add3-7ba16ed962df-kubelet-config\") pod \"global-pull-secret-syncer-4q4t9\" (UID: \"bd011bd6-abd7-4719-add3-7ba16ed962df\") " pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:44.449146 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.449059 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-run-openvswitch\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.449146 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.449108 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-run-ovn\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.449146 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.449149 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ed969f9-3b82-4f68-9c80-c173622b368e-host-slash\") pod \"iptables-alerter-q8srj\" (UID: \"8ed969f9-3b82-4f68-9c80-c173622b368e\") " pod="openshift-network-operator/iptables-alerter-q8srj" Jul 07 15:40:44.449709 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.449177 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08005bdf-60d5-48a3-91b2-21181c3ae482-system-cni-dir\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.449709 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.449204 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/adceffcc-f1d1-4820-9c62-80f1d029dc3a-host-cni-bin\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.449709 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.449308 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0741b689-975b-467a-9288-53cd119c0791-socket-dir\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.449709 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.449416 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/08005bdf-60d5-48a3-91b2-21181c3ae482-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.449709 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.449481 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/adceffcc-f1d1-4820-9c62-80f1d029dc3a-env-overrides\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.451712 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.451688 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/adceffcc-f1d1-4820-9c62-80f1d029dc3a-ovn-node-metrics-cert\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.457548 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.456414 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz9jt\" (UniqueName: \"kubernetes.io/projected/0741b689-975b-467a-9288-53cd119c0791-kube-api-access-kz9jt\") pod \"aws-ebs-csi-driver-node-9k8w9\" (UID: \"0741b689-975b-467a-9288-53cd119c0791\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.457548 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.456411 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqls8\" (UniqueName: \"kubernetes.io/projected/adceffcc-f1d1-4820-9c62-80f1d029dc3a-kube-api-access-dqls8\") pod \"ovnkube-node-bmlhg\" (UID: \"adceffcc-f1d1-4820-9c62-80f1d029dc3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.457548 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.457069 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgxfg\" (UniqueName: \"kubernetes.io/projected/e5253cd9-19e7-49d4-aaa6-5885489984fa-kube-api-access-vgxfg\") pod \"node-ca-gc7w8\" (UID: \"e5253cd9-19e7-49d4-aaa6-5885489984fa\") " pod="openshift-image-registry/node-ca-gc7w8" Jul 07 15:40:44.457548 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.457514 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwg8g\" (UniqueName: \"kubernetes.io/projected/8ed969f9-3b82-4f68-9c80-c173622b368e-kube-api-access-gwg8g\") pod \"iptables-alerter-q8srj\" (UID: \"8ed969f9-3b82-4f68-9c80-c173622b368e\") " pod="openshift-network-operator/iptables-alerter-q8srj" Jul 07 15:40:44.458491 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.458468 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c99g8\" (UniqueName: \"kubernetes.io/projected/08005bdf-60d5-48a3-91b2-21181c3ae482-kube-api-access-c99g8\") pod \"multus-additional-cni-plugins-7qvp4\" (UID: \"08005bdf-60d5-48a3-91b2-21181c3ae482\") " pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.549087 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.548991 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5nrjp" Jul 07 15:40:44.558342 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.558316 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c28px" Jul 07 15:40:44.568442 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.568414 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9m9rt" Jul 07 15:40:44.576347 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.576321 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" Jul 07 15:40:44.585773 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.585736 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:40:44.593002 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.592974 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" Jul 07 15:40:44.595094 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.595076 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:40:44.604533 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.604508 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7qvp4" Jul 07 15:40:44.611443 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.611419 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gc7w8" Jul 07 15:40:44.619379 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.619354 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q8srj" Jul 07 15:40:44.851578 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.851507 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs\") pod \"network-metrics-daemon-nsxgh\" (UID: \"867e35ee-0f3c-4d9f-8485-b3b5d60790cc\") " pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:40:44.851727 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.851666 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:40:44.851766 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.851729 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs podName:867e35ee-0f3c-4d9f-8485-b3b5d60790cc nodeName:}" failed. No retries permitted until 2026-07-07 15:40:45.851712356 +0000 UTC m=+4.001572843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs") pod "network-metrics-daemon-nsxgh" (UID: "867e35ee-0f3c-4d9f-8485-b3b5d60790cc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:40:44.952510 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.952467 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret\") pod \"global-pull-secret-syncer-4q4t9\" (UID: \"bd011bd6-abd7-4719-add3-7ba16ed962df\") " pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:44.952710 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:44.952524 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2fc\" (UniqueName: \"kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc\") pod \"network-check-target-hppz7\" (UID: \"44176831-53af-4b36-aaeb-1b05e789dc01\") " pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:40:44.952710 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.952635 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:40:44.952710 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.952651 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:40:44.952710 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.952670 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:40:44.952710 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.952683 2572 projected.go:196] Error preparing data for projected volume kube-api-access-gr2fc for pod openshift-network-diagnostics/network-check-target-hppz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:40:44.953014 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.952715 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret podName:bd011bd6-abd7-4719-add3-7ba16ed962df nodeName:}" failed. No retries permitted until 2026-07-07 15:40:45.952694303 +0000 UTC m=+4.102554789 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret") pod "global-pull-secret-syncer-4q4t9" (UID: "bd011bd6-abd7-4719-add3-7ba16ed962df") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:40:44.953014 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:44.952736 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc podName:44176831-53af-4b36-aaeb-1b05e789dc01 nodeName:}" failed. No retries permitted until 2026-07-07 15:40:45.952729206 +0000 UTC m=+4.102589692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gr2fc" (UniqueName: "kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc") pod "network-check-target-hppz7" (UID: "44176831-53af-4b36-aaeb-1b05e789dc01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:40:45.341562 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:45.341501 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 15:35:44 +0000 UTC" deadline="2028-02-16 03:26:58.446671827 +0000 UTC" Jul 07 15:40:45.341562 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:45.341547 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14123h46m13.105129728s" Jul 07 15:40:45.371484 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:45.371454 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:45.371629 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:45.371571 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:40:45.584294 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:45.584256 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod708dd8c4_5687_42c0_b485_ec5cd5e0c8cd.slice/crio-b0980667946e129dbf5e15aa1cc512b7d6af67f0cd61bdd4798b8edade311295 WatchSource:0}: Error finding container b0980667946e129dbf5e15aa1cc512b7d6af67f0cd61bdd4798b8edade311295: Status 404 returned error can't find the container with id b0980667946e129dbf5e15aa1cc512b7d6af67f0cd61bdd4798b8edade311295 Jul 07 15:40:45.586480 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:45.586446 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0741b689_975b_467a_9288_53cd119c0791.slice/crio-08170d65a3e0b41b6fc0eb66aec603e37b22669ff6ae6c1101b5bae2e38815c0 WatchSource:0}: Error finding container 08170d65a3e0b41b6fc0eb66aec603e37b22669ff6ae6c1101b5bae2e38815c0: Status 404 returned error can't find the container with id 08170d65a3e0b41b6fc0eb66aec603e37b22669ff6ae6c1101b5bae2e38815c0 Jul 07 15:40:45.587055 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:45.586986 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ccfca5_b744_4fdd_a95d_7da77f0be2a1.slice/crio-0e0316a6d46f838d485d831b01f71dafdba86036f3a8698c006f2dfaedfb7cb2 WatchSource:0}: Error finding container 0e0316a6d46f838d485d831b01f71dafdba86036f3a8698c006f2dfaedfb7cb2: Status 404 returned error can't find the container with id 0e0316a6d46f838d485d831b01f71dafdba86036f3a8698c006f2dfaedfb7cb2 Jul 07 15:40:45.588445 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:45.588337 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5904914_177d_4c1f_9be3_a3f3ef40c391.slice/crio-4ac6cbe21f69d73060d5775c607c9da3981246390aec63e859323052090da57c WatchSource:0}: Error finding container 4ac6cbe21f69d73060d5775c607c9da3981246390aec63e859323052090da57c: Status 404 returned error can't find the container with id 4ac6cbe21f69d73060d5775c607c9da3981246390aec63e859323052090da57c Jul 07 15:40:45.590107 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:45.590084 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867230a6_3253_4bf0_8427_191d66ebdcf3.slice/crio-51afa79c0d8276541f507fc4743c2e25638905be3361f76d7e68c31dad438501 WatchSource:0}: Error finding container 51afa79c0d8276541f507fc4743c2e25638905be3361f76d7e68c31dad438501: Status 404 returned error can't find the container with id 51afa79c0d8276541f507fc4743c2e25638905be3361f76d7e68c31dad438501 Jul 07 15:40:45.592905 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:45.592861 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadceffcc_f1d1_4820_9c62_80f1d029dc3a.slice/crio-0600471fd510432606fc34a66df3a0281b2a07a5060453549560320c43f04b1f WatchSource:0}: Error finding container 0600471fd510432606fc34a66df3a0281b2a07a5060453549560320c43f04b1f: Status 404 returned error can't find the container with id 0600471fd510432606fc34a66df3a0281b2a07a5060453549560320c43f04b1f Jul 07 15:40:45.593677 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:40:45.593538 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5253cd9_19e7_49d4_aaa6_5885489984fa.slice/crio-9611f5749cce9211ddd34dce26a676f476f3ad037d505ce2b4e30008c994e058 WatchSource:0}: Error finding container 9611f5749cce9211ddd34dce26a676f476f3ad037d505ce2b4e30008c994e058: Status 404 returned error can't find the container with id 9611f5749cce9211ddd34dce26a676f476f3ad037d505ce2b4e30008c994e058 Jul 07 15:40:45.861703 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:45.861672 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs\") pod \"network-metrics-daemon-nsxgh\" (UID: \"867e35ee-0f3c-4d9f-8485-b3b5d60790cc\") " pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:40:45.861892 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:45.861846 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:40:45.862030 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:45.861935 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs podName:867e35ee-0f3c-4d9f-8485-b3b5d60790cc nodeName:}" failed. No retries permitted until 2026-07-07 15:40:47.861914763 +0000 UTC m=+6.011775270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs") pod "network-metrics-daemon-nsxgh" (UID: "867e35ee-0f3c-4d9f-8485-b3b5d60790cc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:40:45.963214 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:45.963108 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret\") pod \"global-pull-secret-syncer-4q4t9\" (UID: \"bd011bd6-abd7-4719-add3-7ba16ed962df\") " pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:45.963214 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:45.963161 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2fc\" (UniqueName: \"kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc\") pod \"network-check-target-hppz7\" (UID: \"44176831-53af-4b36-aaeb-1b05e789dc01\") " pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:40:45.963454 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:45.963274 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:40:45.963454 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:45.963318 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:40:45.963454 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:45.963339 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:40:45.963454 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:45.963344 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret podName:bd011bd6-abd7-4719-add3-7ba16ed962df nodeName:}" failed. No retries permitted until 2026-07-07 15:40:47.963327873 +0000 UTC m=+6.113188359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret") pod "global-pull-secret-syncer-4q4t9" (UID: "bd011bd6-abd7-4719-add3-7ba16ed962df") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:40:45.963454 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:45.963352 2572 projected.go:196] Error preparing data for projected volume kube-api-access-gr2fc for pod openshift-network-diagnostics/network-check-target-hppz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:40:45.963454 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:45.963406 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc podName:44176831-53af-4b36-aaeb-1b05e789dc01 nodeName:}" failed. No retries permitted until 2026-07-07 15:40:47.963388775 +0000 UTC m=+6.113249279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gr2fc" (UniqueName: "kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc") pod "network-check-target-hppz7" (UID: "44176831-53af-4b36-aaeb-1b05e789dc01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:40:46.342102 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:46.341996 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 15:35:44 +0000 UTC" deadline="2028-04-13 00:47:42.901154506 +0000 UTC" Jul 07 15:40:46.342102 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:46.342045 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15489h6m56.559114129s" Jul 07 15:40:46.371240 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:46.371204 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:40:46.371411 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:46.371365 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:40:46.371812 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:46.371781 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:40:46.371919 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:46.371879 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:40:46.392497 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:46.392407 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" event={"ID":"0741b689-975b-467a-9288-53cd119c0791","Type":"ContainerStarted","Data":"08170d65a3e0b41b6fc0eb66aec603e37b22669ff6ae6c1101b5bae2e38815c0"} Jul 07 15:40:46.394422 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:46.394388 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q8srj" event={"ID":"8ed969f9-3b82-4f68-9c80-c173622b368e","Type":"ContainerStarted","Data":"f90bca464ed23b394d1dce22bb473109c8920ebf474c6290664606de206b8535"} Jul 07 15:40:46.397269 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:46.397213 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-64.ec2.internal" event={"ID":"929bfad889b023d7ee3168f8319c1420","Type":"ContainerStarted","Data":"33509b27a27acc22a6cd071900de64beb35e4ace304811ee7c5b55ad305781b4"} Jul 07 15:40:46.417534 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:46.416738 2572 generic.go:356] "Generic (PLEG): container finished" podID="ebdd5e05e05144f286c0cddaebd117a9" containerID="ce0d18017e9bcdad00fe00a376829efbbc24a3d2a487cc328163eb1415fef6fc" exitCode=0 Jul 07 15:40:46.417534 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:46.416825 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal" event={"ID":"ebdd5e05e05144f286c0cddaebd117a9","Type":"ContainerDied","Data":"ce0d18017e9bcdad00fe00a376829efbbc24a3d2a487cc328163eb1415fef6fc"} Jul 07 15:40:46.421983 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:46.421898 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gc7w8" event={"ID":"e5253cd9-19e7-49d4-aaa6-5885489984fa","Type":"ContainerStarted","Data":"9611f5749cce9211ddd34dce26a676f476f3ad037d505ce2b4e30008c994e058"} Jul 07 15:40:46.429090 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:46.429052 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" event={"ID":"867230a6-3253-4bf0-8427-191d66ebdcf3","Type":"ContainerStarted","Data":"51afa79c0d8276541f507fc4743c2e25638905be3361f76d7e68c31dad438501"} Jul 07 15:40:46.431487 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:46.431453 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5nrjp" event={"ID":"708dd8c4-5687-42c0-b485-ec5cd5e0c8cd","Type":"ContainerStarted","Data":"b0980667946e129dbf5e15aa1cc512b7d6af67f0cd61bdd4798b8edade311295"} Jul 07 15:40:46.437539 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:46.437512 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qvp4" event={"ID":"08005bdf-60d5-48a3-91b2-21181c3ae482","Type":"ContainerStarted","Data":"25e268d2a4afc9f1c571b8ef8d816c2b8e6347847b6b3d49a27893da59a982f2"} Jul 07 15:40:46.448050 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:46.447980 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-64.ec2.internal" podStartSLOduration=2.447957938 podStartE2EDuration="2.447957938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:40:46.427646133 +0000 UTC m=+4.577506644" watchObservedRunningTime="2026-07-07 15:40:46.447957938 +0000 UTC m=+4.597818449" Jul 07 15:40:46.449421 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:46.449389 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" event={"ID":"adceffcc-f1d1-4820-9c62-80f1d029dc3a","Type":"ContainerStarted","Data":"0600471fd510432606fc34a66df3a0281b2a07a5060453549560320c43f04b1f"} Jul 07 15:40:46.468083 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:46.468044 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c28px" event={"ID":"14ccfca5-b744-4fdd-a95d-7da77f0be2a1","Type":"ContainerStarted","Data":"0e0316a6d46f838d485d831b01f71dafdba86036f3a8698c006f2dfaedfb7cb2"} Jul 07 15:40:46.489906 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:46.489190 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9m9rt" event={"ID":"b5904914-177d-4c1f-9be3-a3f3ef40c391","Type":"ContainerStarted","Data":"4ac6cbe21f69d73060d5775c607c9da3981246390aec63e859323052090da57c"} Jul 07 15:40:47.372234 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:47.372199 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:47.372802 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:47.372337 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:40:47.513574 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:47.513531 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal" event={"ID":"ebdd5e05e05144f286c0cddaebd117a9","Type":"ContainerStarted","Data":"f0c86eadccf26ef3690c03fe93e96cbd38a0713219c11f4b77c3bcba0156941b"} Jul 07 15:40:47.901394 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:47.901344 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs\") pod \"network-metrics-daemon-nsxgh\" (UID: \"867e35ee-0f3c-4d9f-8485-b3b5d60790cc\") " pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:40:47.901591 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:47.901520 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:40:47.901683 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:47.901593 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs podName:867e35ee-0f3c-4d9f-8485-b3b5d60790cc nodeName:}" failed. No retries permitted until 2026-07-07 15:40:51.901570335 +0000 UTC m=+10.051430843 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs") pod "network-metrics-daemon-nsxgh" (UID: "867e35ee-0f3c-4d9f-8485-b3b5d60790cc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:40:48.002094 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:48.002053 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret\") pod \"global-pull-secret-syncer-4q4t9\" (UID: \"bd011bd6-abd7-4719-add3-7ba16ed962df\") " pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:48.002272 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:48.002114 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2fc\" (UniqueName: \"kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc\") pod \"network-check-target-hppz7\" (UID: \"44176831-53af-4b36-aaeb-1b05e789dc01\") " pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:40:48.002351 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:48.002275 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:40:48.002351 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:48.002297 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:40:48.002351 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:48.002312 2572 projected.go:196] Error preparing data for projected volume kube-api-access-gr2fc for pod openshift-network-diagnostics/network-check-target-hppz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:40:48.002506 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:48.002377 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc podName:44176831-53af-4b36-aaeb-1b05e789dc01 nodeName:}" failed. No retries permitted until 2026-07-07 15:40:52.002357301 +0000 UTC m=+10.152217809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gr2fc" (UniqueName: "kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc") pod "network-check-target-hppz7" (UID: "44176831-53af-4b36-aaeb-1b05e789dc01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:40:48.002836 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:48.002813 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:40:48.002984 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:48.002882 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret podName:bd011bd6-abd7-4719-add3-7ba16ed962df nodeName:}" failed. No retries permitted until 2026-07-07 15:40:52.002861483 +0000 UTC m=+10.152721968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret") pod "global-pull-secret-syncer-4q4t9" (UID: "bd011bd6-abd7-4719-add3-7ba16ed962df") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:40:48.374810 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:48.371523 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:40:48.374810 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:48.371657 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:40:48.374810 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:48.372094 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:40:48.374810 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:48.372209 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:40:49.371497 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:49.371449 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:49.371685 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:49.371590 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:40:50.376200 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:50.375722 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:40:50.376200 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:50.375824 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:40:50.376200 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:50.375999 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:40:50.376200 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:50.376083 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:40:51.371729 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:51.371685 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:51.371920 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:51.371817 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:40:51.939166 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:51.939092 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs\") pod \"network-metrics-daemon-nsxgh\" (UID: \"867e35ee-0f3c-4d9f-8485-b3b5d60790cc\") " pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:40:51.939656 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:51.939283 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:40:51.939656 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:51.939374 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs podName:867e35ee-0f3c-4d9f-8485-b3b5d60790cc nodeName:}" failed. No retries permitted until 2026-07-07 15:40:59.939351541 +0000 UTC m=+18.089212040 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs") pod "network-metrics-daemon-nsxgh" (UID: "867e35ee-0f3c-4d9f-8485-b3b5d60790cc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:40:52.040563 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:52.040519 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret\") pod \"global-pull-secret-syncer-4q4t9\" (UID: \"bd011bd6-abd7-4719-add3-7ba16ed962df\") " pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:52.040747 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:52.040591 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2fc\" (UniqueName: \"kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc\") pod \"network-check-target-hppz7\" (UID: \"44176831-53af-4b36-aaeb-1b05e789dc01\") " pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:40:52.040810 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:52.040791 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:40:52.040951 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:52.040936 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret podName:bd011bd6-abd7-4719-add3-7ba16ed962df nodeName:}" failed. No retries permitted until 2026-07-07 15:41:00.040910893 +0000 UTC m=+18.190771383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret") pod "global-pull-secret-syncer-4q4t9" (UID: "bd011bd6-abd7-4719-add3-7ba16ed962df") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:40:52.041057 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:52.041042 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:40:52.041114 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:52.041060 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:40:52.041114 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:52.041073 2572 projected.go:196] Error preparing data for projected volume kube-api-access-gr2fc for pod openshift-network-diagnostics/network-check-target-hppz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:40:52.041208 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:52.041119 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc podName:44176831-53af-4b36-aaeb-1b05e789dc01 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:00.041104648 +0000 UTC m=+18.190965138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gr2fc" (UniqueName: "kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc") pod "network-check-target-hppz7" (UID: "44176831-53af-4b36-aaeb-1b05e789dc01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:40:52.372212 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:52.372175 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:40:52.372392 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:52.372269 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:40:52.372615 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:52.372600 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:40:52.372698 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:52.372684 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:40:53.371260 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:53.371226 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:53.371706 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:53.371400 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:40:54.372781 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:54.372746 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:40:54.373227 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:54.373019 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:40:54.373227 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:54.373138 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:40:54.373464 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:54.373437 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:40:55.371271 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:55.371239 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:55.371434 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:55.371350 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:40:56.371766 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:56.371726 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:40:56.372229 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:56.371894 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:40:56.372229 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:56.371892 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:40:56.372229 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:56.372007 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:40:57.372030 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:57.371993 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:57.372441 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:57.372169 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:40:58.374693 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:58.374664 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:40:58.375177 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:58.374674 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:40:58.375177 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:58.374788 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:40:58.375177 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:58.374891 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:40:59.371343 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:40:59.371306 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:40:59.371518 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:40:59.371414 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:00.004981 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:00.004940 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs\") pod \"network-metrics-daemon-nsxgh\" (UID: \"867e35ee-0f3c-4d9f-8485-b3b5d60790cc\") " pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:00.005402 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:00.005102 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:41:00.005402 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:00.005185 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs podName:867e35ee-0f3c-4d9f-8485-b3b5d60790cc nodeName:}" failed. No retries permitted until 2026-07-07 15:41:16.005164755 +0000 UTC m=+34.155025242 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs") pod "network-metrics-daemon-nsxgh" (UID: "867e35ee-0f3c-4d9f-8485-b3b5d60790cc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:41:00.106185 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:00.105843 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret\") pod \"global-pull-secret-syncer-4q4t9\" (UID: \"bd011bd6-abd7-4719-add3-7ba16ed962df\") " pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:00.106185 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:00.105931 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2fc\" (UniqueName: \"kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc\") pod \"network-check-target-hppz7\" (UID: \"44176831-53af-4b36-aaeb-1b05e789dc01\") " pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:00.106185 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:00.105984 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:41:00.106185 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:00.106059 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret podName:bd011bd6-abd7-4719-add3-7ba16ed962df nodeName:}" failed. No retries permitted until 2026-07-07 15:41:16.106042251 +0000 UTC m=+34.255902738 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret") pod "global-pull-secret-syncer-4q4t9" (UID: "bd011bd6-abd7-4719-add3-7ba16ed962df") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:41:00.106185 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:00.106079 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:41:00.106185 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:00.106095 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:41:00.106185 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:00.106107 2572 projected.go:196] Error preparing data for projected volume kube-api-access-gr2fc for pod openshift-network-diagnostics/network-check-target-hppz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:41:00.106185 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:00.106155 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc podName:44176831-53af-4b36-aaeb-1b05e789dc01 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:16.106139382 +0000 UTC m=+34.255999867 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gr2fc" (UniqueName: "kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc") pod "network-check-target-hppz7" (UID: "44176831-53af-4b36-aaeb-1b05e789dc01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:41:00.371749 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:00.371710 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:00.371749 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:00.371738 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:00.371981 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:00.371874 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:00.371981 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:00.371934 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:01.371492 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:01.371463 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:01.371957 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:01.371572 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:02.375325 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:02.375276 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:02.375766 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:02.375410 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:02.375766 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:02.375455 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:02.375766 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:02.375540 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:03.372345 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:03.371794 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:03.372345 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:03.371948 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:04.372998 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:04.372966 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:04.373648 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:04.373085 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:04.373648 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:04.373135 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:04.373648 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:04.373243 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:05.372470 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.371686 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:05.372470 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:05.372052 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:05.565876 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.565668 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" event={"ID":"adceffcc-f1d1-4820-9c62-80f1d029dc3a","Type":"ContainerStarted","Data":"2c03c8d0c0af4ba14f7f12e262c2f0508bc8ff9cb58897132cbb9ddeb0644ca8"} Jul 07 15:41:05.565876 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.565804 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" event={"ID":"adceffcc-f1d1-4820-9c62-80f1d029dc3a","Type":"ContainerStarted","Data":"80c476c2b7849ed96017d3c8b81182fedfa3d9b5aa03d97be2542d9f7a48c9b1"} Jul 07 15:41:05.567241 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.567209 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c28px" event={"ID":"14ccfca5-b744-4fdd-a95d-7da77f0be2a1","Type":"ContainerStarted","Data":"7412d0705427e84fbaaa86710c815478d0d922a19c825a46d85beeda9e7aec5a"} Jul 07 15:41:05.569607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.569582 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9m9rt" event={"ID":"b5904914-177d-4c1f-9be3-a3f3ef40c391","Type":"ContainerStarted","Data":"2255fad58af2296fff299662991cd7a2711bbd6285282cf141014ec76106a732"} Jul 07 15:41:05.571251 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.571224 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" event={"ID":"0741b689-975b-467a-9288-53cd119c0791","Type":"ContainerStarted","Data":"8e9eed17c18f73ee2b85e888d3f6cb6f18a76b0d0be116c19b48c13b65bd85fa"} Jul 07 15:41:05.573720 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.573656 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gc7w8" event={"ID":"e5253cd9-19e7-49d4-aaa6-5885489984fa","Type":"ContainerStarted","Data":"a897ed708abda654dd5ea7a7c2aedb199a18b8e27469d73b67b0487c80f78755"} Jul 07 15:41:05.575088 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.575067 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" event={"ID":"867230a6-3253-4bf0-8427-191d66ebdcf3","Type":"ContainerStarted","Data":"d12290a9e24c0f78876539fe4c70bf6ece114ccead90ddc6906d3ae55f2be031"} Jul 07 15:41:05.576455 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.576433 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5nrjp" event={"ID":"708dd8c4-5687-42c0-b485-ec5cd5e0c8cd","Type":"ContainerStarted","Data":"1ea6ad9454d2ef13ea489e164d9fafeb13690dbbc85511395e2c466f23941a10"} Jul 07 15:41:05.577942 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.577921 2572 generic.go:356] "Generic (PLEG): container finished" podID="08005bdf-60d5-48a3-91b2-21181c3ae482" containerID="41ea4278eff81efd57674e8e4a6a6be0765a276452032c54665f773faa23e1d2" exitCode=0 Jul 07 15:41:05.578016 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.577948 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qvp4" event={"ID":"08005bdf-60d5-48a3-91b2-21181c3ae482","Type":"ContainerDied","Data":"41ea4278eff81efd57674e8e4a6a6be0765a276452032c54665f773faa23e1d2"} Jul 07 15:41:05.588147 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.588087 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-64.ec2.internal" podStartSLOduration=21.588067352 podStartE2EDuration="21.588067352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:40:47.534619116 +0000 UTC m=+5.684479626" watchObservedRunningTime="2026-07-07 15:41:05.588067352 +0000 UTC m=+23.737927860" Jul 07 15:41:05.589103 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.589066 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-c28px" podStartSLOduration=2.983130621 podStartE2EDuration="22.589052992s" totalImagesPullingTime="19.605922371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:05.587981009 +0000 UTC m=+23.737841526" watchObservedRunningTime="2026-07-07 15:41:05.589052992 +0000 UTC m=+23.738913499" Jul 07 15:41:05.609868 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.609799 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9m9rt" podStartSLOduration=3.075649966 podStartE2EDuration="22.609783595s" totalImagesPullingTime="19.534133629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:05.609432345 +0000 UTC m=+23.759292848" watchObservedRunningTime="2026-07-07 15:41:05.609783595 +0000 UTC m=+23.759644100" Jul 07 15:41:05.650941 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.650889 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5nrjp" podStartSLOduration=3.084062621 podStartE2EDuration="22.650867685s" totalImagesPullingTime="19.566805064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:05.650829113 +0000 UTC m=+23.800689620" watchObservedRunningTime="2026-07-07 15:41:05.650867685 +0000 UTC m=+23.800728187" Jul 07 15:41:05.651230 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.651191 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bxjmc" podStartSLOduration=3.087309643 podStartE2EDuration="22.651176155s" totalImagesPullingTime="19.563866512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:05.635592709 +0000 UTC m=+23.785453217" watchObservedRunningTime="2026-07-07 15:41:05.651176155 +0000 UTC m=+23.801036661" Jul 07 15:41:05.688983 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.688809 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gc7w8_e5253cd9-19e7-49d4-aaa6-5885489984fa/node-ca/0.log" Jul 07 15:41:05.701946 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.701903 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gc7w8" podStartSLOduration=3.144312877 podStartE2EDuration="22.701888431s" totalImagesPullingTime="19.557575554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:05.701539183 +0000 UTC m=+23.851399690" watchObservedRunningTime="2026-07-07 15:41:05.701888431 +0000 UTC m=+23.851748937" Jul 07 15:41:05.724818 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.724790 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:05.809075 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.809051 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:05.984413 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:05.984314 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:06.083974 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:06.083940 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:06.224307 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:06.224274 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5nrjp" Jul 07 15:41:06.224826 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:06.224811 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5nrjp" Jul 07 15:41:06.371290 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:06.371263 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:06.371474 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:06.371265 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:06.371474 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:06.371416 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:06.371474 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:06.371463 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:06.399533 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:06.399506 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:06.554608 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:06.554584 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 15:41:06.584403 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:06.584365 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 15:41:06.584960 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:06.584741 2572 generic.go:356] "Generic (PLEG): container finished" podID="adceffcc-f1d1-4820-9c62-80f1d029dc3a" containerID="2c03c8d0c0af4ba14f7f12e262c2f0508bc8ff9cb58897132cbb9ddeb0644ca8" exitCode=1 Jul 07 15:41:06.584960 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:06.584810 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" event={"ID":"adceffcc-f1d1-4820-9c62-80f1d029dc3a","Type":"ContainerDied","Data":"2c03c8d0c0af4ba14f7f12e262c2f0508bc8ff9cb58897132cbb9ddeb0644ca8"} Jul 07 15:41:06.584960 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:06.584945 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" event={"ID":"adceffcc-f1d1-4820-9c62-80f1d029dc3a","Type":"ContainerStarted","Data":"c034986b5cc58e541ca29d4585b254ec95133816bff04dbb292c8fbb121885e6"} Jul 07 15:41:06.585102 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:06.584986 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" event={"ID":"adceffcc-f1d1-4820-9c62-80f1d029dc3a","Type":"ContainerStarted","Data":"9d69b7393245d5bf9a33219537b11712f15c0b7555cca48ac0c064096895aa13"} Jul 07 15:41:06.585102 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:06.585015 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" event={"ID":"adceffcc-f1d1-4820-9c62-80f1d029dc3a","Type":"ContainerStarted","Data":"404f4417e75b38fded9b3b5b3fad3ca0544659ddd0b2dbfce71b1130b1e92df1"} Jul 07 15:41:06.585102 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:06.585057 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" event={"ID":"adceffcc-f1d1-4820-9c62-80f1d029dc3a","Type":"ContainerStarted","Data":"6738cd54f625c9d0e420f7ef65b25602c93264ea54252e2f67ce50edf3c3a6c9"} Jul 07 15:41:06.586893 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:06.586868 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" event={"ID":"0741b689-975b-467a-9288-53cd119c0791","Type":"ContainerStarted","Data":"326f01c75becc72b88dfc05672904a16408e533d1acf177f6c55d64f3dd94cbd"} Jul 07 15:41:06.587065 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:06.587045 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5nrjp" Jul 07 15:41:06.587648 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:06.587628 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5nrjp" Jul 07 15:41:07.302233 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:07.302124 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T15:41:06.5546042Z","UUID":"0a1e061d-60d9-4cb4-9a2b-2801d444b135","Handler":null,"Name":"","Endpoint":""} Jul 07 15:41:07.306073 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:07.306045 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 15:41:07.306210 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:07.306091 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 15:41:07.371726 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:07.371700 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:07.371925 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:07.371826 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:07.408917 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:07.408881 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:07.591364 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:07.591324 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" event={"ID":"0741b689-975b-467a-9288-53cd119c0791","Type":"ContainerStarted","Data":"78dac432b51407aeea26c763eb59bffdc73c95d99d06045d6036364eedc2e74e"} Jul 07 15:41:07.593367 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:07.593329 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q8srj" event={"ID":"8ed969f9-3b82-4f68-9c80-c173622b368e","Type":"ContainerStarted","Data":"d466b74fb913d99f035c27659d8907ee5acaaeb8bbf335ff7f77a5e78ce31628"} Jul 07 15:41:07.608700 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:07.608671 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:07.616143 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:07.616090 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9k8w9" podStartSLOduration=3.065134979 podStartE2EDuration="24.61607589s" totalImagesPullingTime="21.550940911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:40:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:07.61583972 +0000 UTC m=+25.765700226" watchObservedRunningTime="2026-07-07 15:41:07.61607589 +0000 UTC m=+25.765936397" Jul 07 15:41:07.636222 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:07.636163 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q8srj" podStartSLOduration=5.067586734 podStartE2EDuration="24.636141038s" totalImagesPullingTime="19.568554304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:07.635272315 +0000 UTC m=+25.785132822" watchObservedRunningTime="2026-07-07 15:41:07.636141038 +0000 UTC m=+25.786001547" Jul 07 15:41:07.704980 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:07.704939 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:07.770131 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:07.770101 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:08.171917 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:08.171660 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:08.305972 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:08.305939 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:08.371232 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:08.371201 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:08.371410 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:08.371345 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:08.371410 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:08.371401 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:08.371548 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:08.371525 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:08.598763 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:08.598683 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 15:41:08.599198 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:08.599154 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" event={"ID":"adceffcc-f1d1-4820-9c62-80f1d029dc3a","Type":"ContainerStarted","Data":"676a6ce573591ef14ca7edb45f8ee49cf5e9d7b975aac436eeafab212f7b5703"} Jul 07 15:41:08.707781 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:08.707738 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:09.197263 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:09.197230 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:09.372003 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:09.371964 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:09.372163 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:09.372091 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:09.377487 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:09.377461 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:09.713805 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:09.713777 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:10.126011 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:10.125847 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:10.207302 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:10.207272 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:10.306374 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:10.306272 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:10.371588 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:10.371557 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:10.371694 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:10.371558 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:10.371742 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:10.371704 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:10.371810 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:10.371753 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:10.526230 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:10.526198 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:10.605785 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:10.605689 2572 generic.go:356] "Generic (PLEG): container finished" podID="08005bdf-60d5-48a3-91b2-21181c3ae482" containerID="7486d88256e63740a7d152083a74644046f4b6c91d11704b270187fc4aac6c14" exitCode=0 Jul 07 15:41:10.605977 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:10.605775 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qvp4" event={"ID":"08005bdf-60d5-48a3-91b2-21181c3ae482","Type":"ContainerDied","Data":"7486d88256e63740a7d152083a74644046f4b6c91d11704b270187fc4aac6c14"} Jul 07 15:41:10.609118 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:10.609098 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 15:41:10.609443 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:10.609419 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" event={"ID":"adceffcc-f1d1-4820-9c62-80f1d029dc3a","Type":"ContainerStarted","Data":"2ef115884df0f8de053d1071227a1ea4a8f45253356890c344630ccf697a97bb"} Jul 07 15:41:10.609762 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:10.609745 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:41:10.609898 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:10.609882 2572 scope.go:117] "RemoveContainer" containerID="2c03c8d0c0af4ba14f7f12e262c2f0508bc8ff9cb58897132cbb9ddeb0644ca8" Jul 07 15:41:10.609982 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:10.609884 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:41:10.610098 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:10.610033 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:41:10.628068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:10.628020 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:41:10.628184 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:10.628170 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:41:10.700595 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:10.700564 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:11.107435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:11.107395 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:11.165295 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:11.165260 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:11.371713 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:11.371681 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:11.371896 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:11.371815 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:11.420348 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:11.420318 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:11.521683 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:11.521642 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:11.613442 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:11.613408 2572 generic.go:356] "Generic (PLEG): container finished" podID="08005bdf-60d5-48a3-91b2-21181c3ae482" containerID="f3a66d35548ae9d6a2fec1dec837bfc3a8ad97387e8be1eabb5600e81d6515b9" exitCode=0 Jul 07 15:41:11.613606 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:11.613493 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qvp4" event={"ID":"08005bdf-60d5-48a3-91b2-21181c3ae482","Type":"ContainerDied","Data":"f3a66d35548ae9d6a2fec1dec837bfc3a8ad97387e8be1eabb5600e81d6515b9"} Jul 07 15:41:11.617255 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:11.617236 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 15:41:11.617589 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:11.617567 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" event={"ID":"adceffcc-f1d1-4820-9c62-80f1d029dc3a","Type":"ContainerStarted","Data":"f172aef3d6b99fb110714934aa3c23a2000a87b34495719e3501fbc319a876dc"} Jul 07 15:41:12.106415 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:12.106374 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:12.207471 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:12.207436 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:12.372406 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:12.372374 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:12.372561 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:12.372475 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:12.372561 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:12.372542 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:12.372684 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:12.372652 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:12.511445 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:12.511404 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:12.622513 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:12.622440 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qvp4" event={"ID":"08005bdf-60d5-48a3-91b2-21181c3ae482","Type":"ContainerStarted","Data":"3e9b20740f932c908a22beb6f04cd50991d03be9e311bc7dcdb96ca4e46b57c3"} Jul 07 15:41:12.648135 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:12.648084 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" podStartSLOduration=10.069724265 podStartE2EDuration="29.648068605s" totalImagesPullingTime="19.57834434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:11.671437257 +0000 UTC m=+29.821297762" watchObservedRunningTime="2026-07-07 15:41:12.648068605 +0000 UTC m=+30.797929110" Jul 07 15:41:12.906356 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:12.906266 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:13.101508 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:13.101473 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:13.372188 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:13.372158 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:13.372549 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:13.372257 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:13.626538 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:13.626451 2572 generic.go:356] "Generic (PLEG): container finished" podID="08005bdf-60d5-48a3-91b2-21181c3ae482" containerID="3e9b20740f932c908a22beb6f04cd50991d03be9e311bc7dcdb96ca4e46b57c3" exitCode=0 Jul 07 15:41:13.626538 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:13.626497 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qvp4" event={"ID":"08005bdf-60d5-48a3-91b2-21181c3ae482","Type":"ContainerDied","Data":"3e9b20740f932c908a22beb6f04cd50991d03be9e311bc7dcdb96ca4e46b57c3"} Jul 07 15:41:13.706594 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:13.706568 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:13.757246 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:13.757217 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:14.371895 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:14.371846 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:14.371895 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:14.371883 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:14.372147 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:14.371995 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:14.372147 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:14.372125 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:14.373567 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:14.373541 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:14.502470 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:14.502435 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:14.903588 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:14.903532 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:15.104035 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:15.104003 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:15.371607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:15.371569 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:15.371813 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:15.371695 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:15.721243 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:15.721161 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:16.029373 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:16.029290 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs\") pod \"network-metrics-daemon-nsxgh\" (UID: \"867e35ee-0f3c-4d9f-8485-b3b5d60790cc\") " pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:16.029522 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:16.029437 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:41:16.029522 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:16.029499 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs podName:867e35ee-0f3c-4d9f-8485-b3b5d60790cc nodeName:}" failed. No retries permitted until 2026-07-07 15:41:48.029480286 +0000 UTC m=+66.179340772 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs") pod "network-metrics-daemon-nsxgh" (UID: "867e35ee-0f3c-4d9f-8485-b3b5d60790cc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:41:16.106640 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:16.106602 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:16.129813 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:16.129771 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret\") pod \"global-pull-secret-syncer-4q4t9\" (UID: \"bd011bd6-abd7-4719-add3-7ba16ed962df\") " pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:16.129984 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:16.129833 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2fc\" (UniqueName: \"kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc\") pod \"network-check-target-hppz7\" (UID: \"44176831-53af-4b36-aaeb-1b05e789dc01\") " pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:16.129984 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:16.129941 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:41:16.130093 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:16.130010 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:41:16.130093 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:16.130017 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret podName:bd011bd6-abd7-4719-add3-7ba16ed962df nodeName:}" failed. No retries permitted until 2026-07-07 15:41:48.129999818 +0000 UTC m=+66.279860301 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret") pod "global-pull-secret-syncer-4q4t9" (UID: "bd011bd6-abd7-4719-add3-7ba16ed962df") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:41:16.130093 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:16.130028 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:41:16.130093 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:16.130041 2572 projected.go:196] Error preparing data for projected volume kube-api-access-gr2fc for pod openshift-network-diagnostics/network-check-target-hppz7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:41:16.130093 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:16.130091 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc podName:44176831-53af-4b36-aaeb-1b05e789dc01 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:48.13007549 +0000 UTC m=+66.279935980 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gr2fc" (UniqueName: "kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc") pod "network-check-target-hppz7" (UID: "44176831-53af-4b36-aaeb-1b05e789dc01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:41:16.318815 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:16.318711 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:16.371896 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:16.371862 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:16.372065 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:16.371870 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:16.372065 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:16.371992 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:16.372065 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:16.372043 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:16.700775 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:16.700593 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:17.074645 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:17.074555 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:17.144654 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:17.144618 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:17.210341 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:17.210304 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:17.371394 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:17.371364 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:17.371576 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:17.371497 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:17.516112 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:17.516083 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:17.716018 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:17.715934 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:17.909480 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:17.909436 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:18.115472 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:18.115378 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:18.371646 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:18.371607 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:18.371829 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:18.371721 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:18.371829 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:18.371782 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:18.371972 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:18.371926 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:18.642254 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:18.642178 2572 generic.go:356] "Generic (PLEG): container finished" podID="08005bdf-60d5-48a3-91b2-21181c3ae482" containerID="4b3fab1c68b7ea6938db9bc97f6b8d1418b8c7d199e3676ea2f16a842aa779d5" exitCode=0 Jul 07 15:41:18.642403 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:18.642250 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qvp4" event={"ID":"08005bdf-60d5-48a3-91b2-21181c3ae482","Type":"ContainerDied","Data":"4b3fab1c68b7ea6938db9bc97f6b8d1418b8c7d199e3676ea2f16a842aa779d5"} Jul 07 15:41:19.371279 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:19.371241 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:19.371661 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:19.371346 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:19.647347 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:19.647260 2572 generic.go:356] "Generic (PLEG): container finished" podID="08005bdf-60d5-48a3-91b2-21181c3ae482" containerID="f61e749305c14d7abaccdf51cb5a8f227f18ca9b682435fd3b2166744b21c35f" exitCode=0 Jul 07 15:41:19.647347 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:19.647301 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qvp4" event={"ID":"08005bdf-60d5-48a3-91b2-21181c3ae482","Type":"ContainerDied","Data":"f61e749305c14d7abaccdf51cb5a8f227f18ca9b682435fd3b2166744b21c35f"} Jul 07 15:41:20.371914 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:20.371876 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:20.372438 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:20.371876 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:20.372438 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:20.372017 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:20.372438 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:20.372061 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:20.652715 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:20.652632 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qvp4" event={"ID":"08005bdf-60d5-48a3-91b2-21181c3ae482","Type":"ContainerStarted","Data":"53b8b93ac852f3ba37881a91e5ab8bbe3b8434b5731f87b30883c35e48190bae"} Jul 07 15:41:20.678351 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:20.678297 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7qvp4" podStartSLOduration=7.55486367 podStartE2EDuration="37.678281764s" totalImagesPullingTime="30.123418094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:40:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:20.677739713 +0000 UTC m=+38.827600231" watchObservedRunningTime="2026-07-07 15:41:20.678281764 +0000 UTC m=+38.828142271" Jul 07 15:41:21.371257 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:21.371229 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:21.371468 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:21.371339 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:22.373174 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:22.373130 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:22.373601 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:22.373183 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:22.373601 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:22.373280 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:22.373601 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:22.373408 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:23.371628 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:23.371592 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:23.371791 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:23.371690 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:24.371537 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:24.371496 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:24.372023 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:24.371545 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:24.372023 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:24.371645 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:24.372023 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:24.371742 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:25.201594 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:25.201565 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:25.302389 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:25.302354 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:25.364424 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:25.364395 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:25.371576 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:25.371552 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:25.371932 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:25.371655 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:25.482987 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:25.482908 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:25.667263 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:25.667231 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:25.739055 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:25.738970 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:26.056818 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:26.056715 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:26.119456 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:26.119417 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:26.281628 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:26.281591 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:26.371194 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:26.371160 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:26.371346 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:26.371174 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:26.371346 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:26.371310 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:26.371414 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:26.371349 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:26.458366 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:26.458332 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:26.559780 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:26.559743 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:26.673396 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:26.673318 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:26.925614 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:26.925537 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:27.087833 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:27.087792 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:27.174477 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:27.174436 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:27.365412 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:27.365320 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:27.371519 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:27.371489 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:27.371692 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:27.371589 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:27.456825 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:27.456785 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:28.314764 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:28.314729 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:28.372231 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:28.372208 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:28.372374 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:28.372324 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:28.372434 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:28.372381 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:28.372508 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:28.372488 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:28.378573 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:28.378535 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:28.533003 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:28.532970 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hppz7"] Jul 07 15:41:28.535841 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:28.535816 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4q4t9"] Jul 07 15:41:28.535841 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:28.535949 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:28.536188 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:28.536077 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:28.536500 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:28.536477 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nsxgh"] Jul 07 15:41:28.668505 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:28.668473 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:28.668505 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:28.668511 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:28.668701 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:28.668602 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:28.668743 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:28.668723 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:30.371326 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:30.371148 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:30.371787 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:30.371145 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:30.371787 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:30.371434 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:30.371787 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:30.371472 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:30.371787 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:30.371148 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:30.371787 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:30.371567 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:32.074326 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:32.074293 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:32.178498 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:32.178463 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:32.281968 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:32.281934 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:32.372093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:32.372065 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:32.372282 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:32.372185 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:32.372282 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:32.372179 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q4t9" podUID="bd011bd6-abd7-4719-add3-7ba16ed962df" Jul 07 15:41:32.372282 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:32.372232 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:32.372450 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:32.372318 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hppz7" podUID="44176831-53af-4b36-aaeb-1b05e789dc01" Jul 07 15:41:32.372450 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:32.372370 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsxgh" podUID="867e35ee-0f3c-4d9f-8485-b3b5d60790cc" Jul 07 15:41:32.379695 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:32.379668 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:32.476475 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:32.476440 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:32.578193 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:32.578155 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:33.026029 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.025946 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:33.125660 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.125628 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:33.149675 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.149649 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-64.ec2.internal" event="NodeReady" Jul 07 15:41:33.149798 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.149777 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 15:41:33.203252 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.203218 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jwspw"] Jul 07 15:41:33.224657 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.224627 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sdr96"] Jul 07 15:41:33.224804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.224751 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwspw" Jul 07 15:41:33.227677 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.227640 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 15:41:33.227822 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.227755 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 15:41:33.227899 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.227822 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 15:41:33.227899 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.227869 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tqcfj\"" Jul 07 15:41:33.240583 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.240560 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jwspw"] Jul 07 15:41:33.240685 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.240598 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sdr96"] Jul 07 15:41:33.240685 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.240624 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dp7kf"] Jul 07 15:41:33.240685 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.240679 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sdr96" Jul 07 15:41:33.245176 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.245156 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 15:41:33.245312 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.245257 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 15:41:33.245510 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.245495 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tn46g\"" Jul 07 15:41:33.253295 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.253270 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6978f\" (UniqueName: \"kubernetes.io/projected/3b250d6f-7e56-4305-8bf6-f83934a23bfb-kube-api-access-6978f\") pod \"ingress-canary-jwspw\" (UID: \"3b250d6f-7e56-4305-8bf6-f83934a23bfb\") " pod="openshift-ingress-canary/ingress-canary-jwspw" Jul 07 15:41:33.253401 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.253336 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b250d6f-7e56-4305-8bf6-f83934a23bfb-cert\") pod \"ingress-canary-jwspw\" (UID: \"3b250d6f-7e56-4305-8bf6-f83934a23bfb\") " pod="openshift-ingress-canary/ingress-canary-jwspw" Jul 07 15:41:33.254711 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.254695 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dp7kf" Jul 07 15:41:33.265702 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.265683 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fwwjf\"" Jul 07 15:41:33.265998 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.265975 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 15:41:33.266164 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.266030 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 15:41:33.268379 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.268362 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 15:41:33.268887 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.268872 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 15:41:33.269379 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.269366 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dp7kf"] Jul 07 15:41:33.354551 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.354461 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hffl\" (UniqueName: \"kubernetes.io/projected/d13e7db2-e03e-43a4-98cb-2b5fcc7d7093-kube-api-access-8hffl\") pod \"dns-default-sdr96\" (UID: \"d13e7db2-e03e-43a4-98cb-2b5fcc7d7093\") " pod="openshift-dns/dns-default-sdr96" Jul 07 15:41:33.354551 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.354503 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b250d6f-7e56-4305-8bf6-f83934a23bfb-cert\") pod \"ingress-canary-jwspw\" (UID: \"3b250d6f-7e56-4305-8bf6-f83934a23bfb\") " pod="openshift-ingress-canary/ingress-canary-jwspw" Jul 07 15:41:33.354551 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.354524 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ac29432-252b-4c62-b411-6b3553b79e5c-crio-socket\") pod \"insights-runtime-extractor-dp7kf\" (UID: \"6ac29432-252b-4c62-b411-6b3553b79e5c\") " pod="openshift-insights/insights-runtime-extractor-dp7kf" Jul 07 15:41:33.354819 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.354578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6978f\" (UniqueName: \"kubernetes.io/projected/3b250d6f-7e56-4305-8bf6-f83934a23bfb-kube-api-access-6978f\") pod \"ingress-canary-jwspw\" (UID: \"3b250d6f-7e56-4305-8bf6-f83934a23bfb\") " pod="openshift-ingress-canary/ingress-canary-jwspw" Jul 07 15:41:33.354819 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.354603 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d13e7db2-e03e-43a4-98cb-2b5fcc7d7093-metrics-tls\") pod \"dns-default-sdr96\" (UID: \"d13e7db2-e03e-43a4-98cb-2b5fcc7d7093\") " pod="openshift-dns/dns-default-sdr96" Jul 07 15:41:33.354819 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.354622 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d13e7db2-e03e-43a4-98cb-2b5fcc7d7093-tmp-dir\") pod \"dns-default-sdr96\" (UID: \"d13e7db2-e03e-43a4-98cb-2b5fcc7d7093\") " pod="openshift-dns/dns-default-sdr96" Jul 07 15:41:33.354819 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.354643 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ac29432-252b-4c62-b411-6b3553b79e5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp7kf\" (UID: \"6ac29432-252b-4c62-b411-6b3553b79e5c\") " pod="openshift-insights/insights-runtime-extractor-dp7kf" Jul 07 15:41:33.354819 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.354669 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ac29432-252b-4c62-b411-6b3553b79e5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp7kf\" (UID: \"6ac29432-252b-4c62-b411-6b3553b79e5c\") " pod="openshift-insights/insights-runtime-extractor-dp7kf" Jul 07 15:41:33.354819 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.354704 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ac29432-252b-4c62-b411-6b3553b79e5c-data-volume\") pod \"insights-runtime-extractor-dp7kf\" (UID: \"6ac29432-252b-4c62-b411-6b3553b79e5c\") " pod="openshift-insights/insights-runtime-extractor-dp7kf" Jul 07 15:41:33.354819 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.354742 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d13e7db2-e03e-43a4-98cb-2b5fcc7d7093-config-volume\") pod \"dns-default-sdr96\" (UID: \"d13e7db2-e03e-43a4-98cb-2b5fcc7d7093\") " pod="openshift-dns/dns-default-sdr96" Jul 07 15:41:33.354819 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.354764 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjkp9\" (UniqueName: \"kubernetes.io/projected/6ac29432-252b-4c62-b411-6b3553b79e5c-kube-api-access-pjkp9\") pod \"insights-runtime-extractor-dp7kf\" (UID: \"6ac29432-252b-4c62-b411-6b3553b79e5c\") " pod="openshift-insights/insights-runtime-extractor-dp7kf" Jul 07 15:41:33.358936 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.358916 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b250d6f-7e56-4305-8bf6-f83934a23bfb-cert\") pod \"ingress-canary-jwspw\" (UID: \"3b250d6f-7e56-4305-8bf6-f83934a23bfb\") " pod="openshift-ingress-canary/ingress-canary-jwspw" Jul 07 15:41:33.367601 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.367574 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6978f\" (UniqueName: \"kubernetes.io/projected/3b250d6f-7e56-4305-8bf6-f83934a23bfb-kube-api-access-6978f\") pod \"ingress-canary-jwspw\" (UID: \"3b250d6f-7e56-4305-8bf6-f83934a23bfb\") " pod="openshift-ingress-canary/ingress-canary-jwspw" Jul 07 15:41:33.426426 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.426394 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:33.455668 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.455630 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ac29432-252b-4c62-b411-6b3553b79e5c-crio-socket\") pod \"insights-runtime-extractor-dp7kf\" (UID: \"6ac29432-252b-4c62-b411-6b3553b79e5c\") " pod="openshift-insights/insights-runtime-extractor-dp7kf" Jul 07 15:41:33.455820 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.455684 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d13e7db2-e03e-43a4-98cb-2b5fcc7d7093-metrics-tls\") pod \"dns-default-sdr96\" (UID: \"d13e7db2-e03e-43a4-98cb-2b5fcc7d7093\") " pod="openshift-dns/dns-default-sdr96" Jul 07 15:41:33.455885 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.455820 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d13e7db2-e03e-43a4-98cb-2b5fcc7d7093-tmp-dir\") pod \"dns-default-sdr96\" (UID: \"d13e7db2-e03e-43a4-98cb-2b5fcc7d7093\") " pod="openshift-dns/dns-default-sdr96" Jul 07 15:41:33.455885 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.455840 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ac29432-252b-4c62-b411-6b3553b79e5c-crio-socket\") pod \"insights-runtime-extractor-dp7kf\" (UID: \"6ac29432-252b-4c62-b411-6b3553b79e5c\") " pod="openshift-insights/insights-runtime-extractor-dp7kf" Jul 07 15:41:33.455885 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.455877 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ac29432-252b-4c62-b411-6b3553b79e5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp7kf\" (UID: \"6ac29432-252b-4c62-b411-6b3553b79e5c\") " pod="openshift-insights/insights-runtime-extractor-dp7kf" Jul 07 15:41:33.456029 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.455903 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ac29432-252b-4c62-b411-6b3553b79e5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp7kf\" (UID: \"6ac29432-252b-4c62-b411-6b3553b79e5c\") " pod="openshift-insights/insights-runtime-extractor-dp7kf" Jul 07 15:41:33.456029 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.455949 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ac29432-252b-4c62-b411-6b3553b79e5c-data-volume\") pod \"insights-runtime-extractor-dp7kf\" (UID: \"6ac29432-252b-4c62-b411-6b3553b79e5c\") " pod="openshift-insights/insights-runtime-extractor-dp7kf" Jul 07 15:41:33.456029 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.455992 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d13e7db2-e03e-43a4-98cb-2b5fcc7d7093-config-volume\") pod \"dns-default-sdr96\" (UID: \"d13e7db2-e03e-43a4-98cb-2b5fcc7d7093\") " pod="openshift-dns/dns-default-sdr96" Jul 07 15:41:33.456029 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.456014 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjkp9\" (UniqueName: \"kubernetes.io/projected/6ac29432-252b-4c62-b411-6b3553b79e5c-kube-api-access-pjkp9\") pod \"insights-runtime-extractor-dp7kf\" (UID: \"6ac29432-252b-4c62-b411-6b3553b79e5c\") " pod="openshift-insights/insights-runtime-extractor-dp7kf" Jul 07 15:41:33.456217 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.456055 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hffl\" (UniqueName: \"kubernetes.io/projected/d13e7db2-e03e-43a4-98cb-2b5fcc7d7093-kube-api-access-8hffl\") pod \"dns-default-sdr96\" (UID: \"d13e7db2-e03e-43a4-98cb-2b5fcc7d7093\") " pod="openshift-dns/dns-default-sdr96" Jul 07 15:41:33.456363 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.456332 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ac29432-252b-4c62-b411-6b3553b79e5c-data-volume\") pod \"insights-runtime-extractor-dp7kf\" (UID: \"6ac29432-252b-4c62-b411-6b3553b79e5c\") " pod="openshift-insights/insights-runtime-extractor-dp7kf" Jul 07 15:41:33.456480 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.456386 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d13e7db2-e03e-43a4-98cb-2b5fcc7d7093-tmp-dir\") pod \"dns-default-sdr96\" (UID: \"d13e7db2-e03e-43a4-98cb-2b5fcc7d7093\") " pod="openshift-dns/dns-default-sdr96" Jul 07 15:41:33.456612 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.456596 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ac29432-252b-4c62-b411-6b3553b79e5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp7kf\" (UID: \"6ac29432-252b-4c62-b411-6b3553b79e5c\") " pod="openshift-insights/insights-runtime-extractor-dp7kf" Jul 07 15:41:33.456881 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.456834 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d13e7db2-e03e-43a4-98cb-2b5fcc7d7093-config-volume\") pod \"dns-default-sdr96\" (UID: \"d13e7db2-e03e-43a4-98cb-2b5fcc7d7093\") " pod="openshift-dns/dns-default-sdr96" Jul 07 15:41:33.458330 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.458311 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d13e7db2-e03e-43a4-98cb-2b5fcc7d7093-metrics-tls\") pod \"dns-default-sdr96\" (UID: \"d13e7db2-e03e-43a4-98cb-2b5fcc7d7093\") " pod="openshift-dns/dns-default-sdr96" Jul 07 15:41:33.458389 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.458320 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ac29432-252b-4c62-b411-6b3553b79e5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp7kf\" (UID: \"6ac29432-252b-4c62-b411-6b3553b79e5c\") " pod="openshift-insights/insights-runtime-extractor-dp7kf" Jul 07 15:41:33.464311 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.464290 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hffl\" (UniqueName: \"kubernetes.io/projected/d13e7db2-e03e-43a4-98cb-2b5fcc7d7093-kube-api-access-8hffl\") pod \"dns-default-sdr96\" (UID: \"d13e7db2-e03e-43a4-98cb-2b5fcc7d7093\") " pod="openshift-dns/dns-default-sdr96" Jul 07 15:41:33.464431 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.464399 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjkp9\" (UniqueName: \"kubernetes.io/projected/6ac29432-252b-4c62-b411-6b3553b79e5c-kube-api-access-pjkp9\") pod \"insights-runtime-extractor-dp7kf\" (UID: \"6ac29432-252b-4c62-b411-6b3553b79e5c\") " pod="openshift-insights/insights-runtime-extractor-dp7kf" Jul 07 15:41:33.527541 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.527491 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:33.535508 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.535479 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwspw" Jul 07 15:41:33.551724 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.551691 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sdr96" Jul 07 15:41:33.562968 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.562940 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dp7kf" Jul 07 15:41:33.762119 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.762087 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jwspw"] Jul 07 15:41:33.765397 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.765374 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dp7kf"] Jul 07 15:41:33.766061 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:41:33.766036 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b250d6f_7e56_4305_8bf6_f83934a23bfb.slice/crio-b3e8a08c382d6a395d0537520cf02b9cdafac1fa6eb49170b4db60edd99a4886 WatchSource:0}: Error finding container b3e8a08c382d6a395d0537520cf02b9cdafac1fa6eb49170b4db60edd99a4886: Status 404 returned error can't find the container with id b3e8a08c382d6a395d0537520cf02b9cdafac1fa6eb49170b4db60edd99a4886 Jul 07 15:41:33.768824 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:41:33.768796 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ac29432_252b_4c62_b411_6b3553b79e5c.slice/crio-6185cf27b5464579f5b070ac0999049c30dd286eb3ade18340b1bc2247b58a3d WatchSource:0}: Error finding container 6185cf27b5464579f5b070ac0999049c30dd286eb3ade18340b1bc2247b58a3d: Status 404 returned error can't find the container with id 6185cf27b5464579f5b070ac0999049c30dd286eb3ade18340b1bc2247b58a3d Jul 07 15:41:33.773870 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:33.773833 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sdr96"] Jul 07 15:41:33.777150 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:41:33.777131 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd13e7db2_e03e_43a4_98cb_2b5fcc7d7093.slice/crio-d0ca377b21cdb8554318b0f33b558a8318e570387777d30794f01ca4eab80a8f WatchSource:0}: Error finding container d0ca377b21cdb8554318b0f33b558a8318e570387777d30794f01ca4eab80a8f: Status 404 returned error can't find the container with id d0ca377b21cdb8554318b0f33b558a8318e570387777d30794f01ca4eab80a8f Jul 07 15:41:34.372135 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:34.372092 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:34.374355 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:34.372094 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:34.374355 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:34.372105 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:34.376633 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:34.376609 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 15:41:34.376811 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:34.376787 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 15:41:34.376918 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:34.376870 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 15:41:34.377047 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:34.377019 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 15:41:34.377154 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:34.377071 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jh4tr\"" Jul 07 15:41:34.377154 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:34.377088 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v8g69\"" Jul 07 15:41:34.688084 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:34.688000 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sdr96" event={"ID":"d13e7db2-e03e-43a4-98cb-2b5fcc7d7093","Type":"ContainerStarted","Data":"d0ca377b21cdb8554318b0f33b558a8318e570387777d30794f01ca4eab80a8f"} Jul 07 15:41:34.689685 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:34.689655 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dp7kf" event={"ID":"6ac29432-252b-4c62-b411-6b3553b79e5c","Type":"ContainerStarted","Data":"6185cf27b5464579f5b070ac0999049c30dd286eb3ade18340b1bc2247b58a3d"} Jul 07 15:41:34.692621 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:34.692595 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jwspw" event={"ID":"3b250d6f-7e56-4305-8bf6-f83934a23bfb","Type":"ContainerStarted","Data":"b3e8a08c382d6a395d0537520cf02b9cdafac1fa6eb49170b4db60edd99a4886"} Jul 07 15:41:35.349428 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:35.349391 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:35.688484 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:35.688450 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:36.252023 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:36.251726 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:36.327070 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:36.327004 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:36.700259 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:36.700221 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sdr96" event={"ID":"d13e7db2-e03e-43a4-98cb-2b5fcc7d7093","Type":"ContainerStarted","Data":"99ce180a21d0db09eae74af15a5bef0aa4ac2b3f9bb5750a3ff8ba26fe05da71"} Jul 07 15:41:37.412615 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.412575 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:37.461920 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.461885 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-78vll"] Jul 07 15:41:37.464706 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.464685 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" Jul 07 15:41:37.468998 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.468549 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 07 15:41:37.468998 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.468606 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-84n96\"" Jul 07 15:41:37.468998 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.468631 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 07 15:41:37.468998 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.468661 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 15:41:37.468998 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.468723 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 15:41:37.468998 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.468798 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 15:41:37.479973 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.479882 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-78vll"] Jul 07 15:41:37.502090 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.502018 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:37.577039 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.577004 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:37.589094 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.589061 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dff34d1d-59de-45db-a8a6-9dc59064c147-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-78vll\" (UID: \"dff34d1d-59de-45db-a8a6-9dc59064c147\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" Jul 07 15:41:37.589094 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.589092 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dff34d1d-59de-45db-a8a6-9dc59064c147-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-78vll\" (UID: \"dff34d1d-59de-45db-a8a6-9dc59064c147\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" Jul 07 15:41:37.589324 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.589165 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6597\" (UniqueName: \"kubernetes.io/projected/dff34d1d-59de-45db-a8a6-9dc59064c147-kube-api-access-r6597\") pod \"prometheus-operator-567f7b8b7c-78vll\" (UID: \"dff34d1d-59de-45db-a8a6-9dc59064c147\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" Jul 07 15:41:37.589324 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.589197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dff34d1d-59de-45db-a8a6-9dc59064c147-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-78vll\" (UID: \"dff34d1d-59de-45db-a8a6-9dc59064c147\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" Jul 07 15:41:37.689729 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.689687 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dff34d1d-59de-45db-a8a6-9dc59064c147-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-78vll\" (UID: \"dff34d1d-59de-45db-a8a6-9dc59064c147\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" Jul 07 15:41:37.689729 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.689727 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dff34d1d-59de-45db-a8a6-9dc59064c147-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-78vll\" (UID: \"dff34d1d-59de-45db-a8a6-9dc59064c147\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" Jul 07 15:41:37.690037 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.689789 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6597\" (UniqueName: \"kubernetes.io/projected/dff34d1d-59de-45db-a8a6-9dc59064c147-kube-api-access-r6597\") pod \"prometheus-operator-567f7b8b7c-78vll\" (UID: \"dff34d1d-59de-45db-a8a6-9dc59064c147\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" Jul 07 15:41:37.690037 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.689822 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dff34d1d-59de-45db-a8a6-9dc59064c147-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-78vll\" (UID: \"dff34d1d-59de-45db-a8a6-9dc59064c147\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" Jul 07 15:41:37.690507 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.690482 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dff34d1d-59de-45db-a8a6-9dc59064c147-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-78vll\" (UID: \"dff34d1d-59de-45db-a8a6-9dc59064c147\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" Jul 07 15:41:37.693425 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.693403 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dff34d1d-59de-45db-a8a6-9dc59064c147-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-78vll\" (UID: \"dff34d1d-59de-45db-a8a6-9dc59064c147\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" Jul 07 15:41:37.693612 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.693594 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dff34d1d-59de-45db-a8a6-9dc59064c147-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-78vll\" (UID: \"dff34d1d-59de-45db-a8a6-9dc59064c147\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" Jul 07 15:41:37.699529 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.699506 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6597\" (UniqueName: \"kubernetes.io/projected/dff34d1d-59de-45db-a8a6-9dc59064c147-kube-api-access-r6597\") pod \"prometheus-operator-567f7b8b7c-78vll\" (UID: \"dff34d1d-59de-45db-a8a6-9dc59064c147\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" Jul 07 15:41:37.774793 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:37.774760 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" Jul 07 15:41:38.188281 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:38.188243 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:38.289188 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:38.289148 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:39.157266 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:39.157173 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-78vll"] Jul 07 15:41:39.161512 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:41:39.161487 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddff34d1d_59de_45db_a8a6_9dc59064c147.slice/crio-cfda2ff12e3852a60ac1076e14df0bce755ff46ccb7cf06189817807c4dab4e5 WatchSource:0}: Error finding container cfda2ff12e3852a60ac1076e14df0bce755ff46ccb7cf06189817807c4dab4e5: Status 404 returned error can't find the container with id cfda2ff12e3852a60ac1076e14df0bce755ff46ccb7cf06189817807c4dab4e5 Jul 07 15:41:39.384911 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:39.384884 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:39.487714 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:39.487686 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:39.595395 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:39.595368 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:39.686426 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:39.686402 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:39.713666 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:39.712562 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dp7kf" event={"ID":"6ac29432-252b-4c62-b411-6b3553b79e5c","Type":"ContainerStarted","Data":"8e81ef83d84a21594712e4b5fb4d13d18a7338560e33a81068aac24f53b4359d"} Jul 07 15:41:39.715146 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:39.715110 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jwspw" event={"ID":"3b250d6f-7e56-4305-8bf6-f83934a23bfb","Type":"ContainerStarted","Data":"e33a29ab7a1e1adc668dd85b80e8250812a32a1e29571fdb3df9ab947f371dd7"} Jul 07 15:41:39.716983 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:39.716959 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sdr96" event={"ID":"d13e7db2-e03e-43a4-98cb-2b5fcc7d7093","Type":"ContainerStarted","Data":"c45acfb6910ea4b03cfc3a6cf9b953bdc6d74fa5d498d615eacc73d93f8df9ce"} Jul 07 15:41:39.717089 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:39.717014 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sdr96" Jul 07 15:41:39.718187 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:39.718158 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" event={"ID":"dff34d1d-59de-45db-a8a6-9dc59064c147","Type":"ContainerStarted","Data":"cfda2ff12e3852a60ac1076e14df0bce755ff46ccb7cf06189817807c4dab4e5"} Jul 07 15:41:39.733975 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:39.733929 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jwspw" podStartSLOduration=1.511633415 podStartE2EDuration="6.733915438s" totalImagesPullingTime="5.222282023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:39.73333223 +0000 UTC m=+57.883192738" watchObservedRunningTime="2026-07-07 15:41:39.733915438 +0000 UTC m=+57.883775937" Jul 07 15:41:39.754039 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:39.753992 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sdr96" podStartSLOduration=4.543886097 podStartE2EDuration="6.753970038s" totalImagesPullingTime="2.210083941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:39.753375124 +0000 UTC m=+57.903235641" watchObservedRunningTime="2026-07-07 15:41:39.753970038 +0000 UTC m=+57.903830544" Jul 07 15:41:40.104209 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.104131 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-567498574c-m9s76"] Jul 07 15:41:40.107684 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.107662 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.110801 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.110781 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 15:41:40.110955 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.110886 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 15:41:40.111022 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.110950 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-t87sb\"" Jul 07 15:41:40.111149 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.111134 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 15:41:40.112662 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.112297 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 15:41:40.112662 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.112369 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 15:41:40.112662 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.112518 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 15:41:40.112876 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.112737 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 15:41:40.117624 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.117605 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 15:41:40.123068 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.123047 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567498574c-m9s76"] Jul 07 15:41:40.211508 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.211472 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-service-ca\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.211966 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.211544 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-config\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.211966 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.211634 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-oauth-config\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.211966 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.211662 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mscvb\" (UniqueName: \"kubernetes.io/projected/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-kube-api-access-mscvb\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.211966 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.211694 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-serving-cert\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.211966 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.211715 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-trusted-ca-bundle\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.211966 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.211737 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-oauth-serving-cert\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.312944 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.312896 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-oauth-config\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.313161 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.312964 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mscvb\" (UniqueName: \"kubernetes.io/projected/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-kube-api-access-mscvb\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.313344 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.313321 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-serving-cert\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.313408 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.313364 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-trusted-ca-bundle\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.313408 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.313393 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-oauth-serving-cert\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.313777 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.313755 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-service-ca\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.313910 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.313832 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-config\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.314244 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.314205 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-oauth-serving-cert\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.314432 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.314378 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-trusted-ca-bundle\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.314554 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.314534 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-config\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.314760 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.314741 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-service-ca\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.317446 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.317424 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-serving-cert\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.320598 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.320560 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-oauth-config\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.329744 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.329636 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mscvb\" (UniqueName: \"kubernetes.io/projected/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-kube-api-access-mscvb\") pod \"console-567498574c-m9s76\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.419487 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.419223 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:40.725418 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.725336 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dp7kf" event={"ID":"6ac29432-252b-4c62-b411-6b3553b79e5c","Type":"ContainerStarted","Data":"a3d766d7168736d8fc910f94083ff4ff0168d4ff6419deb602282feca99c73c1"} Jul 07 15:41:40.847283 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:40.847262 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567498574c-m9s76"] Jul 07 15:41:40.995055 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:41:40.994962 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bae9f32_8033_4347_9006_a2ffe3bcbe5d.slice/crio-27b9857c10ea8db7e138781005876471788c546ee4963364d9bab08cd8a60a5e WatchSource:0}: Error finding container 27b9857c10ea8db7e138781005876471788c546ee4963364d9bab08cd8a60a5e: Status 404 returned error can't find the container with id 27b9857c10ea8db7e138781005876471788c546ee4963364d9bab08cd8a60a5e Jul 07 15:41:41.151435 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:41.151367 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:41.252827 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:41.252737 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:41.362524 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:41.362493 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:41.729895 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:41.729862 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567498574c-m9s76" event={"ID":"5bae9f32-8033-4347-9006-a2ffe3bcbe5d","Type":"ContainerStarted","Data":"27b9857c10ea8db7e138781005876471788c546ee4963364d9bab08cd8a60a5e"} Jul 07 15:41:41.731771 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:41.731740 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" event={"ID":"dff34d1d-59de-45db-a8a6-9dc59064c147","Type":"ContainerStarted","Data":"0fba37276053c2c36ec1e8adb0dfb823dfd173f8ca183e2561a5734ffbe0bf9f"} Jul 07 15:41:41.731941 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:41.731791 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" event={"ID":"dff34d1d-59de-45db-a8a6-9dc59064c147","Type":"ContainerStarted","Data":"68e789cf29ae893871622dd54ca46e7e32d6b913aa076143984fc345ab4cc028"} Jul 07 15:41:41.760794 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:41.760733 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-78vll" podStartSLOduration=2.904703204 podStartE2EDuration="4.760710326s" totalImagesPullingTime="1.856007122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:41.758906228 +0000 UTC m=+59.908766734" watchObservedRunningTime="2026-07-07 15:41:41.760710326 +0000 UTC m=+59.910570833" Jul 07 15:41:42.635459 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:42.635425 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bmlhg" Jul 07 15:41:42.737757 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:42.737677 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dp7kf" event={"ID":"6ac29432-252b-4c62-b411-6b3553b79e5c","Type":"ContainerStarted","Data":"c7289869722f2043ddd72d00d50e919ca7b40f6789b72b5e5e2cc73bc57cf527"} Jul 07 15:41:42.760926 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:42.760873 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:42.859735 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:42.859700 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:43.586948 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.586915 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:43.696048 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.696019 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:43.821062 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.821029 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:43.850914 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.850788 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dp7kf" podStartSLOduration=2.313760795 podStartE2EDuration="10.850768327s" totalImagesPullingTime="8.537007532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:41:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:42.762776196 +0000 UTC m=+60.912636694" watchObservedRunningTime="2026-07-07 15:41:43.850768327 +0000 UTC m=+62.000628909" Jul 07 15:41:43.851755 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.851733 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67"] Jul 07 15:41:43.853970 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.853950 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" Jul 07 15:41:43.858833 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.858799 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-l7m7r\"" Jul 07 15:41:43.859238 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.859203 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 07 15:41:43.859339 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.859238 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 07 15:41:43.874682 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.874653 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67"] Jul 07 15:41:43.875614 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.875593 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx"] Jul 07 15:41:43.877741 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.877721 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:43.880563 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.880545 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-szz4f\"" Jul 07 15:41:43.880891 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.880874 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 07 15:41:43.881091 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.881071 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 07 15:41:43.881353 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.881338 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 07 15:41:43.893655 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.892518 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rlph7"] Jul 07 15:41:43.894816 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.894796 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx"] Jul 07 15:41:43.894939 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.894924 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:43.897317 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.897291 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 15:41:43.897621 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.897603 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 15:41:43.897805 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.897791 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zws6j\"" Jul 07 15:41:43.897997 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.897983 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 15:41:43.931976 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.931945 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:43.947783 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.947739 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/106be09e-887b-49c7-86c0-486a4880ae04-node-exporter-tls\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:43.947972 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.947810 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/106be09e-887b-49c7-86c0-486a4880ae04-root\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:43.947972 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.947833 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txm7f\" (UniqueName: \"kubernetes.io/projected/106be09e-887b-49c7-86c0-486a4880ae04-kube-api-access-txm7f\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:43.947972 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.947870 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f62d7fac-1b60-4abf-a6d9-750e39613ce0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-blx67\" (UID: \"f62d7fac-1b60-4abf-a6d9-750e39613ce0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" Jul 07 15:41:43.947972 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.947922 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f4fdde01-03f7-4685-bded-c19e8031e5c2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:43.948203 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.947979 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csw42\" (UniqueName: \"kubernetes.io/projected/f4fdde01-03f7-4685-bded-c19e8031e5c2-kube-api-access-csw42\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:43.948203 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.948008 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f62d7fac-1b60-4abf-a6d9-750e39613ce0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-blx67\" (UID: \"f62d7fac-1b60-4abf-a6d9-750e39613ce0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" Jul 07 15:41:43.948203 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.948037 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/106be09e-887b-49c7-86c0-486a4880ae04-node-exporter-textfile\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:43.948203 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.948058 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fdde01-03f7-4685-bded-c19e8031e5c2-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:43.948203 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.948130 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/106be09e-887b-49c7-86c0-486a4880ae04-metrics-client-ca\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:43.948203 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.948169 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f62d7fac-1b60-4abf-a6d9-750e39613ce0-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-blx67\" (UID: \"f62d7fac-1b60-4abf-a6d9-750e39613ce0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" Jul 07 15:41:43.948203 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.948197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/106be09e-887b-49c7-86c0-486a4880ae04-node-exporter-wtmp\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:43.948546 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.948248 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/106be09e-887b-49c7-86c0-486a4880ae04-node-exporter-accelerators-collector-config\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:43.948546 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.948296 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/106be09e-887b-49c7-86c0-486a4880ae04-sys\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:43.948546 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.948324 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4fdde01-03f7-4685-bded-c19e8031e5c2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:43.948546 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.948364 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4fdde01-03f7-4685-bded-c19e8031e5c2-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:43.948546 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.948419 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rs4w\" (UniqueName: \"kubernetes.io/projected/f62d7fac-1b60-4abf-a6d9-750e39613ce0-kube-api-access-4rs4w\") pod \"openshift-state-metrics-54cf96dfcf-blx67\" (UID: \"f62d7fac-1b60-4abf-a6d9-750e39613ce0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" Jul 07 15:41:43.948546 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.948472 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f4fdde01-03f7-4685-bded-c19e8031e5c2-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:43.948546 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:43.948495 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/106be09e-887b-49c7-86c0-486a4880ae04-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.033717 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.033676 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:44.049823 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.049781 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fdde01-03f7-4685-bded-c19e8031e5c2-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:44.050022 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.049841 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/106be09e-887b-49c7-86c0-486a4880ae04-metrics-client-ca\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.050022 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.049910 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f62d7fac-1b60-4abf-a6d9-750e39613ce0-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-blx67\" (UID: \"f62d7fac-1b60-4abf-a6d9-750e39613ce0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" Jul 07 15:41:44.050022 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.049951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/106be09e-887b-49c7-86c0-486a4880ae04-node-exporter-wtmp\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.050022 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.049980 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/106be09e-887b-49c7-86c0-486a4880ae04-node-exporter-accelerators-collector-config\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.050022 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.050011 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/106be09e-887b-49c7-86c0-486a4880ae04-sys\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.050245 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.050035 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4fdde01-03f7-4685-bded-c19e8031e5c2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:44.050245 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.050073 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4fdde01-03f7-4685-bded-c19e8031e5c2-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:44.050245 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.050101 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rs4w\" (UniqueName: \"kubernetes.io/projected/f62d7fac-1b60-4abf-a6d9-750e39613ce0-kube-api-access-4rs4w\") pod \"openshift-state-metrics-54cf96dfcf-blx67\" (UID: \"f62d7fac-1b60-4abf-a6d9-750e39613ce0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" Jul 07 15:41:44.050245 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.050127 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f4fdde01-03f7-4685-bded-c19e8031e5c2-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:44.050245 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.050155 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/106be09e-887b-49c7-86c0-486a4880ae04-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.050245 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.050183 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/106be09e-887b-49c7-86c0-486a4880ae04-node-exporter-tls\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.050245 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.050226 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/106be09e-887b-49c7-86c0-486a4880ae04-root\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.050562 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.050250 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txm7f\" (UniqueName: \"kubernetes.io/projected/106be09e-887b-49c7-86c0-486a4880ae04-kube-api-access-txm7f\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.050562 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.050280 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f62d7fac-1b60-4abf-a6d9-750e39613ce0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-blx67\" (UID: \"f62d7fac-1b60-4abf-a6d9-750e39613ce0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" Jul 07 15:41:44.050562 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.050284 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/106be09e-887b-49c7-86c0-486a4880ae04-sys\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.050562 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.050310 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f4fdde01-03f7-4685-bded-c19e8031e5c2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:44.050906 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.050879 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/106be09e-887b-49c7-86c0-486a4880ae04-node-exporter-accelerators-collector-config\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.050999 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.050980 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/106be09e-887b-49c7-86c0-486a4880ae04-metrics-client-ca\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.051055 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.051040 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f4fdde01-03f7-4685-bded-c19e8031e5c2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:44.051094 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.051045 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f62d7fac-1b60-4abf-a6d9-750e39613ce0-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-blx67\" (UID: \"f62d7fac-1b60-4abf-a6d9-750e39613ce0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" Jul 07 15:41:44.051125 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.051109 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/106be09e-887b-49c7-86c0-486a4880ae04-node-exporter-wtmp\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.051162 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.051147 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csw42\" (UniqueName: \"kubernetes.io/projected/f4fdde01-03f7-4685-bded-c19e8031e5c2-kube-api-access-csw42\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:44.051204 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.051189 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f62d7fac-1b60-4abf-a6d9-750e39613ce0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-blx67\" (UID: \"f62d7fac-1b60-4abf-a6d9-750e39613ce0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" Jul 07 15:41:44.051267 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.051224 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/106be09e-887b-49c7-86c0-486a4880ae04-node-exporter-textfile\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.051463 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.051415 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/106be09e-887b-49c7-86c0-486a4880ae04-root\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.051541 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.051525 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/106be09e-887b-49c7-86c0-486a4880ae04-node-exporter-textfile\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.051674 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.051647 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4fdde01-03f7-4685-bded-c19e8031e5c2-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:44.052098 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.052070 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f4fdde01-03f7-4685-bded-c19e8031e5c2-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:44.054092 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.054061 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/106be09e-887b-49c7-86c0-486a4880ae04-node-exporter-tls\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.054242 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.054186 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/106be09e-887b-49c7-86c0-486a4880ae04-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.054376 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.054356 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4fdde01-03f7-4685-bded-c19e8031e5c2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:44.054504 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.054482 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4fdde01-03f7-4685-bded-c19e8031e5c2-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:44.054578 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.054556 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f62d7fac-1b60-4abf-a6d9-750e39613ce0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-blx67\" (UID: \"f62d7fac-1b60-4abf-a6d9-750e39613ce0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" Jul 07 15:41:44.055454 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.055436 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f62d7fac-1b60-4abf-a6d9-750e39613ce0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-blx67\" (UID: \"f62d7fac-1b60-4abf-a6d9-750e39613ce0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" Jul 07 15:41:44.060288 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.060265 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rs4w\" (UniqueName: \"kubernetes.io/projected/f62d7fac-1b60-4abf-a6d9-750e39613ce0-kube-api-access-4rs4w\") pod \"openshift-state-metrics-54cf96dfcf-blx67\" (UID: \"f62d7fac-1b60-4abf-a6d9-750e39613ce0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" Jul 07 15:41:44.060390 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.060315 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csw42\" (UniqueName: \"kubernetes.io/projected/f4fdde01-03f7-4685-bded-c19e8031e5c2-kube-api-access-csw42\") pod \"kube-state-metrics-7c9dbb8b7d-srlgx\" (UID: \"f4fdde01-03f7-4685-bded-c19e8031e5c2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:44.060972 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.060949 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txm7f\" (UniqueName: \"kubernetes.io/projected/106be09e-887b-49c7-86c0-486a4880ae04-kube-api-access-txm7f\") pod \"node-exporter-rlph7\" (UID: \"106be09e-887b-49c7-86c0-486a4880ae04\") " pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.165099 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.165054 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" Jul 07 15:41:44.188690 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.188661 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" Jul 07 15:41:44.206253 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.206223 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rlph7" Jul 07 15:41:44.235113 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.235072 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:44.336168 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.336139 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:44.437380 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.437296 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:44.537398 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.537365 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:44.660064 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:41:44.660038 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod106be09e_887b_49c7_86c0_486a4880ae04.slice/crio-f0c9e7f7ffb58d767d38e4ca59724250f7869c846a2b98c40889987a7a3a3463 WatchSource:0}: Error finding container f0c9e7f7ffb58d767d38e4ca59724250f7869c846a2b98c40889987a7a3a3463: Status 404 returned error can't find the container with id f0c9e7f7ffb58d767d38e4ca59724250f7869c846a2b98c40889987a7a3a3463 Jul 07 15:41:44.720477 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.720371 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:44.749660 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.749348 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rlph7" event={"ID":"106be09e-887b-49c7-86c0-486a4880ae04","Type":"ContainerStarted","Data":"f0c9e7f7ffb58d767d38e4ca59724250f7869c846a2b98c40889987a7a3a3463"} Jul 07 15:41:44.813110 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.813078 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx"] Jul 07 15:41:44.821217 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.821171 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:44.826998 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.826975 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67"] Jul 07 15:41:44.829795 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:41:44.829771 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf62d7fac_1b60_4abf_a6d9_750e39613ce0.slice/crio-9e7fbc61fa7261a3edca23155f5e17715ecff4508ed69cc0f8c415688f4ac02a WatchSource:0}: Error finding container 9e7fbc61fa7261a3edca23155f5e17715ecff4508ed69cc0f8c415688f4ac02a: Status 404 returned error can't find the container with id 9e7fbc61fa7261a3edca23155f5e17715ecff4508ed69cc0f8c415688f4ac02a Jul 07 15:41:44.908321 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.908292 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:44.972735 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.972658 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 15:41:44.975103 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.975087 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:44.977761 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.977717 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 15:41:44.977761 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.977730 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 15:41:44.977761 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.977726 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 15:41:44.978015 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.977769 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 15:41:44.978015 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.977793 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 15:41:44.978116 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.978065 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 15:41:44.978166 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.978117 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 15:41:44.978256 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.978239 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zb7gf\"" Jul 07 15:41:44.978410 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.978394 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 15:41:44.978997 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.978985 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 15:41:44.994195 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.994173 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 15:41:44.997581 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:44.997561 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:45.060845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.060814 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.060845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.060844 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.061033 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.060889 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.061033 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.060910 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99b2647f-9b61-4d56-86e0-a9b118316c74-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.061033 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.060926 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-web-config\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.061033 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.060950 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99b2647f-9b61-4d56-86e0-a9b118316c74-tls-assets\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.061033 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.060997 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99b2647f-9b61-4d56-86e0-a9b118316c74-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.061236 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.061091 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99b2647f-9b61-4d56-86e0-a9b118316c74-config-out\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.061236 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.061156 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/99b2647f-9b61-4d56-86e0-a9b118316c74-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.061236 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.061191 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54v96\" (UniqueName: \"kubernetes.io/projected/99b2647f-9b61-4d56-86e0-a9b118316c74-kube-api-access-54v96\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.061331 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.061247 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-config-volume\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.061331 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.061307 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.061396 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.061342 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.162804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.162761 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-web-config\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.163011 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.162839 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99b2647f-9b61-4d56-86e0-a9b118316c74-tls-assets\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.163011 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.162886 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99b2647f-9b61-4d56-86e0-a9b118316c74-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.163011 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.162965 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99b2647f-9b61-4d56-86e0-a9b118316c74-config-out\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.163011 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.163008 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/99b2647f-9b61-4d56-86e0-a9b118316c74-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.163220 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.163079 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54v96\" (UniqueName: \"kubernetes.io/projected/99b2647f-9b61-4d56-86e0-a9b118316c74-kube-api-access-54v96\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.163220 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.163118 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-config-volume\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.163220 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.163158 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.163220 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.163175 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.163220 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.163206 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.163467 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.163222 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.163467 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.163247 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.163467 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.163278 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99b2647f-9b61-4d56-86e0-a9b118316c74-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.164182 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.164154 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/99b2647f-9b61-4d56-86e0-a9b118316c74-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.165127 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:45.164605 2572 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 07 15:41:45.165127 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:41:45.164691 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-secret-alertmanager-main-tls podName:99b2647f-9b61-4d56-86e0-a9b118316c74 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:45.664672187 +0000 UTC m=+63.814532692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "99b2647f-9b61-4d56-86e0-a9b118316c74") : secret "alertmanager-main-tls" not found Jul 07 15:41:45.165127 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.164811 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99b2647f-9b61-4d56-86e0-a9b118316c74-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.166790 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.166764 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99b2647f-9b61-4d56-86e0-a9b118316c74-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.167539 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.167510 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.168434 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.168408 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.168549 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.168486 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.168753 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.168735 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-web-config\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.169004 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.168982 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-config-volume\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.169763 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.169741 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99b2647f-9b61-4d56-86e0-a9b118316c74-config-out\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.170080 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.170041 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.170215 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.170143 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99b2647f-9b61-4d56-86e0-a9b118316c74-tls-assets\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.175872 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.175836 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54v96\" (UniqueName: \"kubernetes.io/projected/99b2647f-9b61-4d56-86e0-a9b118316c74-kube-api-access-54v96\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.321509 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.321428 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:45.666816 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.666776 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.669616 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.669560 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/99b2647f-9b61-4d56-86e0-a9b118316c74-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"99b2647f-9b61-4d56-86e0-a9b118316c74\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:45.756648 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.756610 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" event={"ID":"f62d7fac-1b60-4abf-a6d9-750e39613ce0","Type":"ContainerStarted","Data":"5ee053ca03a5d209a174780617b231a7b2fcd6d40eca59b7b7c201e0d31ac310"} Jul 07 15:41:45.757121 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.756668 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" event={"ID":"f62d7fac-1b60-4abf-a6d9-750e39613ce0","Type":"ContainerStarted","Data":"e0ef31e43826fe1238dd2381db6a2bd867d6effac3f30a85d52cb9ac1e27059c"} Jul 07 15:41:45.757121 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.756688 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" event={"ID":"f62d7fac-1b60-4abf-a6d9-750e39613ce0","Type":"ContainerStarted","Data":"9e7fbc61fa7261a3edca23155f5e17715ecff4508ed69cc0f8c415688f4ac02a"} Jul 07 15:41:45.758910 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.758884 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567498574c-m9s76" event={"ID":"5bae9f32-8033-4347-9006-a2ffe3bcbe5d","Type":"ContainerStarted","Data":"a9a5f8cb7c36c2253e81916c8bcd8d8ffa283b06cadf1676c454ee34f06121da"} Jul 07 15:41:45.761384 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.761231 2572 generic.go:356] "Generic (PLEG): container finished" podID="106be09e-887b-49c7-86c0-486a4880ae04" containerID="b6ed9b20e19cb6105c01f760e71485a3a77cc273d9af68aa8867ff3b48593080" exitCode=0 Jul 07 15:41:45.761384 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.761307 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rlph7" event={"ID":"106be09e-887b-49c7-86c0-486a4880ae04","Type":"ContainerDied","Data":"b6ed9b20e19cb6105c01f760e71485a3a77cc273d9af68aa8867ff3b48593080"} Jul 07 15:41:45.765885 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.765814 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" event={"ID":"f4fdde01-03f7-4685-bded-c19e8031e5c2","Type":"ContainerStarted","Data":"f4dde8a44e1d69e829e3a57175b102cd79afe1c6aae62fb7e3ad7eabe13fce7a"} Jul 07 15:41:45.781138 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.780658 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-567498574c-m9s76" podStartSLOduration=2.11164225 podStartE2EDuration="5.780638971s" totalImagesPullingTime="3.668996721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:45.77968372 +0000 UTC m=+63.929544227" watchObservedRunningTime="2026-07-07 15:41:45.780638971 +0000 UTC m=+63.930499479" Jul 07 15:41:45.885275 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:45.885084 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:41:46.040527 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.040483 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 15:41:46.247700 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:41:46.247672 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b2647f_9b61_4d56_86e0_a9b118316c74.slice/crio-ec80afc2c237d01a706ace81440dc4de62a5d41bcb7e878254cad123603ee14f WatchSource:0}: Error finding container ec80afc2c237d01a706ace81440dc4de62a5d41bcb7e878254cad123603ee14f: Status 404 returned error can't find the container with id ec80afc2c237d01a706ace81440dc4de62a5d41bcb7e878254cad123603ee14f Jul 07 15:41:46.614740 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.614424 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:46.714819 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.714757 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:46.728438 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.728410 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sdr96" Jul 07 15:41:46.773647 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.773062 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rlph7" event={"ID":"106be09e-887b-49c7-86c0-486a4880ae04","Type":"ContainerStarted","Data":"9c8bbf35008077b5017fb7f70a5a2b489e9f96e2d775e11ca7c11a9df4e495d8"} Jul 07 15:41:46.773647 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.773134 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rlph7" event={"ID":"106be09e-887b-49c7-86c0-486a4880ae04","Type":"ContainerStarted","Data":"c0a6227a70354754b2c89d47405a5ceaf12e909f57fd9d75f42ac3c39d895933"} Jul 07 15:41:46.775911 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.775883 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" event={"ID":"f4fdde01-03f7-4685-bded-c19e8031e5c2","Type":"ContainerStarted","Data":"c5e7c5dd546e4c91de5e1b99f1cbbfbb1af71ca11b906453490e968de9da0a00"} Jul 07 15:41:46.776052 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.775938 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" event={"ID":"f4fdde01-03f7-4685-bded-c19e8031e5c2","Type":"ContainerStarted","Data":"5ab173abb96e07cf7ba5f5ba54e2e6e7ddbd28f9f3d0ad72edf010e657ebf314"} Jul 07 15:41:46.776052 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.775968 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" event={"ID":"f4fdde01-03f7-4685-bded-c19e8031e5c2","Type":"ContainerStarted","Data":"e7f7cf4d7fb798cbe0c4488ed48cab7668b608323981cb95f15020a08ca92b36"} Jul 07 15:41:46.777190 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.777163 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99b2647f-9b61-4d56-86e0-a9b118316c74","Type":"ContainerStarted","Data":"ec80afc2c237d01a706ace81440dc4de62a5d41bcb7e878254cad123603ee14f"} Jul 07 15:41:46.779423 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.779392 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" event={"ID":"f62d7fac-1b60-4abf-a6d9-750e39613ce0","Type":"ContainerStarted","Data":"448793b3a06970c81ad7c1964ef4515e52f12da6b11bbfe3e69e871ec0a59f6c"} Jul 07 15:41:46.796203 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.795277 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rlph7" podStartSLOduration=2.828694225 podStartE2EDuration="3.795260013s" totalImagesPullingTime="877.822447ms" totalInitContainerRuntime="88.743341ms" isStatefulPod=true podCreationTimestamp="2026-07-07 15:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:46.793933079 +0000 UTC m=+64.943793584" watchObservedRunningTime="2026-07-07 15:41:46.795260013 +0000 UTC m=+64.945120523" Jul 07 15:41:46.824362 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.824312 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-blx67" podStartSLOduration=2.275702909 podStartE2EDuration="3.824299574s" totalImagesPullingTime="1.548596665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:46.823762348 +0000 UTC m=+64.973622858" watchObservedRunningTime="2026-07-07 15:41:46.824299574 +0000 UTC m=+64.974160079" Jul 07 15:41:46.850295 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.850242 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-srlgx" podStartSLOduration=2.190428619 podStartE2EDuration="3.850226539s" totalImagesPullingTime="1.65979792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:46.849560471 +0000 UTC m=+64.999420978" watchObservedRunningTime="2026-07-07 15:41:46.850226539 +0000 UTC m=+65.000087045" Jul 07 15:41:46.866209 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.866175 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm"] Jul 07 15:41:46.868620 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.868602 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:46.871314 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.871256 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 15:41:46.871411 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.871321 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 15:41:46.871463 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.871426 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7mjhz\"" Jul 07 15:41:46.871463 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.871458 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 15:41:46.871588 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.871484 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 15:41:46.871813 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.871799 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4r02m34m6cson\"" Jul 07 15:41:46.871877 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.871801 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 15:41:46.882986 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.882964 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm"] Jul 07 15:41:46.889466 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.889445 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:46.946263 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.946228 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:46.980411 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.980378 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:46.980411 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.980410 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:46.980607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.980436 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:46.980607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.980509 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-grpc-tls\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:46.980607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.980539 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-thanos-querier-tls\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:46.980607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.980560 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-metrics-client-ca\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:46.980607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.980590 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spwpg\" (UniqueName: \"kubernetes.io/projected/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-kube-api-access-spwpg\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:46.980765 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:46.980659 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.066332 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.066255 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:47.081695 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.081670 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.081802 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.081699 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.081802 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.081721 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.081802 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.081782 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-grpc-tls\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.081976 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.081820 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-thanos-querier-tls\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.081976 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.081846 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-metrics-client-ca\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.081976 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.081899 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spwpg\" (UniqueName: \"kubernetes.io/projected/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-kube-api-access-spwpg\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.081976 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.081929 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.082740 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.082711 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-metrics-client-ca\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.084549 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.084496 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.084797 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.084771 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.084879 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.084773 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.084962 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.084943 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-thanos-querier-tls\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.084997 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.084984 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-grpc-tls\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.085033 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.085013 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.090688 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.090671 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spwpg\" (UniqueName: \"kubernetes.io/projected/e917c281-fa2b-4ec6-8fe9-538390cf2b3b-kube-api-access-spwpg\") pod \"thanos-querier-7d8b589bfc-ks4lm\" (UID: \"e917c281-fa2b-4ec6-8fe9-538390cf2b3b\") " pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.124975 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.124941 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:47.178940 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.178910 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:47.315846 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.315822 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm"] Jul 07 15:41:47.317761 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:41:47.317707 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode917c281_fa2b_4ec6_8fe9_538390cf2b3b.slice/crio-8cb523a0f3a253c8e11ead4cabb585c82ff14b5c680d8a1ae74daf37a9f6f53c WatchSource:0}: Error finding container 8cb523a0f3a253c8e11ead4cabb585c82ff14b5c680d8a1ae74daf37a9f6f53c: Status 404 returned error can't find the container with id 8cb523a0f3a253c8e11ead4cabb585c82ff14b5c680d8a1ae74daf37a9f6f53c Jul 07 15:41:47.343263 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.343230 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:47.569492 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.569345 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:47.786633 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.786595 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" event={"ID":"e917c281-fa2b-4ec6-8fe9-538390cf2b3b","Type":"ContainerStarted","Data":"8cb523a0f3a253c8e11ead4cabb585c82ff14b5c680d8a1ae74daf37a9f6f53c"} Jul 07 15:41:47.907562 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.907516 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:47.975404 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:47.975368 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:48.096030 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.095989 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs\") pod \"network-metrics-daemon-nsxgh\" (UID: \"867e35ee-0f3c-4d9f-8485-b3b5d60790cc\") " pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:48.099053 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.099027 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 15:41:48.109219 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.109188 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/867e35ee-0f3c-4d9f-8485-b3b5d60790cc-metrics-certs\") pod \"network-metrics-daemon-nsxgh\" (UID: \"867e35ee-0f3c-4d9f-8485-b3b5d60790cc\") " pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:48.196008 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.195927 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jh4tr\"" Jul 07 15:41:48.196397 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.196375 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2fc\" (UniqueName: \"kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc\") pod \"network-check-target-hppz7\" (UID: \"44176831-53af-4b36-aaeb-1b05e789dc01\") " pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:48.196482 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.196449 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret\") pod \"global-pull-secret-syncer-4q4t9\" (UID: \"bd011bd6-abd7-4719-add3-7ba16ed962df\") " pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:48.199178 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.199156 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 15:41:48.199589 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.199567 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 15:41:48.203669 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.203650 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsxgh" Jul 07 15:41:48.209545 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.209519 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd011bd6-abd7-4719-add3-7ba16ed962df-original-pull-secret\") pod \"global-pull-secret-syncer-4q4t9\" (UID: \"bd011bd6-abd7-4719-add3-7ba16ed962df\") " pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:48.209665 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.209633 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 15:41:48.226693 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.226351 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr2fc\" (UniqueName: \"kubernetes.io/projected/44176831-53af-4b36-aaeb-1b05e789dc01-kube-api-access-gr2fc\") pod \"network-check-target-hppz7\" (UID: \"44176831-53af-4b36-aaeb-1b05e789dc01\") " pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:48.367355 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.367310 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-86b4d47b78-hzms4"] Jul 07 15:41:48.381734 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.381712 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.384930 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.384653 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 15:41:48.385697 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.385481 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 15:41:48.385697 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.385535 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 15:41:48.385697 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.385486 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 15:41:48.387564 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.386912 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mhznv\"" Jul 07 15:41:48.387564 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.387261 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9objl2on4rjbo\"" Jul 07 15:41:48.391409 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.391352 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86b4d47b78-hzms4"] Jul 07 15:41:48.440956 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.440893 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nsxgh"] Jul 07 15:41:48.489317 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.489202 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v8g69\"" Jul 07 15:41:48.496611 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.496585 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:48.499000 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.498977 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q4t9" Jul 07 15:41:48.499188 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.499164 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b724ed67-5d65-408e-92f4-6f4a33bde500-metrics-server-audit-profiles\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.499258 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.499206 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b724ed67-5d65-408e-92f4-6f4a33bde500-secret-metrics-server-tls\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.499258 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.499230 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b724ed67-5d65-408e-92f4-6f4a33bde500-client-ca-bundle\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.499339 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.499259 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b724ed67-5d65-408e-92f4-6f4a33bde500-audit-log\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.499339 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.499285 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg6p5\" (UniqueName: \"kubernetes.io/projected/b724ed67-5d65-408e-92f4-6f4a33bde500-kube-api-access-kg6p5\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.499418 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.499335 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b724ed67-5d65-408e-92f4-6f4a33bde500-secret-metrics-server-client-certs\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.499418 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.499365 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b724ed67-5d65-408e-92f4-6f4a33bde500-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.604308 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.604271 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b724ed67-5d65-408e-92f4-6f4a33bde500-audit-log\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.604463 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.604317 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg6p5\" (UniqueName: \"kubernetes.io/projected/b724ed67-5d65-408e-92f4-6f4a33bde500-kube-api-access-kg6p5\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.604463 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.604385 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b724ed67-5d65-408e-92f4-6f4a33bde500-secret-metrics-server-client-certs\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.604463 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.604413 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b724ed67-5d65-408e-92f4-6f4a33bde500-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.604568 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.604476 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b724ed67-5d65-408e-92f4-6f4a33bde500-metrics-server-audit-profiles\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.604568 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.604516 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b724ed67-5d65-408e-92f4-6f4a33bde500-secret-metrics-server-tls\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.604568 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.604538 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b724ed67-5d65-408e-92f4-6f4a33bde500-client-ca-bundle\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.605362 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.605297 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b724ed67-5d65-408e-92f4-6f4a33bde500-audit-log\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.605672 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.605656 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b724ed67-5d65-408e-92f4-6f4a33bde500-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.606152 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.606127 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b724ed67-5d65-408e-92f4-6f4a33bde500-metrics-server-audit-profiles\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.607931 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.607904 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b724ed67-5d65-408e-92f4-6f4a33bde500-secret-metrics-server-tls\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.608086 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.608067 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b724ed67-5d65-408e-92f4-6f4a33bde500-client-ca-bundle\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.608197 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.608155 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b724ed67-5d65-408e-92f4-6f4a33bde500-secret-metrics-server-client-certs\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.614594 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.614571 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg6p5\" (UniqueName: \"kubernetes.io/projected/b724ed67-5d65-408e-92f4-6f4a33bde500-kube-api-access-kg6p5\") pod \"metrics-server-86b4d47b78-hzms4\" (UID: \"b724ed67-5d65-408e-92f4-6f4a33bde500\") " pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.625619 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:41:48.625587 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867e35ee_0f3c_4d9f_8485_b3b5d60790cc.slice/crio-1a6e18cb602164fe7ae072744e0ba5ee7a11f07a4e763ab3fa8f08e1a8fd3c33 WatchSource:0}: Error finding container 1a6e18cb602164fe7ae072744e0ba5ee7a11f07a4e763ab3fa8f08e1a8fd3c33: Status 404 returned error can't find the container with id 1a6e18cb602164fe7ae072744e0ba5ee7a11f07a4e763ab3fa8f08e1a8fd3c33 Jul 07 15:41:48.635360 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.635336 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:48.641354 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.641331 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-qd58h"] Jul 07 15:41:48.673112 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.673074 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-qd58h"] Jul 07 15:41:48.673247 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.673190 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qd58h" Jul 07 15:41:48.675795 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.675773 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 15:41:48.676029 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.676016 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-b9bgv\"" Jul 07 15:41:48.696921 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.696797 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:41:48.712846 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.711355 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:48.795305 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.795197 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nsxgh" event={"ID":"867e35ee-0f3c-4d9f-8485-b3b5d60790cc","Type":"ContainerStarted","Data":"1a6e18cb602164fe7ae072744e0ba5ee7a11f07a4e763ab3fa8f08e1a8fd3c33"} Jul 07 15:41:48.798022 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.797930 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99b2647f-9b61-4d56-86e0-a9b118316c74","Type":"ContainerStarted","Data":"ff4d86d2bdea85bad8dcada6b4813e869c4a79f1984575d6d951543792ee51fa"} Jul 07 15:41:48.807093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.807062 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21c8673d-9e35-4aca-857c-6698870a4442-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-qd58h\" (UID: \"21c8673d-9e35-4aca-857c-6698870a4442\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qd58h" Jul 07 15:41:48.807236 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.807166 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbwkh\" (UniqueName: \"kubernetes.io/projected/21c8673d-9e35-4aca-857c-6698870a4442-kube-api-access-rbwkh\") pod \"monitoring-plugin-d5dcff7cf-qd58h\" (UID: \"21c8673d-9e35-4aca-857c-6698870a4442\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qd58h" Jul 07 15:41:48.817822 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.817790 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:48.820845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.820767 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4q4t9"] Jul 07 15:41:48.839647 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.839608 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hppz7"] Jul 07 15:41:48.876045 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:41:48.876012 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd011bd6_abd7_4719_add3_7ba16ed962df.slice/crio-1c55b34d2ec582842270b9512051f5e629f7c19d89e64323ef4d73d828a0661c WatchSource:0}: Error finding container 1c55b34d2ec582842270b9512051f5e629f7c19d89e64323ef4d73d828a0661c: Status 404 returned error can't find the container with id 1c55b34d2ec582842270b9512051f5e629f7c19d89e64323ef4d73d828a0661c Jul 07 15:41:48.886658 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:41:48.886631 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44176831_53af_4b36_aaeb_1b05e789dc01.slice/crio-6684f02c0b285f05b5148759b9f5bf0e2e3712ebf084a49e4c1aeb286444d707 WatchSource:0}: Error finding container 6684f02c0b285f05b5148759b9f5bf0e2e3712ebf084a49e4c1aeb286444d707: Status 404 returned error can't find the container with id 6684f02c0b285f05b5148759b9f5bf0e2e3712ebf084a49e4c1aeb286444d707 Jul 07 15:41:48.893487 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.893464 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86b4d47b78-hzms4"] Jul 07 15:41:48.897357 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:41:48.897331 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb724ed67_5d65_408e_92f4_6f4a33bde500.slice/crio-2abea9ac82a271dbce041b9a9d3778f3ffb9b9621f5948195bd0aeecbd0db07d WatchSource:0}: Error finding container 2abea9ac82a271dbce041b9a9d3778f3ffb9b9621f5948195bd0aeecbd0db07d: Status 404 returned error can't find the container with id 2abea9ac82a271dbce041b9a9d3778f3ffb9b9621f5948195bd0aeecbd0db07d Jul 07 15:41:48.908129 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.908086 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbwkh\" (UniqueName: \"kubernetes.io/projected/21c8673d-9e35-4aca-857c-6698870a4442-kube-api-access-rbwkh\") pod \"monitoring-plugin-d5dcff7cf-qd58h\" (UID: \"21c8673d-9e35-4aca-857c-6698870a4442\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qd58h" Jul 07 15:41:48.908250 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.908209 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21c8673d-9e35-4aca-857c-6698870a4442-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-qd58h\" (UID: \"21c8673d-9e35-4aca-857c-6698870a4442\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qd58h" Jul 07 15:41:48.910922 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.910901 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21c8673d-9e35-4aca-857c-6698870a4442-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-qd58h\" (UID: \"21c8673d-9e35-4aca-857c-6698870a4442\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qd58h" Jul 07 15:41:48.916297 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.916262 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbwkh\" (UniqueName: \"kubernetes.io/projected/21c8673d-9e35-4aca-857c-6698870a4442-kube-api-access-rbwkh\") pod \"monitoring-plugin-d5dcff7cf-qd58h\" (UID: \"21c8673d-9e35-4aca-857c-6698870a4442\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qd58h" Jul 07 15:41:48.984253 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:48.984214 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qd58h" Jul 07 15:41:49.146898 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.146846 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-964bc6c8f-cxr68"] Jul 07 15:41:49.167136 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.167100 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-964bc6c8f-cxr68"] Jul 07 15:41:49.167292 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.167249 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.170637 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.170612 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 15:41:49.170637 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.170636 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 15:41:49.170885 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.170642 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jqvlv\"" Jul 07 15:41:49.170885 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.170704 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 15:41:49.170885 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.170642 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 15:41:49.171131 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.171115 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 15:41:49.185933 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.185897 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 15:41:49.268229 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.268148 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:49.313436 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.313404 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-serving-certs-ca-bundle\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.313621 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.313447 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.313621 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.313470 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-secret-telemeter-client\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.313621 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.313537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-metrics-client-ca\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.313621 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.313563 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-telemeter-client-tls\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.313621 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.313603 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-telemeter-trusted-ca-bundle\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.313781 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.313734 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-federate-client-tls\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.313781 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.313769 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n5fr\" (UniqueName: \"kubernetes.io/projected/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-kube-api-access-8n5fr\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.335604 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.335573 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:49.415648 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.415251 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-telemeter-trusted-ca-bundle\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.415648 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.415354 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-federate-client-tls\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.415648 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.415387 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n5fr\" (UniqueName: \"kubernetes.io/projected/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-kube-api-access-8n5fr\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.415648 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.415431 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-serving-certs-ca-bundle\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.415648 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.415468 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.415648 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.415487 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-secret-telemeter-client\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.415648 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.415506 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-metrics-client-ca\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.415648 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.415533 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-telemeter-client-tls\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.416347 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.416315 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-serving-certs-ca-bundle\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.416493 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.416406 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-metrics-client-ca\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.416742 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.416682 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-telemeter-trusted-ca-bundle\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.418875 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.418834 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-federate-client-tls\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.418973 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.418956 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.419279 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.419263 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-secret-telemeter-client\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.419552 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.419539 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-telemeter-client-tls\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.424455 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.424428 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n5fr\" (UniqueName: \"kubernetes.io/projected/e53034a1-4c2f-4d76-a7b3-5e7a31c60a13-kube-api-access-8n5fr\") pod \"telemeter-client-964bc6c8f-cxr68\" (UID: \"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13\") " pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.486577 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.486538 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" Jul 07 15:41:49.654708 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.654578 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-qd58h"] Jul 07 15:41:49.666765 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:41:49.666698 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c8673d_9e35_4aca_857c_6698870a4442.slice/crio-b5843ce228cb8a84c9707b8d41b8084e7e67667c2a0fb4a25ba7ffea38ced65a WatchSource:0}: Error finding container b5843ce228cb8a84c9707b8d41b8084e7e67667c2a0fb4a25ba7ffea38ced65a: Status 404 returned error can't find the container with id b5843ce228cb8a84c9707b8d41b8084e7e67667c2a0fb4a25ba7ffea38ced65a Jul 07 15:41:49.692608 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.692524 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-964bc6c8f-cxr68"] Jul 07 15:41:49.702248 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:41:49.702183 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode53034a1_4c2f_4d76_a7b3_5e7a31c60a13.slice/crio-f6f173a25134950dcf9b2b3c76fca34b4c76fced9d6f52b3e4c6474c41b61c4e WatchSource:0}: Error finding container f6f173a25134950dcf9b2b3c76fca34b4c76fced9d6f52b3e4c6474c41b61c4e: Status 404 returned error can't find the container with id f6f173a25134950dcf9b2b3c76fca34b4c76fced9d6f52b3e4c6474c41b61c4e Jul 07 15:41:49.715040 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.715011 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:49.724138 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.723787 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567498574c-m9s76"] Jul 07 15:41:49.749599 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.748062 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5ffd9f758b-k2tzq"] Jul 07 15:41:49.753962 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.753939 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:49.767829 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.766335 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ffd9f758b-k2tzq"] Jul 07 15:41:49.809220 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.809084 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" event={"ID":"e917c281-fa2b-4ec6-8fe9-538390cf2b3b","Type":"ContainerStarted","Data":"4c52ad5fddd428036fa0dcea04a92a47fd783e228cc9346917b94c5c82f4320c"} Jul 07 15:41:49.809220 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.809165 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" event={"ID":"e917c281-fa2b-4ec6-8fe9-538390cf2b3b","Type":"ContainerStarted","Data":"c0be1d4127ef7ca0470546fe6609a20576440c519f550b156eb8ea8a60cc40df"} Jul 07 15:41:49.815281 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.814579 2572 generic.go:356] "Generic (PLEG): container finished" podID="99b2647f-9b61-4d56-86e0-a9b118316c74" containerID="ff4d86d2bdea85bad8dcada6b4813e869c4a79f1984575d6d951543792ee51fa" exitCode=0 Jul 07 15:41:49.815281 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.814655 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99b2647f-9b61-4d56-86e0-a9b118316c74","Type":"ContainerDied","Data":"ff4d86d2bdea85bad8dcada6b4813e869c4a79f1984575d6d951543792ee51fa"} Jul 07 15:41:49.818327 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.818303 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" event={"ID":"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13","Type":"ContainerStarted","Data":"f6f173a25134950dcf9b2b3c76fca34b4c76fced9d6f52b3e4c6474c41b61c4e"} Jul 07 15:41:49.821812 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.821787 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qd58h" event={"ID":"21c8673d-9e35-4aca-857c-6698870a4442","Type":"ContainerStarted","Data":"b5843ce228cb8a84c9707b8d41b8084e7e67667c2a0fb4a25ba7ffea38ced65a"} Jul 07 15:41:49.824201 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.824144 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" event={"ID":"b724ed67-5d65-408e-92f4-6f4a33bde500","Type":"ContainerStarted","Data":"2abea9ac82a271dbce041b9a9d3778f3ffb9b9621f5948195bd0aeecbd0db07d"} Jul 07 15:41:49.826971 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.826912 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hppz7" event={"ID":"44176831-53af-4b36-aaeb-1b05e789dc01","Type":"ContainerStarted","Data":"6684f02c0b285f05b5148759b9f5bf0e2e3712ebf084a49e4c1aeb286444d707"} Jul 07 15:41:49.829333 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.829289 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:49.829453 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.829434 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4q4t9" event={"ID":"bd011bd6-abd7-4719-add3-7ba16ed962df","Type":"ContainerStarted","Data":"1c55b34d2ec582842270b9512051f5e629f7c19d89e64323ef4d73d828a0661c"} Jul 07 15:41:49.928061 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.927991 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:49.929075 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.928611 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-oauth-serving-cert\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:49.929075 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.928689 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-oauth-config\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:49.929075 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.928804 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-serving-cert\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:49.929075 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.928843 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-service-ca\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:49.929075 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.928928 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26xpf\" (UniqueName: \"kubernetes.io/projected/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-kube-api-access-26xpf\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:49.929075 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.928977 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-trusted-ca-bundle\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:49.929999 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:49.929452 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-config\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:50.032251 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.030252 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-oauth-config\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:50.032251 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.030320 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-serving-cert\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:50.032251 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.030356 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-service-ca\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:50.032251 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.030386 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26xpf\" (UniqueName: \"kubernetes.io/projected/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-kube-api-access-26xpf\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:50.032251 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.030421 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-trusted-ca-bundle\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:50.032251 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.030452 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-config\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:50.032251 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.030529 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-oauth-serving-cert\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:50.032251 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.031267 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-oauth-serving-cert\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:50.034729 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.033298 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-service-ca\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:50.034729 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.034148 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-trusted-ca-bundle\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:50.034729 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.034658 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-config\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:50.036973 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.036899 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-oauth-config\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:50.043050 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.042997 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-serving-cert\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:50.046348 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.046297 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26xpf\" (UniqueName: \"kubernetes.io/projected/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-kube-api-access-26xpf\") pod \"console-5ffd9f758b-k2tzq\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:50.087655 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.087498 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:41:50.245202 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.243211 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 15:41:50.245202 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.243617 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:50.247748 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.246603 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.253304 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.253094 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 15:41:50.253304 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.253307 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tnzc6\"" Jul 07 15:41:50.253550 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.253533 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 15:41:50.253755 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.253736 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 15:41:50.259774 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.259244 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 15:41:50.259774 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.259329 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 15:41:50.259774 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.259457 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 15:41:50.259774 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.259555 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ff1ur7ne2rsv1\"" Jul 07 15:41:50.259774 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.259638 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 15:41:50.259774 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.259676 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 15:41:50.259774 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.259729 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 15:41:50.261106 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.260424 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 15:41:50.261106 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.260502 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 15:41:50.261106 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.260423 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 15:41:50.261106 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.260831 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 15:41:50.267991 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.263143 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 15:41:50.274738 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.274709 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 15:41:50.299196 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.299118 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ffd9f758b-k2tzq"] Jul 07 15:41:50.419839 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.419800 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-567498574c-m9s76" Jul 07 15:41:50.435845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.434980 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3b17c484-3dd3-445a-aa4f-79e249f1d301-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.435845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435035 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.435845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435064 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.435845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.435845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435112 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.435845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435147 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.435845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435180 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b17c484-3dd3-445a-aa4f-79e249f1d301-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.435845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435204 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.435845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435275 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.435845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435302 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.435845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435325 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.435845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435355 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhnkk\" (UniqueName: \"kubernetes.io/projected/3b17c484-3dd3-445a-aa4f-79e249f1d301-kube-api-access-jhnkk\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.435845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435390 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.435845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435420 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-config\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.435845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435444 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.435845 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435481 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.436916 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435532 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b17c484-3dd3-445a-aa4f-79e249f1d301-config-out\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.436916 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435559 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.436916 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435585 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-web-config\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.436916 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.435609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.538433 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536272 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b17c484-3dd3-445a-aa4f-79e249f1d301-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.538433 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536319 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.538433 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536381 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.538433 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536411 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.538433 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536435 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.538433 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536459 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhnkk\" (UniqueName: \"kubernetes.io/projected/3b17c484-3dd3-445a-aa4f-79e249f1d301-kube-api-access-jhnkk\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.538433 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536491 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.538433 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-config\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.538433 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536543 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.538433 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536575 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.538433 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536619 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b17c484-3dd3-445a-aa4f-79e249f1d301-config-out\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.538433 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536647 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.538433 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536670 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-web-config\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.538433 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536689 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.538433 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536724 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3b17c484-3dd3-445a-aa4f-79e249f1d301-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.538433 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536832 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.538433 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536876 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.542870 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536901 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.542870 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536927 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.542870 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.536962 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.542870 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.537994 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.542870 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.538547 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3b17c484-3dd3-445a-aa4f-79e249f1d301-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.542870 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.538941 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.542870 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.539456 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.542870 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.539613 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.542870 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.542356 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.544924 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.543796 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.544924 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.544641 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3b17c484-3dd3-445a-aa4f-79e249f1d301-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.552956 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.552889 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhnkk\" (UniqueName: \"kubernetes.io/projected/3b17c484-3dd3-445a-aa4f-79e249f1d301-kube-api-access-jhnkk\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.554426 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.554400 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.554781 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.554760 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b17c484-3dd3-445a-aa4f-79e249f1d301-config-out\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.555429 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.555405 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.557643 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.557617 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.560355 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.560237 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.560595 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.560577 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.561387 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.561363 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-web-config\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.566656 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.566632 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.567318 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.567094 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b17c484-3dd3-445a-aa4f-79e249f1d301-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.569275 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.569223 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.569823 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.569782 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b17c484-3dd3-445a-aa4f-79e249f1d301-config\") pod \"prometheus-k8s-0\" (UID: \"3b17c484-3dd3-445a-aa4f-79e249f1d301\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.574029 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.573775 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:41:50.849456 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:50.849366 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" event={"ID":"e917c281-fa2b-4ec6-8fe9-538390cf2b3b","Type":"ContainerStarted","Data":"20b10c6fab4efb07b56aa6d752ee70e5f72b7057201ddecdac4e0b35767d7aa9"} Jul 07 15:41:51.118869 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:51.118822 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 15:41:51.795842 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:41:51.795809 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b17c484_3dd3_445a_aa4f_79e249f1d301.slice/crio-1dd311dc8a05b25b43549281b1553ccadbe123fe192f073ce7efa2c123421436 WatchSource:0}: Error finding container 1dd311dc8a05b25b43549281b1553ccadbe123fe192f073ce7efa2c123421436: Status 404 returned error can't find the container with id 1dd311dc8a05b25b43549281b1553ccadbe123fe192f073ce7efa2c123421436 Jul 07 15:41:51.856948 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:51.856834 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffd9f758b-k2tzq" event={"ID":"4e1f9b3f-867e-473c-b19e-76e8e9a38c67","Type":"ContainerStarted","Data":"ec7aae70c1c68fbed70efbc0bf4d91363f9e3d61fcdf2b0cecf84044ec28e8ab"} Jul 07 15:41:51.859088 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:51.859006 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b17c484-3dd3-445a-aa4f-79e249f1d301","Type":"ContainerStarted","Data":"1dd311dc8a05b25b43549281b1553ccadbe123fe192f073ce7efa2c123421436"} Jul 07 15:41:52.041487 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:52.041429 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:53.110137 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:53.110098 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:53.211514 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:53.211433 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:55.138902 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:55.138868 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:55.197085 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:55.197040 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:56.883145 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.883114 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hppz7" event={"ID":"44176831-53af-4b36-aaeb-1b05e789dc01","Type":"ContainerStarted","Data":"8dcb307feff79d5eb30ab904d9cf432781a38dc0011729e82d4060bea4fc2e30"} Jul 07 15:41:56.883549 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.883194 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:41:56.886148 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.886116 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" event={"ID":"e917c281-fa2b-4ec6-8fe9-538390cf2b3b","Type":"ContainerStarted","Data":"afc48357579a5807d8cee2f5173fa929893e5aa5ae1e4375a73f12ffdf5e9ca9"} Jul 07 15:41:56.886281 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.886180 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" event={"ID":"e917c281-fa2b-4ec6-8fe9-538390cf2b3b","Type":"ContainerStarted","Data":"fe8e7ce1de0acd81460b73c85692b06d943a89f2298bead457966ae38c1a944a"} Jul 07 15:41:56.886281 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.886266 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" event={"ID":"e917c281-fa2b-4ec6-8fe9-538390cf2b3b","Type":"ContainerStarted","Data":"d4a3d5a9e26a028c470c5ee3e54a03cfbc1f382c5585440d05f92ddd2f774489"} Jul 07 15:41:56.886386 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.886310 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:56.888153 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.888116 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nsxgh" event={"ID":"867e35ee-0f3c-4d9f-8485-b3b5d60790cc","Type":"ContainerStarted","Data":"61dd159d4f9b7a280c52077c1a53955bd59e951f5ef23b23df50c7c617207bd0"} Jul 07 15:41:56.888258 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.888176 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nsxgh" event={"ID":"867e35ee-0f3c-4d9f-8485-b3b5d60790cc","Type":"ContainerStarted","Data":"3e3199d23594e8d2f50a415d0ec3fbe5d7146df2651717f7e3d6c7537a7249c3"} Jul 07 15:41:56.889586 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.889557 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffd9f758b-k2tzq" event={"ID":"4e1f9b3f-867e-473c-b19e-76e8e9a38c67","Type":"ContainerStarted","Data":"712234fac8d73ce5b3c5a9bcf4b3a647920809fa19bc06b40b1e64d5f0b9028f"} Jul 07 15:41:56.892454 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.892434 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" Jul 07 15:41:56.892997 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.892977 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99b2647f-9b61-4d56-86e0-a9b118316c74","Type":"ContainerStarted","Data":"393711d2e0e2f63f352261600b01b5d3ab07ef114907369a3b12be59c8e677bf"} Jul 07 15:41:56.893147 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.893034 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99b2647f-9b61-4d56-86e0-a9b118316c74","Type":"ContainerStarted","Data":"b07b55339c1749390ed7a06f1938a6aad0e29b9294abc5e3a7c42030710e4d1d"} Jul 07 15:41:56.893147 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.893083 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99b2647f-9b61-4d56-86e0-a9b118316c74","Type":"ContainerStarted","Data":"180c7ee086c3ed1572ee530bc8e7155dd43296dc4ee4de3a5c4f95679b11b511"} Jul 07 15:41:56.893147 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.893124 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99b2647f-9b61-4d56-86e0-a9b118316c74","Type":"ContainerStarted","Data":"7a05111288db39c9c1f25f4a2f5d8a25649e8f822aa8af0987635d191f5c406a"} Jul 07 15:41:56.893301 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.893168 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99b2647f-9b61-4d56-86e0-a9b118316c74","Type":"ContainerStarted","Data":"cf19ea969b7a7d553ab73d4becdf8e1b936fda10c28edae3e500385ee2e0b496"} Jul 07 15:41:56.893301 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.893209 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99b2647f-9b61-4d56-86e0-a9b118316c74","Type":"ContainerStarted","Data":"67b05bce71af3ad231a5db29e60e3e494a4e19becd5b6572d7bd36dbef4c610b"} Jul 07 15:41:56.894308 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.894288 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4q4t9" event={"ID":"bd011bd6-abd7-4719-add3-7ba16ed962df","Type":"ContainerStarted","Data":"4a6fa5b442640cc8ef8f731bce8f7e6096d4833018563e89c14a7d444093909f"} Jul 07 15:41:56.895654 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.895635 2572 generic.go:356] "Generic (PLEG): container finished" podID="3b17c484-3dd3-445a-aa4f-79e249f1d301" containerID="9797dec12b76c63d77b0e25c1ae2f7c50f13b3349485ab3419f90b90d8189c54" exitCode=0 Jul 07 15:41:56.895735 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.895714 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b17c484-3dd3-445a-aa4f-79e249f1d301","Type":"ContainerDied","Data":"9797dec12b76c63d77b0e25c1ae2f7c50f13b3349485ab3419f90b90d8189c54"} Jul 07 15:41:56.897726 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.897706 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" event={"ID":"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13","Type":"ContainerStarted","Data":"797a737060ebc078f2186c7fcb95434f736a05db0e10a0d49e7109bee70daa34"} Jul 07 15:41:56.897814 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.897756 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" event={"ID":"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13","Type":"ContainerStarted","Data":"452df00d7f27d80c5d2a9a84b80dd1f50e14964a2c48424e29de5e0732890c9d"} Jul 07 15:41:56.897814 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.897788 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" event={"ID":"e53034a1-4c2f-4d76-a7b3-5e7a31c60a13","Type":"ContainerStarted","Data":"4006ffd3dd1e806917cc143365fe07215bed96e24d187f2a802e804251bbe7df"} Jul 07 15:41:56.899157 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.899136 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qd58h" event={"ID":"21c8673d-9e35-4aca-857c-6698870a4442","Type":"ContainerStarted","Data":"6f07766d2022485b7fe5710676483a652303c6164e94d2222f41522ee474ee00"} Jul 07 15:41:56.899352 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.899332 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qd58h" Jul 07 15:41:56.901343 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.901305 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hppz7" podStartSLOduration=66.812895469 podStartE2EDuration="1m13.901292843s" totalImagesPullingTime="7.088397374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:56.900397756 +0000 UTC m=+75.050258264" watchObservedRunningTime="2026-07-07 15:41:56.901292843 +0000 UTC m=+75.051153348" Jul 07 15:41:56.903691 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.902162 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" event={"ID":"b724ed67-5d65-408e-92f4-6f4a33bde500","Type":"ContainerStarted","Data":"3bad71e661e05be1aecf39a6097898e0bce356ebbcec238ed254b8d5ce397c4d"} Jul 07 15:41:56.906083 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.906066 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qd58h" Jul 07 15:41:56.930600 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.930544 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.350719235 podStartE2EDuration="12.930530779s" totalImagesPullingTime="8.551976362s" totalInitContainerRuntime="27.835182ms" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:56.928441006 +0000 UTC m=+75.078301524" watchObservedRunningTime="2026-07-07 15:41:56.930530779 +0000 UTC m=+75.080391285" Jul 07 15:41:56.951218 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.951159 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5ffd9f758b-k2tzq" podStartSLOduration=7.951138874 podStartE2EDuration="7.951138874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:56.948182243 +0000 UTC m=+75.098042751" watchObservedRunningTime="2026-07-07 15:41:56.951138874 +0000 UTC m=+75.100999381" Jul 07 15:41:56.974103 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.974044 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-964bc6c8f-cxr68" podStartSLOduration=1.724845781 podStartE2EDuration="7.97402914s" totalImagesPullingTime="6.249183359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:56.972356485 +0000 UTC m=+75.122216991" watchObservedRunningTime="2026-07-07 15:41:56.97402914 +0000 UTC m=+75.123889645" Jul 07 15:41:56.991871 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:56.991816 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qd58h" podStartSLOduration=2.706163477 podStartE2EDuration="8.991798245s" totalImagesPullingTime="6.285634768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:56.990941247 +0000 UTC m=+75.140801754" watchObservedRunningTime="2026-07-07 15:41:56.991798245 +0000 UTC m=+75.141658752" Jul 07 15:41:57.009198 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:57.009149 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nsxgh" podStartSLOduration=68.18731229 podStartE2EDuration="1m14.009134319s" totalImagesPullingTime="5.821822029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:57.008054194 +0000 UTC m=+75.157914702" watchObservedRunningTime="2026-07-07 15:41:57.009134319 +0000 UTC m=+75.158994841" Jul 07 15:41:57.029456 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:57.029405 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4q4t9" podStartSLOduration=66.92830357 podStartE2EDuration="1m14.029389902s" totalImagesPullingTime="7.101086332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:57.028522997 +0000 UTC m=+75.178383503" watchObservedRunningTime="2026-07-07 15:41:57.029389902 +0000 UTC m=+75.179250407" Jul 07 15:41:57.055876 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:57.055806 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7d8b589bfc-ks4lm" podStartSLOduration=2.733379813 podStartE2EDuration="11.055791494s" totalImagesPullingTime="8.322411681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:57.054326269 +0000 UTC m=+75.204186774" watchObservedRunningTime="2026-07-07 15:41:57.055791494 +0000 UTC m=+75.205652000" Jul 07 15:41:57.105426 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:57.105388 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:57.115218 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:57.115172 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" podStartSLOduration=2.066217711 podStartE2EDuration="9.115156698s" totalImagesPullingTime="7.048938987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:57.11440618 +0000 UTC m=+75.264266686" watchObservedRunningTime="2026-07-07 15:41:57.115156698 +0000 UTC m=+75.265017263" Jul 07 15:41:57.210482 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:57.210398 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:57.305617 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:57.305562 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:57.682716 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:57.682676 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ffd9f758b-k2tzq"] Jul 07 15:41:59.922154 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:41:59.922128 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b17c484-3dd3-445a-aa4f-79e249f1d301","Type":"ContainerStarted","Data":"b47473a2124ad44824bab3f10bc59b85aff5e5c7d3e76ac4746be6266ec7c454"} Jul 07 15:42:00.088887 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:00.088558 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:42:00.929948 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:00.929911 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b17c484-3dd3-445a-aa4f-79e249f1d301","Type":"ContainerStarted","Data":"31702d82ddc112b7d3baa0fa819aaa1be3297a010c09fede0a26f89e89dd8624"} Jul 07 15:42:00.930319 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:00.929977 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b17c484-3dd3-445a-aa4f-79e249f1d301","Type":"ContainerStarted","Data":"2460c15b6ba89259d7354384200fe8c53a9d6c79f5c51bad488aafbe43dd83d2"} Jul 07 15:42:00.930319 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:00.930003 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b17c484-3dd3-445a-aa4f-79e249f1d301","Type":"ContainerStarted","Data":"a26b7d1b8b521409a9bea69cd4c5c3201327d9891b733a08bff5d174abe8863d"} Jul 07 15:42:00.930319 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:00.930032 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b17c484-3dd3-445a-aa4f-79e249f1d301","Type":"ContainerStarted","Data":"efd82a8d5499c820f8eed596d2dfeeffcf5d424f6fffd881b6302a721076ffe8"} Jul 07 15:42:00.930319 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:00.930056 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3b17c484-3dd3-445a-aa4f-79e249f1d301","Type":"ContainerStarted","Data":"4638d6bd0776b2971998903c7bc9a13dba4f77561ada4aa3a709f383d3137687"} Jul 07 15:42:00.986783 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:00.986732 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.998648616 podStartE2EDuration="10.986714022s" totalImagesPullingTime="2.931437095s" totalInitContainerRuntime="56.628311ms" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:00.984031382 +0000 UTC m=+79.133891889" watchObservedRunningTime="2026-07-07 15:42:00.986714022 +0000 UTC m=+79.136574529" Jul 07 15:42:01.097990 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:01.097959 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:01.159841 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:01.159777 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:02.062847 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:02.062811 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:02.120786 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:02.120755 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:05.574838 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:05.574714 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:42:08.450459 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:08.450424 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:08.517395 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:08.517364 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:08.575453 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:08.575418 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:08.697215 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:08.697181 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:42:08.697405 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:08.697247 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:42:14.757756 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:14.757704 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-567498574c-m9s76" podUID="5bae9f32-8033-4347-9006-a2ffe3bcbe5d" containerName="console" containerID="cri-o://a9a5f8cb7c36c2253e81916c8bcd8d8ffa283b06cadf1676c454ee34f06121da" gracePeriod=15 Jul 07 15:42:14.994561 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:14.994528 2572 generic.go:356] "Generic (PLEG): container finished" podID="5bae9f32-8033-4347-9006-a2ffe3bcbe5d" containerID="a9a5f8cb7c36c2253e81916c8bcd8d8ffa283b06cadf1676c454ee34f06121da" exitCode=0 Jul 07 15:42:14.994708 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:14.994606 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567498574c-m9s76" event={"ID":"5bae9f32-8033-4347-9006-a2ffe3bcbe5d","Type":"ContainerDied","Data":"a9a5f8cb7c36c2253e81916c8bcd8d8ffa283b06cadf1676c454ee34f06121da"} Jul 07 15:42:15.543077 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.543050 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567498574c-m9s76" Jul 07 15:42:15.671174 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.671075 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-service-ca\") pod \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " Jul 07 15:42:15.671174 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.671123 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-oauth-config\") pod \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " Jul 07 15:42:15.671174 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.671150 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-config\") pod \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " Jul 07 15:42:15.671473 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.671228 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-serving-cert\") pod \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " Jul 07 15:42:15.671473 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.671284 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mscvb\" (UniqueName: \"kubernetes.io/projected/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-kube-api-access-mscvb\") pod \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " Jul 07 15:42:15.671473 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.671300 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-trusted-ca-bundle\") pod \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " Jul 07 15:42:15.671473 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.671352 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-oauth-serving-cert\") pod \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\" (UID: \"5bae9f32-8033-4347-9006-a2ffe3bcbe5d\") " Jul 07 15:42:15.671473 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.671442 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-service-ca" (OuterVolumeSpecName: "service-ca") pod "5bae9f32-8033-4347-9006-a2ffe3bcbe5d" (UID: "5bae9f32-8033-4347-9006-a2ffe3bcbe5d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:42:15.671710 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.671554 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-config" (OuterVolumeSpecName: "console-config") pod "5bae9f32-8033-4347-9006-a2ffe3bcbe5d" (UID: "5bae9f32-8033-4347-9006-a2ffe3bcbe5d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:42:15.671777 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.671748 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5bae9f32-8033-4347-9006-a2ffe3bcbe5d" (UID: "5bae9f32-8033-4347-9006-a2ffe3bcbe5d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:42:15.671777 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.671759 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5bae9f32-8033-4347-9006-a2ffe3bcbe5d" (UID: "5bae9f32-8033-4347-9006-a2ffe3bcbe5d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:42:15.671888 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.671774 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-service-ca\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:42:15.671888 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.671795 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-config\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:42:15.673840 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.673813 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-kube-api-access-mscvb" (OuterVolumeSpecName: "kube-api-access-mscvb") pod "5bae9f32-8033-4347-9006-a2ffe3bcbe5d" (UID: "5bae9f32-8033-4347-9006-a2ffe3bcbe5d"). InnerVolumeSpecName "kube-api-access-mscvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:42:15.674035 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.674008 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5bae9f32-8033-4347-9006-a2ffe3bcbe5d" (UID: "5bae9f32-8033-4347-9006-a2ffe3bcbe5d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:42:15.674093 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.674076 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5bae9f32-8033-4347-9006-a2ffe3bcbe5d" (UID: "5bae9f32-8033-4347-9006-a2ffe3bcbe5d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:42:15.772717 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.772678 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-oauth-config\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:42:15.772717 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.772709 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-console-serving-cert\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:42:15.772717 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.772719 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mscvb\" (UniqueName: \"kubernetes.io/projected/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-kube-api-access-mscvb\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:42:15.772717 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.772728 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-trusted-ca-bundle\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:42:15.773244 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.772737 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bae9f32-8033-4347-9006-a2ffe3bcbe5d-oauth-serving-cert\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:42:16.000022 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.999946 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567498574c-m9s76" Jul 07 15:42:16.000022 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:15.999972 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567498574c-m9s76" event={"ID":"5bae9f32-8033-4347-9006-a2ffe3bcbe5d","Type":"ContainerDied","Data":"27b9857c10ea8db7e138781005876471788c546ee4963364d9bab08cd8a60a5e"} Jul 07 15:42:16.000212 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:16.000030 2572 scope.go:117] "RemoveContainer" containerID="a9a5f8cb7c36c2253e81916c8bcd8d8ffa283b06cadf1676c454ee34f06121da" Jul 07 15:42:16.024317 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:16.024286 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567498574c-m9s76"] Jul 07 15:42:16.028672 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:16.028647 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-567498574c-m9s76"] Jul 07 15:42:16.377574 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:16.377536 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bae9f32-8033-4347-9006-a2ffe3bcbe5d" path="/var/lib/kubelet/pods/5bae9f32-8033-4347-9006-a2ffe3bcbe5d/volumes" Jul 07 15:42:17.061395 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:17.061363 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:17.264720 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:17.264686 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:23.940453 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:23.940390 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5ffd9f758b-k2tzq" podUID="4e1f9b3f-867e-473c-b19e-76e8e9a38c67" containerName="console" containerID="cri-o://712234fac8d73ce5b3c5a9bcf4b3a647920809fa19bc06b40b1e64d5f0b9028f" gracePeriod=15 Jul 07 15:42:24.195504 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.195390 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:42:24.255918 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.255805 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26xpf\" (UniqueName: \"kubernetes.io/projected/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-kube-api-access-26xpf\") pod \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " Jul 07 15:42:24.256096 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.255985 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-trusted-ca-bundle\") pod \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " Jul 07 15:42:24.256096 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.256072 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-oauth-serving-cert\") pod \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " Jul 07 15:42:24.256211 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.256130 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-serving-cert\") pod \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " Jul 07 15:42:24.256211 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.256186 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-oauth-config\") pod \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " Jul 07 15:42:24.256317 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.256211 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-config\") pod \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " Jul 07 15:42:24.256317 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.256236 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-service-ca\") pod \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\" (UID: \"4e1f9b3f-867e-473c-b19e-76e8e9a38c67\") " Jul 07 15:42:24.256420 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.256381 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4e1f9b3f-867e-473c-b19e-76e8e9a38c67" (UID: "4e1f9b3f-867e-473c-b19e-76e8e9a38c67"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:42:24.256477 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.256452 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4e1f9b3f-867e-473c-b19e-76e8e9a38c67" (UID: "4e1f9b3f-867e-473c-b19e-76e8e9a38c67"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:42:24.256708 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.256688 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-trusted-ca-bundle\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:42:24.256802 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.256714 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-oauth-serving-cert\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:42:24.256802 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.256726 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-service-ca" (OuterVolumeSpecName: "service-ca") pod "4e1f9b3f-867e-473c-b19e-76e8e9a38c67" (UID: "4e1f9b3f-867e-473c-b19e-76e8e9a38c67"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:42:24.257085 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.257061 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-config" (OuterVolumeSpecName: "console-config") pod "4e1f9b3f-867e-473c-b19e-76e8e9a38c67" (UID: "4e1f9b3f-867e-473c-b19e-76e8e9a38c67"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:42:24.258279 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.258251 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-kube-api-access-26xpf" (OuterVolumeSpecName: "kube-api-access-26xpf") pod "4e1f9b3f-867e-473c-b19e-76e8e9a38c67" (UID: "4e1f9b3f-867e-473c-b19e-76e8e9a38c67"). InnerVolumeSpecName "kube-api-access-26xpf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:42:24.258440 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.258420 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4e1f9b3f-867e-473c-b19e-76e8e9a38c67" (UID: "4e1f9b3f-867e-473c-b19e-76e8e9a38c67"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:42:24.258937 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.258914 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4e1f9b3f-867e-473c-b19e-76e8e9a38c67" (UID: "4e1f9b3f-867e-473c-b19e-76e8e9a38c67"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:42:24.357291 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.357260 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-serving-cert\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:42:24.357291 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.357289 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-oauth-config\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:42:24.357291 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.357299 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-console-config\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:42:24.357513 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.357308 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-service-ca\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:42:24.357513 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:24.357316 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26xpf\" (UniqueName: \"kubernetes.io/projected/4e1f9b3f-867e-473c-b19e-76e8e9a38c67-kube-api-access-26xpf\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:42:25.040967 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:25.040924 2572 generic.go:356] "Generic (PLEG): container finished" podID="4e1f9b3f-867e-473c-b19e-76e8e9a38c67" containerID="712234fac8d73ce5b3c5a9bcf4b3a647920809fa19bc06b40b1e64d5f0b9028f" exitCode=0 Jul 07 15:42:25.041421 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:25.040973 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffd9f758b-k2tzq" Jul 07 15:42:25.041421 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:25.040977 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffd9f758b-k2tzq" event={"ID":"4e1f9b3f-867e-473c-b19e-76e8e9a38c67","Type":"ContainerDied","Data":"712234fac8d73ce5b3c5a9bcf4b3a647920809fa19bc06b40b1e64d5f0b9028f"} Jul 07 15:42:25.041421 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:25.041034 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffd9f758b-k2tzq" event={"ID":"4e1f9b3f-867e-473c-b19e-76e8e9a38c67","Type":"ContainerDied","Data":"ec7aae70c1c68fbed70efbc0bf4d91363f9e3d61fcdf2b0cecf84044ec28e8ab"} Jul 07 15:42:25.041421 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:25.041055 2572 scope.go:117] "RemoveContainer" containerID="712234fac8d73ce5b3c5a9bcf4b3a647920809fa19bc06b40b1e64d5f0b9028f" Jul 07 15:42:25.050183 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:25.050158 2572 scope.go:117] "RemoveContainer" containerID="712234fac8d73ce5b3c5a9bcf4b3a647920809fa19bc06b40b1e64d5f0b9028f" Jul 07 15:42:25.050497 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:42:25.050474 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"712234fac8d73ce5b3c5a9bcf4b3a647920809fa19bc06b40b1e64d5f0b9028f\": container with ID starting with 712234fac8d73ce5b3c5a9bcf4b3a647920809fa19bc06b40b1e64d5f0b9028f not found: ID does not exist" containerID="712234fac8d73ce5b3c5a9bcf4b3a647920809fa19bc06b40b1e64d5f0b9028f" Jul 07 15:42:25.050605 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:25.050508 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"712234fac8d73ce5b3c5a9bcf4b3a647920809fa19bc06b40b1e64d5f0b9028f"} err="failed to get container status \"712234fac8d73ce5b3c5a9bcf4b3a647920809fa19bc06b40b1e64d5f0b9028f\": rpc error: code = NotFound desc = could not find container \"712234fac8d73ce5b3c5a9bcf4b3a647920809fa19bc06b40b1e64d5f0b9028f\": container with ID starting with 712234fac8d73ce5b3c5a9bcf4b3a647920809fa19bc06b40b1e64d5f0b9028f not found: ID does not exist" Jul 07 15:42:25.059494 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:25.059467 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ffd9f758b-k2tzq"] Jul 07 15:42:25.063637 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:25.063609 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5ffd9f758b-k2tzq"] Jul 07 15:42:26.377510 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:26.377475 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e1f9b3f-867e-473c-b19e-76e8e9a38c67" path="/var/lib/kubelet/pods/4e1f9b3f-867e-473c-b19e-76e8e9a38c67/volumes" Jul 07 15:42:27.916812 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:27.916490 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hppz7" Jul 07 15:42:28.702457 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:28.702427 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:42:28.706793 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:28.706768 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-86b4d47b78-hzms4" Jul 07 15:42:50.574794 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:50.574757 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:42:50.595099 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:50.595072 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:42:51.165497 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:42:51.165462 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:43:00.167302 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:00.167264 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:00.224923 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:00.224884 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:12.086263 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:12.086224 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:12.145190 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:12.145157 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:13.512147 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:13.512112 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:13.621684 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:13.621646 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:13.672589 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:13.672559 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:14.431050 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:14.431015 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:14.481247 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:14.481213 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:17.093283 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:17.093249 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:17.197113 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:17.197076 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:18.998834 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:18.998795 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:24.544682 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:24.544647 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:24.660693 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:24.660660 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:24.715690 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:24.715658 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:40.153911 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:40.153879 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:44.111833 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:44.111796 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:54.880369 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:54.880331 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:54.976380 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:43:54.976350 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:21.800624 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:21.800585 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:22.710782 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:22.710705 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:25.418059 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:25.418026 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:25.519969 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:25.519916 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:27.196358 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:27.196322 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:27.328955 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:27.328922 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:27.708972 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:27.708912 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:27.806120 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:27.806090 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:27.964580 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:27.964510 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h67pm"] Jul 07 15:44:27.964875 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:27.964825 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bae9f32-8033-4347-9006-a2ffe3bcbe5d" containerName="console" Jul 07 15:44:27.964875 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:27.964841 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bae9f32-8033-4347-9006-a2ffe3bcbe5d" containerName="console" Jul 07 15:44:27.964875 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:27.964878 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e1f9b3f-867e-473c-b19e-76e8e9a38c67" containerName="console" Jul 07 15:44:27.964875 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:27.964884 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e1f9b3f-867e-473c-b19e-76e8e9a38c67" containerName="console" Jul 07 15:44:27.965174 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:27.964946 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e1f9b3f-867e-473c-b19e-76e8e9a38c67" containerName="console" Jul 07 15:44:27.965174 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:27.964957 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bae9f32-8033-4347-9006-a2ffe3bcbe5d" containerName="console" Jul 07 15:44:27.966814 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:27.966799 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-h67pm" Jul 07 15:44:27.969504 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:27.969487 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 15:44:27.969623 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:27.969561 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7z78f\"" Jul 07 15:44:27.969777 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:27.969757 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 15:44:27.978220 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:27.978198 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h67pm"] Jul 07 15:44:28.014958 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:28.014919 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgmmr\" (UniqueName: \"kubernetes.io/projected/6146c95d-27a2-4212-8f71-54b7db6050d4-kube-api-access-mgmmr\") pod \"cert-manager-webhook-6486ffd997-h67pm\" (UID: \"6146c95d-27a2-4212-8f71-54b7db6050d4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h67pm" Jul 07 15:44:28.015119 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:28.014972 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6146c95d-27a2-4212-8f71-54b7db6050d4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h67pm\" (UID: \"6146c95d-27a2-4212-8f71-54b7db6050d4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h67pm" Jul 07 15:44:28.115705 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:28.115666 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgmmr\" (UniqueName: \"kubernetes.io/projected/6146c95d-27a2-4212-8f71-54b7db6050d4-kube-api-access-mgmmr\") pod \"cert-manager-webhook-6486ffd997-h67pm\" (UID: \"6146c95d-27a2-4212-8f71-54b7db6050d4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h67pm" Jul 07 15:44:28.115705 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:28.115705 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6146c95d-27a2-4212-8f71-54b7db6050d4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h67pm\" (UID: \"6146c95d-27a2-4212-8f71-54b7db6050d4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h67pm" Jul 07 15:44:28.125511 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:28.125478 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6146c95d-27a2-4212-8f71-54b7db6050d4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h67pm\" (UID: \"6146c95d-27a2-4212-8f71-54b7db6050d4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h67pm" Jul 07 15:44:28.125649 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:28.125606 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgmmr\" (UniqueName: \"kubernetes.io/projected/6146c95d-27a2-4212-8f71-54b7db6050d4-kube-api-access-mgmmr\") pod \"cert-manager-webhook-6486ffd997-h67pm\" (UID: \"6146c95d-27a2-4212-8f71-54b7db6050d4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h67pm" Jul 07 15:44:28.287194 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:28.287111 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-h67pm" Jul 07 15:44:28.419171 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:28.419145 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h67pm"] Jul 07 15:44:28.421962 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:44:28.421931 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6146c95d_27a2_4212_8f71_54b7db6050d4.slice/crio-8a3a4ed957ffa2fd0df07f8421d914980f5530ecdeac3f0ba4413f8433055c69 WatchSource:0}: Error finding container 8a3a4ed957ffa2fd0df07f8421d914980f5530ecdeac3f0ba4413f8433055c69: Status 404 returned error can't find the container with id 8a3a4ed957ffa2fd0df07f8421d914980f5530ecdeac3f0ba4413f8433055c69 Jul 07 15:44:28.532400 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:28.532368 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-h67pm" event={"ID":"6146c95d-27a2-4212-8f71-54b7db6050d4","Type":"ContainerStarted","Data":"8a3a4ed957ffa2fd0df07f8421d914980f5530ecdeac3f0ba4413f8433055c69"} Jul 07 15:44:30.059804 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:30.059770 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:30.287306 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:30.287184 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:31.548484 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:31.548394 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-h67pm" event={"ID":"6146c95d-27a2-4212-8f71-54b7db6050d4","Type":"ContainerStarted","Data":"1d053a100358fc6547a4a8c38a64c1e088573571587e7577ad4cb9e7034b7e6e"} Jul 07 15:44:31.548823 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:31.548533 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-h67pm" Jul 07 15:44:31.568425 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:31.568367 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-h67pm" podStartSLOduration=1.694333103 podStartE2EDuration="4.568345948s" totalImagesPullingTime="2.874012845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:44:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:44:31.568126179 +0000 UTC m=+229.717986688" watchObservedRunningTime="2026-07-07 15:44:31.568345948 +0000 UTC m=+229.718206457" Jul 07 15:44:32.419943 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:32.419891 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:32.477825 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:32.477790 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:37.555083 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:37.555051 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-h67pm" Jul 07 15:44:37.703905 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:37.703872 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:38.406912 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:38.406871 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:38.506872 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:38.506817 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:40.239713 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:40.239682 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pm5hl"] Jul 07 15:44:40.242033 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:40.242018 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pm5hl" Jul 07 15:44:40.244840 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:40.244819 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-l77rz\"" Jul 07 15:44:40.252189 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:40.252164 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pm5hl"] Jul 07 15:44:40.324496 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:40.324458 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h2kh\" (UniqueName: \"kubernetes.io/projected/3f6fe077-e2b8-4c45-8b4c-49a4bf40d266-kube-api-access-4h2kh\") pod \"cert-manager-55b4d954d5-pm5hl\" (UID: \"3f6fe077-e2b8-4c45-8b4c-49a4bf40d266\") " pod="cert-manager/cert-manager-55b4d954d5-pm5hl" Jul 07 15:44:40.324668 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:40.324507 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f6fe077-e2b8-4c45-8b4c-49a4bf40d266-bound-sa-token\") pod \"cert-manager-55b4d954d5-pm5hl\" (UID: \"3f6fe077-e2b8-4c45-8b4c-49a4bf40d266\") " pod="cert-manager/cert-manager-55b4d954d5-pm5hl" Jul 07 15:44:40.425567 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:40.425535 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h2kh\" (UniqueName: \"kubernetes.io/projected/3f6fe077-e2b8-4c45-8b4c-49a4bf40d266-kube-api-access-4h2kh\") pod \"cert-manager-55b4d954d5-pm5hl\" (UID: \"3f6fe077-e2b8-4c45-8b4c-49a4bf40d266\") " pod="cert-manager/cert-manager-55b4d954d5-pm5hl" Jul 07 15:44:40.425708 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:40.425578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f6fe077-e2b8-4c45-8b4c-49a4bf40d266-bound-sa-token\") pod \"cert-manager-55b4d954d5-pm5hl\" (UID: \"3f6fe077-e2b8-4c45-8b4c-49a4bf40d266\") " pod="cert-manager/cert-manager-55b4d954d5-pm5hl" Jul 07 15:44:40.433890 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:40.433846 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f6fe077-e2b8-4c45-8b4c-49a4bf40d266-bound-sa-token\") pod \"cert-manager-55b4d954d5-pm5hl\" (UID: \"3f6fe077-e2b8-4c45-8b4c-49a4bf40d266\") " pod="cert-manager/cert-manager-55b4d954d5-pm5hl" Jul 07 15:44:40.434121 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:40.434101 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h2kh\" (UniqueName: \"kubernetes.io/projected/3f6fe077-e2b8-4c45-8b4c-49a4bf40d266-kube-api-access-4h2kh\") pod \"cert-manager-55b4d954d5-pm5hl\" (UID: \"3f6fe077-e2b8-4c45-8b4c-49a4bf40d266\") " pod="cert-manager/cert-manager-55b4d954d5-pm5hl" Jul 07 15:44:40.550416 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:40.550330 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pm5hl" Jul 07 15:44:40.707794 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:40.707761 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pm5hl"] Jul 07 15:44:40.711744 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:44:40.711716 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f6fe077_e2b8_4c45_8b4c_49a4bf40d266.slice/crio-9eb6bffcbea168ba339923419f360c463c79c7d6330fb2d23be0c5d30d31b3bb WatchSource:0}: Error finding container 9eb6bffcbea168ba339923419f360c463c79c7d6330fb2d23be0c5d30d31b3bb: Status 404 returned error can't find the container with id 9eb6bffcbea168ba339923419f360c463c79c7d6330fb2d23be0c5d30d31b3bb Jul 07 15:44:41.590404 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:41.590371 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pm5hl" event={"ID":"3f6fe077-e2b8-4c45-8b4c-49a4bf40d266","Type":"ContainerStarted","Data":"0c00558e752c3fbc4e728b37acd4c5104e1b0c22df83d4693377108581414ec4"} Jul 07 15:44:41.590841 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:41.590412 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pm5hl" event={"ID":"3f6fe077-e2b8-4c45-8b4c-49a4bf40d266","Type":"ContainerStarted","Data":"9eb6bffcbea168ba339923419f360c463c79c7d6330fb2d23be0c5d30d31b3bb"} Jul 07 15:44:41.611197 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:41.611147 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-pm5hl" podStartSLOduration=1.611131995 podStartE2EDuration="1.611131995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:44:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:44:41.609589231 +0000 UTC m=+239.759449738" watchObservedRunningTime="2026-07-07 15:44:41.611131995 +0000 UTC m=+239.760992501" Jul 07 15:44:46.541920 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:46.541887 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:46.647157 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:46.647122 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:48.250499 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:48.250463 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:58.609568 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:58.609526 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:58.705863 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:44:58.705827 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:00.616384 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:00.616346 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:00.737583 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:00.737554 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:01.272462 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.272426 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:01.508149 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.508113 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:01.615337 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.615189 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:01.709744 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.709704 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd"] Jul 07 15:45:01.712488 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.712469 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:01.716286 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.716259 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 15:45:01.716774 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.716747 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 15:45:01.717373 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.717341 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 15:45:01.717490 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.717390 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 15:45:01.717552 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.717499 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-z46jf\"" Jul 07 15:45:01.755437 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.755401 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd"] Jul 07 15:45:01.816937 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.816899 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72ee07b1-5fc0-4b69-94b0-76f06b763edf-tmp\") pod \"opendatahub-operator-controller-manager-77db849c7c-vvlzd\" (UID: \"72ee07b1-5fc0-4b69-94b0-76f06b763edf\") " pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:01.816937 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.816944 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/72ee07b1-5fc0-4b69-94b0-76f06b763edf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77db849c7c-vvlzd\" (UID: \"72ee07b1-5fc0-4b69-94b0-76f06b763edf\") " pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:01.817155 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.816983 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/72ee07b1-5fc0-4b69-94b0-76f06b763edf-manifests\") pod \"opendatahub-operator-controller-manager-77db849c7c-vvlzd\" (UID: \"72ee07b1-5fc0-4b69-94b0-76f06b763edf\") " pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:01.817155 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.817014 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72ee07b1-5fc0-4b69-94b0-76f06b763edf-webhook-cert\") pod \"opendatahub-operator-controller-manager-77db849c7c-vvlzd\" (UID: \"72ee07b1-5fc0-4b69-94b0-76f06b763edf\") " pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:01.817155 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.817061 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqq95\" (UniqueName: \"kubernetes.io/projected/72ee07b1-5fc0-4b69-94b0-76f06b763edf-kube-api-access-tqq95\") pod \"opendatahub-operator-controller-manager-77db849c7c-vvlzd\" (UID: \"72ee07b1-5fc0-4b69-94b0-76f06b763edf\") " pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:01.918176 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.918139 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72ee07b1-5fc0-4b69-94b0-76f06b763edf-tmp\") pod \"opendatahub-operator-controller-manager-77db849c7c-vvlzd\" (UID: \"72ee07b1-5fc0-4b69-94b0-76f06b763edf\") " pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:01.918381 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.918182 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/72ee07b1-5fc0-4b69-94b0-76f06b763edf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77db849c7c-vvlzd\" (UID: \"72ee07b1-5fc0-4b69-94b0-76f06b763edf\") " pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:01.918381 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.918224 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/72ee07b1-5fc0-4b69-94b0-76f06b763edf-manifests\") pod \"opendatahub-operator-controller-manager-77db849c7c-vvlzd\" (UID: \"72ee07b1-5fc0-4b69-94b0-76f06b763edf\") " pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:01.918381 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.918240 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72ee07b1-5fc0-4b69-94b0-76f06b763edf-webhook-cert\") pod \"opendatahub-operator-controller-manager-77db849c7c-vvlzd\" (UID: \"72ee07b1-5fc0-4b69-94b0-76f06b763edf\") " pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:01.918381 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.918270 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqq95\" (UniqueName: \"kubernetes.io/projected/72ee07b1-5fc0-4b69-94b0-76f06b763edf-kube-api-access-tqq95\") pod \"opendatahub-operator-controller-manager-77db849c7c-vvlzd\" (UID: \"72ee07b1-5fc0-4b69-94b0-76f06b763edf\") " pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:01.918712 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.918691 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/72ee07b1-5fc0-4b69-94b0-76f06b763edf-manifests\") pod \"opendatahub-operator-controller-manager-77db849c7c-vvlzd\" (UID: \"72ee07b1-5fc0-4b69-94b0-76f06b763edf\") " pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:01.920915 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.920889 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72ee07b1-5fc0-4b69-94b0-76f06b763edf-tmp\") pod \"opendatahub-operator-controller-manager-77db849c7c-vvlzd\" (UID: \"72ee07b1-5fc0-4b69-94b0-76f06b763edf\") " pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:01.921152 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.921129 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72ee07b1-5fc0-4b69-94b0-76f06b763edf-webhook-cert\") pod \"opendatahub-operator-controller-manager-77db849c7c-vvlzd\" (UID: \"72ee07b1-5fc0-4b69-94b0-76f06b763edf\") " pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:01.921550 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.921531 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/72ee07b1-5fc0-4b69-94b0-76f06b763edf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77db849c7c-vvlzd\" (UID: \"72ee07b1-5fc0-4b69-94b0-76f06b763edf\") " pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:01.930139 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.930109 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:01.931350 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:01.931329 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqq95\" (UniqueName: \"kubernetes.io/projected/72ee07b1-5fc0-4b69-94b0-76f06b763edf-kube-api-access-tqq95\") pod \"opendatahub-operator-controller-manager-77db849c7c-vvlzd\" (UID: \"72ee07b1-5fc0-4b69-94b0-76f06b763edf\") " pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:02.023880 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:02.023827 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:02.024965 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:02.024941 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:02.093063 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:02.093029 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:02.177049 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:02.177018 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd"] Jul 07 15:45:02.179791 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:45:02.179763 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ee07b1_5fc0_4b69_94b0_76f06b763edf.slice/crio-5a8c61d5b57e6fcbc7c1cc89a22c89b2d2005989f983694dd47b9d671ee07d69 WatchSource:0}: Error finding container 5a8c61d5b57e6fcbc7c1cc89a22c89b2d2005989f983694dd47b9d671ee07d69: Status 404 returned error can't find the container with id 5a8c61d5b57e6fcbc7c1cc89a22c89b2d2005989f983694dd47b9d671ee07d69 Jul 07 15:45:02.182749 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:02.182724 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:02.285380 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:02.285347 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:02.443205 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:02.443098 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:02.544838 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:02.544744 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:02.676426 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:02.676393 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" event={"ID":"72ee07b1-5fc0-4b69-94b0-76f06b763edf","Type":"ContainerStarted","Data":"5a8c61d5b57e6fcbc7c1cc89a22c89b2d2005989f983694dd47b9d671ee07d69"} Jul 07 15:45:06.699400 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:06.699355 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" event={"ID":"72ee07b1-5fc0-4b69-94b0-76f06b763edf","Type":"ContainerStarted","Data":"51d46b9bc3448dc96e5dbb523ab538b593b47ae0eaf28c9ebde46247067e4a91"} Jul 07 15:45:07.148920 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:07.148884 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:07.203685 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:07.203638 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:07.705588 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:07.705560 2572 generic.go:356] "Generic (PLEG): container finished" podID="72ee07b1-5fc0-4b69-94b0-76f06b763edf" containerID="51d46b9bc3448dc96e5dbb523ab538b593b47ae0eaf28c9ebde46247067e4a91" exitCode=0 Jul 07 15:45:07.706007 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:07.705657 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" event={"ID":"72ee07b1-5fc0-4b69-94b0-76f06b763edf","Type":"ContainerDied","Data":"51d46b9bc3448dc96e5dbb523ab538b593b47ae0eaf28c9ebde46247067e4a91"} Jul 07 15:45:08.711727 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:08.711693 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" event={"ID":"72ee07b1-5fc0-4b69-94b0-76f06b763edf","Type":"ContainerStarted","Data":"2be1e6cdb8c69a8016902fb7d9f244de0b068783c34cb0dfb2da90e5d04f916a"} Jul 07 15:45:08.712120 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:08.711809 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:08.737354 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:08.737306 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" podStartSLOduration=2.5495965160000003 podStartE2EDuration="7.737289754s" totalImagesPullingTime="4.041001324s" totalInitContainerRuntime="1.146691914s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:45:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:45:08.735801871 +0000 UTC m=+266.885662380" watchObservedRunningTime="2026-07-07 15:45:08.737289754 +0000 UTC m=+266.887150259" Jul 07 15:45:10.592498 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:10.592459 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:10.691484 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:10.691425 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:18.680265 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:18.680223 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:19.718140 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:19.718109 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77db849c7c-vvlzd" Jul 07 15:45:20.122525 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:20.122494 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:21.348215 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:21.348179 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:21.468303 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:21.468257 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:22.184779 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:22.184750 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:22.282283 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:22.282252 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:22.379299 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:22.379267 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:22.804468 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:22.804439 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:22.913667 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:22.913638 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:27.263411 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:27.263380 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:28.003831 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:28.003796 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:29.025963 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.025911 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:29.121840 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.121810 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:29.375583 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.375552 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-778944b866-hr7fh"] Jul 07 15:45:29.383871 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.383831 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" Jul 07 15:45:29.390600 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.390470 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mv4kw\"" Jul 07 15:45:29.391194 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.391177 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 15:45:29.391654 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.391637 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 15:45:29.391806 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.391679 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 15:45:29.392253 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.392238 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 15:45:29.411769 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.411723 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:45:29.427636 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.427608 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-778944b866-hr7fh"] Jul 07 15:45:29.468152 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.468120 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3704b84a-741b-4c09-8ece-4b0a0598883a-cert\") pod \"lws-controller-manager-778944b866-hr7fh\" (UID: \"3704b84a-741b-4c09-8ece-4b0a0598883a\") " pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" Jul 07 15:45:29.468300 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.468168 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3704b84a-741b-4c09-8ece-4b0a0598883a-metrics-cert\") pod \"lws-controller-manager-778944b866-hr7fh\" (UID: \"3704b84a-741b-4c09-8ece-4b0a0598883a\") " pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" Jul 07 15:45:29.468300 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.468264 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsbrj\" (UniqueName: \"kubernetes.io/projected/3704b84a-741b-4c09-8ece-4b0a0598883a-kube-api-access-jsbrj\") pod \"lws-controller-manager-778944b866-hr7fh\" (UID: \"3704b84a-741b-4c09-8ece-4b0a0598883a\") " pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" Jul 07 15:45:29.468300 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.468294 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3704b84a-741b-4c09-8ece-4b0a0598883a-manager-config\") pod \"lws-controller-manager-778944b866-hr7fh\" (UID: \"3704b84a-741b-4c09-8ece-4b0a0598883a\") " pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" Jul 07 15:45:29.569188 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.569141 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsbrj\" (UniqueName: \"kubernetes.io/projected/3704b84a-741b-4c09-8ece-4b0a0598883a-kube-api-access-jsbrj\") pod \"lws-controller-manager-778944b866-hr7fh\" (UID: \"3704b84a-741b-4c09-8ece-4b0a0598883a\") " pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" Jul 07 15:45:29.569188 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.569187 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3704b84a-741b-4c09-8ece-4b0a0598883a-manager-config\") pod \"lws-controller-manager-778944b866-hr7fh\" (UID: \"3704b84a-741b-4c09-8ece-4b0a0598883a\") " pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" Jul 07 15:45:29.569446 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.569263 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3704b84a-741b-4c09-8ece-4b0a0598883a-cert\") pod \"lws-controller-manager-778944b866-hr7fh\" (UID: \"3704b84a-741b-4c09-8ece-4b0a0598883a\") " pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" Jul 07 15:45:29.569446 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.569290 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3704b84a-741b-4c09-8ece-4b0a0598883a-metrics-cert\") pod \"lws-controller-manager-778944b866-hr7fh\" (UID: \"3704b84a-741b-4c09-8ece-4b0a0598883a\") " pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" Jul 07 15:45:29.570004 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.569979 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3704b84a-741b-4c09-8ece-4b0a0598883a-manager-config\") pod \"lws-controller-manager-778944b866-hr7fh\" (UID: \"3704b84a-741b-4c09-8ece-4b0a0598883a\") " pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" Jul 07 15:45:29.571826 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.571800 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3704b84a-741b-4c09-8ece-4b0a0598883a-metrics-cert\") pod \"lws-controller-manager-778944b866-hr7fh\" (UID: \"3704b84a-741b-4c09-8ece-4b0a0598883a\") " pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" Jul 07 15:45:29.571976 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.571959 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3704b84a-741b-4c09-8ece-4b0a0598883a-cert\") pod \"lws-controller-manager-778944b866-hr7fh\" (UID: \"3704b84a-741b-4c09-8ece-4b0a0598883a\") " pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" Jul 07 15:45:29.589640 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.589615 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsbrj\" (UniqueName: \"kubernetes.io/projected/3704b84a-741b-4c09-8ece-4b0a0598883a-kube-api-access-jsbrj\") pod \"lws-controller-manager-778944b866-hr7fh\" (UID: \"3704b84a-741b-4c09-8ece-4b0a0598883a\") " pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" Jul 07 15:45:29.693813 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.693728 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" Jul 07 15:45:29.829948 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:29.829910 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-778944b866-hr7fh"] Jul 07 15:45:29.834574 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:45:29.834544 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3704b84a_741b_4c09_8ece_4b0a0598883a.slice/crio-17d523bee6a4df5a6fd2287e1d5d5b53e35a2f94cdd340d58cccdd9b8d21a221 WatchSource:0}: Error finding container 17d523bee6a4df5a6fd2287e1d5d5b53e35a2f94cdd340d58cccdd9b8d21a221: Status 404 returned error can't find the container with id 17d523bee6a4df5a6fd2287e1d5d5b53e35a2f94cdd340d58cccdd9b8d21a221 Jul 07 15:45:30.685298 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.685260 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b"] Jul 07 15:45:30.689074 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.689046 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.696427 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.696391 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 15:45:30.696559 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.696391 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 15:45:30.698419 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.698399 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 15:45:30.698655 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.698401 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 15:45:30.698655 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.698545 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 15:45:30.698655 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.698593 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 15:45:30.698655 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.698644 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7nvd4\"" Jul 07 15:45:30.724357 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.724279 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b"] Jul 07 15:45:30.781623 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.781459 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5f5ad39c-5329-49c7-883c-67d1074bf5d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.781623 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.781506 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f5ad39c-5329-49c7-883c-67d1074bf5d4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.781623 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.781542 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f5ad39c-5329-49c7-883c-67d1074bf5d4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.781623 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.781573 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f5ad39c-5329-49c7-883c-67d1074bf5d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.781623 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.781591 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5f5ad39c-5329-49c7-883c-67d1074bf5d4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.781623 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.781614 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5jfk\" (UniqueName: \"kubernetes.io/projected/5f5ad39c-5329-49c7-883c-67d1074bf5d4-kube-api-access-k5jfk\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.782076 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.781691 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5f5ad39c-5329-49c7-883c-67d1074bf5d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.797667 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.797628 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:30.816070 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.816027 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" event={"ID":"3704b84a-741b-4c09-8ece-4b0a0598883a","Type":"ContainerStarted","Data":"17d523bee6a4df5a6fd2287e1d5d5b53e35a2f94cdd340d58cccdd9b8d21a221"} Jul 07 15:45:30.882838 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.882795 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5f5ad39c-5329-49c7-883c-67d1074bf5d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.883043 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.882939 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5f5ad39c-5329-49c7-883c-67d1074bf5d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.883043 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.882975 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f5ad39c-5329-49c7-883c-67d1074bf5d4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.883043 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.883025 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f5ad39c-5329-49c7-883c-67d1074bf5d4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.883221 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.883053 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f5ad39c-5329-49c7-883c-67d1074bf5d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.883221 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.883081 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5f5ad39c-5329-49c7-883c-67d1074bf5d4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.883221 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.883111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5jfk\" (UniqueName: \"kubernetes.io/projected/5f5ad39c-5329-49c7-883c-67d1074bf5d4-kube-api-access-k5jfk\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.883896 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.883476 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5f5ad39c-5329-49c7-883c-67d1074bf5d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.886289 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.886264 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5f5ad39c-5329-49c7-883c-67d1074bf5d4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.886507 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.886446 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5f5ad39c-5329-49c7-883c-67d1074bf5d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.886654 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.886634 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f5ad39c-5329-49c7-883c-67d1074bf5d4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.887138 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.887113 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f5ad39c-5329-49c7-883c-67d1074bf5d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.894763 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.894737 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f5ad39c-5329-49c7-883c-67d1074bf5d4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:30.895266 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:30.895241 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5jfk\" (UniqueName: \"kubernetes.io/projected/5f5ad39c-5329-49c7-883c-67d1074bf5d4-kube-api-access-k5jfk\") pod \"istiod-openshift-gateway-94bb8fbfd-m8h2b\" (UID: \"5f5ad39c-5329-49c7-883c-67d1074bf5d4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:31.002727 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:31.002647 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:31.181966 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:31.181736 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b"] Jul 07 15:45:32.164902 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:45:32.164818 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f5ad39c_5329_49c7_883c_67d1074bf5d4.slice/crio-f8438243ac2738dfb4921b561dd63681a082d384d53285f0cbcb3fcb4467e253 WatchSource:0}: Error finding container f8438243ac2738dfb4921b561dd63681a082d384d53285f0cbcb3fcb4467e253: Status 404 returned error can't find the container with id f8438243ac2738dfb4921b561dd63681a082d384d53285f0cbcb3fcb4467e253 Jul 07 15:45:32.830371 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:32.830276 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" event={"ID":"3704b84a-741b-4c09-8ece-4b0a0598883a","Type":"ContainerStarted","Data":"42e0ac7bb19e9cdba292ffbf559220522a36a58af6600f18d9858b46afc568ec"} Jul 07 15:45:32.830371 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:32.830342 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" Jul 07 15:45:32.831976 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:32.831947 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" event={"ID":"5f5ad39c-5329-49c7-883c-67d1074bf5d4","Type":"ContainerStarted","Data":"f8438243ac2738dfb4921b561dd63681a082d384d53285f0cbcb3fcb4467e253"} Jul 07 15:45:32.883272 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:32.883122 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" podStartSLOduration=1.489235927 podStartE2EDuration="3.883098075s" totalImagesPullingTime="2.393862148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:45:32.881753132 +0000 UTC m=+291.031613639" watchObservedRunningTime="2026-07-07 15:45:32.883098075 +0000 UTC m=+291.032958581" Jul 07 15:45:33.177592 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:33.177559 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:33.313842 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:33.313641 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:33.418382 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:33.418342 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:33.541454 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:33.541372 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:33.656299 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:33.656263 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:33.833233 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:33.833154 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:33.947771 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:33.947735 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:34.124306 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:34.124271 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:34.292817 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:34.292784 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:34.593166 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:34.593121 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 15:45:34.593333 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:34.593204 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 15:45:34.849187 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:34.848624 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" event={"ID":"5f5ad39c-5329-49c7-883c-67d1074bf5d4","Type":"ContainerStarted","Data":"05446f0eda11393356d611ef254d0f8e06a775d0e14c74e9765c58a746e0f9e0"} Jul 07 15:45:34.849187 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:34.848701 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:34.897040 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:34.896979 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" podStartSLOduration=2.471245946 podStartE2EDuration="4.896956409s" totalImagesPullingTime="2.425710463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:45:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:45:34.895262419 +0000 UTC m=+293.045122926" watchObservedRunningTime="2026-07-07 15:45:34.896956409 +0000 UTC m=+293.046816916" Jul 07 15:45:35.855235 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:35.855206 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m8h2b" Jul 07 15:45:42.257660 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:42.257634 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 15:45:42.260348 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:42.260325 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 15:45:42.262954 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:42.262934 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 15:45:43.843013 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:43.842976 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-778944b866-hr7fh" Jul 07 15:45:44.247076 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:44.247046 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:44.345042 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:45:44.345002 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:11.845197 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:46:11.845155 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:11.943415 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:46:11.943379 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:12.515138 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:46:12.515102 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:12.568701 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:46:12.568671 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:14.361467 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:46:14.361430 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:14.421691 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:46:14.421652 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:22.902991 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:46:22.902959 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:23.002524 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:46:23.002490 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:23.074528 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:46:23.074488 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:23.819831 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:46:23.819790 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:24.021291 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:46:24.021248 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:28.091870 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:46:28.091831 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:45.081912 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:46:45.081846 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:51.753445 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:46:51.753402 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:55.960273 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:46:55.960238 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:58.580167 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:46:58.580136 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:00.178946 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:00.178907 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:01.619770 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:01.619730 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:03.144847 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:03.144808 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:03.441476 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:03.441391 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:03.739534 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:03.739446 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:06.051499 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:06.051464 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:06.164538 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:06.164508 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:08.551291 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:08.551251 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:08.624117 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:08.624086 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:10.559395 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:10.559367 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:10.655493 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:10.655458 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:13.692674 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:13.692640 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:14.301884 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:14.301833 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:15.746138 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:15.746092 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:15.809303 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:15.809268 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:23.753245 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:23.753209 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh"] Jul 07 15:47:23.755545 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:23.755528 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh" Jul 07 15:47:23.758841 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:23.758817 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bh7bf\"" Jul 07 15:47:23.759062 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:23.759042 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 15:47:23.759237 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:23.759119 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 15:47:23.773805 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:23.773767 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh"] Jul 07 15:47:23.858780 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:23.858748 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh"] Jul 07 15:47:23.859080 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:47:23.859061 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-slqj5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh" podUID="773a7586-0a97-43da-928a-c2815b4decfd" Jul 07 15:47:23.912013 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:23.911980 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/773a7586-0a97-43da-928a-c2815b4decfd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z4wvh\" (UID: \"773a7586-0a97-43da-928a-c2815b4decfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh" Jul 07 15:47:23.912196 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:23.912102 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slqj5\" (UniqueName: \"kubernetes.io/projected/773a7586-0a97-43da-928a-c2815b4decfd-kube-api-access-slqj5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z4wvh\" (UID: \"773a7586-0a97-43da-928a-c2815b4decfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh" Jul 07 15:47:23.999516 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:23.999478 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:24.012712 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.012646 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slqj5\" (UniqueName: \"kubernetes.io/projected/773a7586-0a97-43da-928a-c2815b4decfd-kube-api-access-slqj5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z4wvh\" (UID: \"773a7586-0a97-43da-928a-c2815b4decfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh" Jul 07 15:47:24.012712 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.012692 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/773a7586-0a97-43da-928a-c2815b4decfd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z4wvh\" (UID: \"773a7586-0a97-43da-928a-c2815b4decfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh" Jul 07 15:47:24.013085 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.013068 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/773a7586-0a97-43da-928a-c2815b4decfd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z4wvh\" (UID: \"773a7586-0a97-43da-928a-c2815b4decfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh" Jul 07 15:47:24.027886 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.027839 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slqj5\" (UniqueName: \"kubernetes.io/projected/773a7586-0a97-43da-928a-c2815b4decfd-kube-api-access-slqj5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z4wvh\" (UID: \"773a7586-0a97-43da-928a-c2815b4decfd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh" Jul 07 15:47:24.100242 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.100206 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:24.349984 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.349896 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh" Jul 07 15:47:24.356899 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.356875 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh" Jul 07 15:47:24.357263 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.357245 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh"] Jul 07 15:47:24.366520 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.366497 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh"] Jul 07 15:47:24.374688 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:47:24.374654 2572 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"773a7586-0a97-43da-928a-c2815b4decfd\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-6fb7879bc9-z4wvh\": pods \"kuadrant-operator-controller-manager-6fb7879bc9-z4wvh\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh" Jul 07 15:47:24.377042 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:47:24.376999 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-z4wvh\" is forbidden: User \"system:node:ip-10-0-138-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-64.ec2.internal' and this object" podUID="773a7586-0a97-43da-928a-c2815b4decfd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh" Jul 07 15:47:24.429795 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.429769 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7"] Jul 07 15:47:24.432556 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.432536 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" Jul 07 15:47:24.456304 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.456265 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7"] Jul 07 15:47:24.515619 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.515589 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slqj5\" (UniqueName: \"kubernetes.io/projected/773a7586-0a97-43da-928a-c2815b4decfd-kube-api-access-slqj5\") pod \"773a7586-0a97-43da-928a-c2815b4decfd\" (UID: \"773a7586-0a97-43da-928a-c2815b4decfd\") " Jul 07 15:47:24.515810 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.515677 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/773a7586-0a97-43da-928a-c2815b4decfd-extensions-socket-volume\") pod \"773a7586-0a97-43da-928a-c2815b4decfd\" (UID: \"773a7586-0a97-43da-928a-c2815b4decfd\") " Jul 07 15:47:24.515810 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.515796 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbdkz\" (UniqueName: \"kubernetes.io/projected/c2f28055-f250-45b0-b960-d2b63ffffeef-kube-api-access-mbdkz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fcbl7\" (UID: \"c2f28055-f250-45b0-b960-d2b63ffffeef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" Jul 07 15:47:24.515958 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.515834 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2f28055-f250-45b0-b960-d2b63ffffeef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fcbl7\" (UID: \"c2f28055-f250-45b0-b960-d2b63ffffeef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" Jul 07 15:47:24.515958 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.515939 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773a7586-0a97-43da-928a-c2815b4decfd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "773a7586-0a97-43da-928a-c2815b4decfd" (UID: "773a7586-0a97-43da-928a-c2815b4decfd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:24.516056 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.516017 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/773a7586-0a97-43da-928a-c2815b4decfd-extensions-socket-volume\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:47:24.518003 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.517984 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773a7586-0a97-43da-928a-c2815b4decfd-kube-api-access-slqj5" (OuterVolumeSpecName: "kube-api-access-slqj5") pod "773a7586-0a97-43da-928a-c2815b4decfd" (UID: "773a7586-0a97-43da-928a-c2815b4decfd"). InnerVolumeSpecName "kube-api-access-slqj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:47:24.616515 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.616410 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbdkz\" (UniqueName: \"kubernetes.io/projected/c2f28055-f250-45b0-b960-d2b63ffffeef-kube-api-access-mbdkz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fcbl7\" (UID: \"c2f28055-f250-45b0-b960-d2b63ffffeef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" Jul 07 15:47:24.616515 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.616466 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2f28055-f250-45b0-b960-d2b63ffffeef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fcbl7\" (UID: \"c2f28055-f250-45b0-b960-d2b63ffffeef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" Jul 07 15:47:24.616515 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.616523 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slqj5\" (UniqueName: \"kubernetes.io/projected/773a7586-0a97-43da-928a-c2815b4decfd-kube-api-access-slqj5\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:47:24.616827 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.616812 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2f28055-f250-45b0-b960-d2b63ffffeef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fcbl7\" (UID: \"c2f28055-f250-45b0-b960-d2b63ffffeef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" Jul 07 15:47:24.625329 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.625298 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbdkz\" (UniqueName: \"kubernetes.io/projected/c2f28055-f250-45b0-b960-d2b63ffffeef-kube-api-access-mbdkz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fcbl7\" (UID: \"c2f28055-f250-45b0-b960-d2b63ffffeef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" Jul 07 15:47:24.743778 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.743736 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" Jul 07 15:47:24.920251 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.920228 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7"] Jul 07 15:47:24.922290 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:47:24.922267 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f28055_f250_45b0_b960_d2b63ffffeef.slice/crio-1f42bdf0e40c70d5884e30a74873fc751b157e3ee57d4ba05f53443a25339fa3 WatchSource:0}: Error finding container 1f42bdf0e40c70d5884e30a74873fc751b157e3ee57d4ba05f53443a25339fa3: Status 404 returned error can't find the container with id 1f42bdf0e40c70d5884e30a74873fc751b157e3ee57d4ba05f53443a25339fa3 Jul 07 15:47:24.924717 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:24.924701 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:47:25.206327 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:25.206243 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:25.298355 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:25.298320 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:25.356495 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:25.356457 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" event={"ID":"c2f28055-f250-45b0-b960-d2b63ffffeef","Type":"ContainerStarted","Data":"1f42bdf0e40c70d5884e30a74873fc751b157e3ee57d4ba05f53443a25339fa3"} Jul 07 15:47:25.356670 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:25.356476 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh" Jul 07 15:47:25.365982 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:47:25.365952 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-z4wvh\" is forbidden: User \"system:node:ip-10-0-138-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-64.ec2.internal' and this object" podUID="773a7586-0a97-43da-928a-c2815b4decfd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z4wvh" Jul 07 15:47:26.383504 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:26.383473 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="773a7586-0a97-43da-928a-c2815b4decfd" path="/var/lib/kubelet/pods/773a7586-0a97-43da-928a-c2815b4decfd/volumes" Jul 07 15:47:26.631000 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:26.630958 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:26.829006 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:26.828913 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:29.560346 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:29.560309 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:29.661956 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:29.661916 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:31.387575 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:31.387539 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" event={"ID":"c2f28055-f250-45b0-b960-d2b63ffffeef","Type":"ContainerStarted","Data":"9c653bcd7a62aa63451945a97db2bed9900617664efe1faaf6ba3538e856ece8"} Jul 07 15:47:31.388053 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:31.387638 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" Jul 07 15:47:31.414214 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:31.414159 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" podStartSLOduration=2.024706793 podStartE2EDuration="7.414140799s" totalImagesPullingTime="5.389434006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:47:31.411271243 +0000 UTC m=+409.561131746" watchObservedRunningTime="2026-07-07 15:47:31.414140799 +0000 UTC m=+409.564001307" Jul 07 15:47:33.562518 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:33.562478 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:33.643374 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:33.643339 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:42.393438 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:42.393404 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" Jul 07 15:47:43.358156 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:43.358122 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:43.420568 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:43.420541 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:44.160765 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:44.160717 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:44.397448 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:44.397412 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:50.911750 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:50.911713 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7"] Jul 07 15:47:50.912244 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:50.912015 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" podUID="c2f28055-f250-45b0-b960-d2b63ffffeef" containerName="manager" containerID="cri-o://9c653bcd7a62aa63451945a97db2bed9900617664efe1faaf6ba3538e856ece8" gracePeriod=10 Jul 07 15:47:51.191898 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:51.191800 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" Jul 07 15:47:51.251562 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:51.251528 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbdkz\" (UniqueName: \"kubernetes.io/projected/c2f28055-f250-45b0-b960-d2b63ffffeef-kube-api-access-mbdkz\") pod \"c2f28055-f250-45b0-b960-d2b63ffffeef\" (UID: \"c2f28055-f250-45b0-b960-d2b63ffffeef\") " Jul 07 15:47:51.251562 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:51.251565 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2f28055-f250-45b0-b960-d2b63ffffeef-extensions-socket-volume\") pod \"c2f28055-f250-45b0-b960-d2b63ffffeef\" (UID: \"c2f28055-f250-45b0-b960-d2b63ffffeef\") " Jul 07 15:47:51.251951 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:51.251923 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2f28055-f250-45b0-b960-d2b63ffffeef-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c2f28055-f250-45b0-b960-d2b63ffffeef" (UID: "c2f28055-f250-45b0-b960-d2b63ffffeef"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:51.253943 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:51.253907 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2f28055-f250-45b0-b960-d2b63ffffeef-kube-api-access-mbdkz" (OuterVolumeSpecName: "kube-api-access-mbdkz") pod "c2f28055-f250-45b0-b960-d2b63ffffeef" (UID: "c2f28055-f250-45b0-b960-d2b63ffffeef"). InnerVolumeSpecName "kube-api-access-mbdkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:47:51.352672 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:51.352634 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbdkz\" (UniqueName: \"kubernetes.io/projected/c2f28055-f250-45b0-b960-d2b63ffffeef-kube-api-access-mbdkz\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:47:51.352672 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:51.352665 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2f28055-f250-45b0-b960-d2b63ffffeef-extensions-socket-volume\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:47:51.479338 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:51.479249 2572 generic.go:356] "Generic (PLEG): container finished" podID="c2f28055-f250-45b0-b960-d2b63ffffeef" containerID="9c653bcd7a62aa63451945a97db2bed9900617664efe1faaf6ba3538e856ece8" exitCode=0 Jul 07 15:47:51.479338 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:51.479300 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" Jul 07 15:47:51.479506 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:51.479344 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" event={"ID":"c2f28055-f250-45b0-b960-d2b63ffffeef","Type":"ContainerDied","Data":"9c653bcd7a62aa63451945a97db2bed9900617664efe1faaf6ba3538e856ece8"} Jul 07 15:47:51.479506 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:51.479405 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7" event={"ID":"c2f28055-f250-45b0-b960-d2b63ffffeef","Type":"ContainerDied","Data":"1f42bdf0e40c70d5884e30a74873fc751b157e3ee57d4ba05f53443a25339fa3"} Jul 07 15:47:51.479506 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:51.479429 2572 scope.go:117] "RemoveContainer" containerID="9c653bcd7a62aa63451945a97db2bed9900617664efe1faaf6ba3538e856ece8" Jul 07 15:47:51.488907 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:51.488888 2572 scope.go:117] "RemoveContainer" containerID="9c653bcd7a62aa63451945a97db2bed9900617664efe1faaf6ba3538e856ece8" Jul 07 15:47:51.489216 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:47:51.489192 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c653bcd7a62aa63451945a97db2bed9900617664efe1faaf6ba3538e856ece8\": container with ID starting with 9c653bcd7a62aa63451945a97db2bed9900617664efe1faaf6ba3538e856ece8 not found: ID does not exist" containerID="9c653bcd7a62aa63451945a97db2bed9900617664efe1faaf6ba3538e856ece8" Jul 07 15:47:51.489292 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:51.489228 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c653bcd7a62aa63451945a97db2bed9900617664efe1faaf6ba3538e856ece8"} err="failed to get container status \"9c653bcd7a62aa63451945a97db2bed9900617664efe1faaf6ba3538e856ece8\": rpc error: code = NotFound desc = could not find container \"9c653bcd7a62aa63451945a97db2bed9900617664efe1faaf6ba3538e856ece8\": container with ID starting with 9c653bcd7a62aa63451945a97db2bed9900617664efe1faaf6ba3538e856ece8 not found: ID does not exist" Jul 07 15:47:51.503361 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:51.503331 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7"] Jul 07 15:47:51.516318 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:51.516282 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fcbl7"] Jul 07 15:47:52.377559 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:47:52.377517 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2f28055-f250-45b0-b960-d2b63ffffeef" path="/var/lib/kubelet/pods/c2f28055-f250-45b0-b960-d2b63ffffeef/volumes" Jul 07 15:48:07.316409 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.316326 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9"] Jul 07 15:48:07.316819 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.316687 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2f28055-f250-45b0-b960-d2b63ffffeef" containerName="manager" Jul 07 15:48:07.316819 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.316700 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2f28055-f250-45b0-b960-d2b63ffffeef" containerName="manager" Jul 07 15:48:07.316819 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.316771 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2f28055-f250-45b0-b960-d2b63ffffeef" containerName="manager" Jul 07 15:48:07.319731 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.319712 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.322340 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.322324 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4dr7z\"" Jul 07 15:48:07.334675 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.334653 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9"] Jul 07 15:48:07.343657 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.343622 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:07.494578 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.494536 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e589c1a2-1e65-4826-b0d7-4145df69b5b4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.494578 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.494575 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e589c1a2-1e65-4826-b0d7-4145df69b5b4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.494826 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.494739 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e589c1a2-1e65-4826-b0d7-4145df69b5b4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.494924 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.494817 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e589c1a2-1e65-4826-b0d7-4145df69b5b4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.494924 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.494907 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e589c1a2-1e65-4826-b0d7-4145df69b5b4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.495031 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.494955 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e589c1a2-1e65-4826-b0d7-4145df69b5b4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.495031 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.494981 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e589c1a2-1e65-4826-b0d7-4145df69b5b4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.495031 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.495015 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e589c1a2-1e65-4826-b0d7-4145df69b5b4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.495345 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.495322 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m87dj\" (UniqueName: \"kubernetes.io/projected/e589c1a2-1e65-4826-b0d7-4145df69b5b4-kube-api-access-m87dj\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.582044 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.581965 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:07.596660 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.596633 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e589c1a2-1e65-4826-b0d7-4145df69b5b4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.596758 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.596665 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e589c1a2-1e65-4826-b0d7-4145df69b5b4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.596758 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.596683 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e589c1a2-1e65-4826-b0d7-4145df69b5b4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.596758 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.596703 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e589c1a2-1e65-4826-b0d7-4145df69b5b4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.596758 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.596726 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e589c1a2-1e65-4826-b0d7-4145df69b5b4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.596962 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.596775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m87dj\" (UniqueName: \"kubernetes.io/projected/e589c1a2-1e65-4826-b0d7-4145df69b5b4-kube-api-access-m87dj\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.596962 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.596873 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e589c1a2-1e65-4826-b0d7-4145df69b5b4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.597061 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.596995 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e589c1a2-1e65-4826-b0d7-4145df69b5b4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.597116 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.597075 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e589c1a2-1e65-4826-b0d7-4145df69b5b4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.597116 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.597086 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e589c1a2-1e65-4826-b0d7-4145df69b5b4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.597274 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.597140 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e589c1a2-1e65-4826-b0d7-4145df69b5b4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.597274 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.597188 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e589c1a2-1e65-4826-b0d7-4145df69b5b4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.597510 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.597486 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e589c1a2-1e65-4826-b0d7-4145df69b5b4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.597615 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.597593 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e589c1a2-1e65-4826-b0d7-4145df69b5b4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.599283 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.599261 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e589c1a2-1e65-4826-b0d7-4145df69b5b4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.599406 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.599389 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e589c1a2-1e65-4826-b0d7-4145df69b5b4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.605738 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.605715 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e589c1a2-1e65-4826-b0d7-4145df69b5b4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.606174 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.606152 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m87dj\" (UniqueName: \"kubernetes.io/projected/e589c1a2-1e65-4826-b0d7-4145df69b5b4-kube-api-access-m87dj\") pod \"maas-default-gateway-openshift-default-56654dcf7-9lxm9\" (UID: \"e589c1a2-1e65-4826-b0d7-4145df69b5b4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.629684 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.629657 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:07.769038 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:07.769012 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9"] Jul 07 15:48:07.771646 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:48:07.771611 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode589c1a2_1e65_4826_b0d7_4145df69b5b4.slice/crio-598adf1d194ccb0f37332ffec3ee1e2c33ccb44dcf54ca8483833049f9b7522b WatchSource:0}: Error finding container 598adf1d194ccb0f37332ffec3ee1e2c33ccb44dcf54ca8483833049f9b7522b: Status 404 returned error can't find the container with id 598adf1d194ccb0f37332ffec3ee1e2c33ccb44dcf54ca8483833049f9b7522b Jul 07 15:48:08.559141 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:08.559105 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" event={"ID":"e589c1a2-1e65-4826-b0d7-4145df69b5b4","Type":"ContainerStarted","Data":"598adf1d194ccb0f37332ffec3ee1e2c33ccb44dcf54ca8483833049f9b7522b"} Jul 07 15:48:10.257624 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:10.257587 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 15:48:10.258024 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:10.257673 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 15:48:10.258024 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:10.257717 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 15:48:10.570486 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:10.570388 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" event={"ID":"e589c1a2-1e65-4826-b0d7-4145df69b5b4","Type":"ContainerStarted","Data":"b21b989ddaee759eb57686c22beda027032f50a922c57b98a1a12c7fa323eab3"} Jul 07 15:48:10.595907 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:10.595834 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" podStartSLOduration=1.112582397 podStartE2EDuration="3.59581998s" totalImagesPullingTime="2.483237583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:48:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:48:10.594318951 +0000 UTC m=+448.744179458" watchObservedRunningTime="2026-07-07 15:48:10.59581998 +0000 UTC m=+448.745680483" Jul 07 15:48:10.630607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:10.630580 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:11.610055 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.610021 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:11.623081 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.623047 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tq79c"] Jul 07 15:48:11.626587 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.626566 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" Jul 07 15:48:11.629212 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.629186 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 15:48:11.629450 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.629433 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 15:48:11.629543 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.629470 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 15:48:11.630249 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.630229 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gnpsb\"" Jul 07 15:48:11.635168 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.635148 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:11.640599 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.640572 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tq79c"] Jul 07 15:48:11.716312 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.716280 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tq79c"] Jul 07 15:48:11.734006 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.733975 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:11.737348 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.737323 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbj2k\" (UniqueName: \"kubernetes.io/projected/bd8636e9-2db8-4b5a-905d-770ac7f34c6c-kube-api-access-fbj2k\") pod \"limitador-limitador-64c94fd64f-tq79c\" (UID: \"bd8636e9-2db8-4b5a-905d-770ac7f34c6c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" Jul 07 15:48:11.737496 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.737480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd8636e9-2db8-4b5a-905d-770ac7f34c6c-config-file\") pod \"limitador-limitador-64c94fd64f-tq79c\" (UID: \"bd8636e9-2db8-4b5a-905d-770ac7f34c6c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" Jul 07 15:48:11.814021 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.813980 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:11.838300 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.838272 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbj2k\" (UniqueName: \"kubernetes.io/projected/bd8636e9-2db8-4b5a-905d-770ac7f34c6c-kube-api-access-fbj2k\") pod \"limitador-limitador-64c94fd64f-tq79c\" (UID: \"bd8636e9-2db8-4b5a-905d-770ac7f34c6c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" Jul 07 15:48:11.838476 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.838321 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd8636e9-2db8-4b5a-905d-770ac7f34c6c-config-file\") pod \"limitador-limitador-64c94fd64f-tq79c\" (UID: \"bd8636e9-2db8-4b5a-905d-770ac7f34c6c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" Jul 07 15:48:11.839072 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.839043 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd8636e9-2db8-4b5a-905d-770ac7f34c6c-config-file\") pod \"limitador-limitador-64c94fd64f-tq79c\" (UID: \"bd8636e9-2db8-4b5a-905d-770ac7f34c6c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" Jul 07 15:48:11.851602 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.851577 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbj2k\" (UniqueName: \"kubernetes.io/projected/bd8636e9-2db8-4b5a-905d-770ac7f34c6c-kube-api-access-fbj2k\") pod \"limitador-limitador-64c94fd64f-tq79c\" (UID: \"bd8636e9-2db8-4b5a-905d-770ac7f34c6c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" Jul 07 15:48:11.937673 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:11.937633 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" Jul 07 15:48:12.074202 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:12.074131 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tq79c"] Jul 07 15:48:12.076572 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:48:12.076538 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8636e9_2db8_4b5a_905d_770ac7f34c6c.slice/crio-fbcfea3d4a19d49c7d480d3e04b4127f53f516eb3eb4a236392dab9678577738 WatchSource:0}: Error finding container fbcfea3d4a19d49c7d480d3e04b4127f53f516eb3eb4a236392dab9678577738: Status 404 returned error can't find the container with id fbcfea3d4a19d49c7d480d3e04b4127f53f516eb3eb4a236392dab9678577738 Jul 07 15:48:12.462143 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:12.462112 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:12.522066 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:12.522019 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:12.581495 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:12.581457 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" event={"ID":"bd8636e9-2db8-4b5a-905d-770ac7f34c6c","Type":"ContainerStarted","Data":"fbcfea3d4a19d49c7d480d3e04b4127f53f516eb3eb4a236392dab9678577738"} Jul 07 15:48:12.581733 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:12.581716 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:12.582819 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:12.582804 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:48:15.600649 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:15.600613 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" event={"ID":"bd8636e9-2db8-4b5a-905d-770ac7f34c6c","Type":"ContainerStarted","Data":"cbb1162e26491dab715a75f216c39ee452ba9f4292952d9d2402403f4c569d42"} Jul 07 15:48:15.601292 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:15.600744 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" Jul 07 15:48:15.622148 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:15.622097 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" podStartSLOduration=1.737927221 podStartE2EDuration="4.622079706s" totalImagesPullingTime="2.884152485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:48:15.620234104 +0000 UTC m=+453.770094609" watchObservedRunningTime="2026-07-07 15:48:15.622079706 +0000 UTC m=+453.771940212" Jul 07 15:48:26.607348 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:26.607318 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" Jul 07 15:48:28.631408 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:28.631373 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tq79c"] Jul 07 15:48:28.631800 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:28.631592 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" podUID="bd8636e9-2db8-4b5a-905d-770ac7f34c6c" containerName="limitador" containerID="cri-o://cbb1162e26491dab715a75f216c39ee452ba9f4292952d9d2402403f4c569d42" gracePeriod=30 Jul 07 15:48:29.178334 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:29.178311 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" Jul 07 15:48:29.290551 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:29.290458 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbj2k\" (UniqueName: \"kubernetes.io/projected/bd8636e9-2db8-4b5a-905d-770ac7f34c6c-kube-api-access-fbj2k\") pod \"bd8636e9-2db8-4b5a-905d-770ac7f34c6c\" (UID: \"bd8636e9-2db8-4b5a-905d-770ac7f34c6c\") " Jul 07 15:48:29.290709 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:29.290572 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd8636e9-2db8-4b5a-905d-770ac7f34c6c-config-file\") pod \"bd8636e9-2db8-4b5a-905d-770ac7f34c6c\" (UID: \"bd8636e9-2db8-4b5a-905d-770ac7f34c6c\") " Jul 07 15:48:29.290917 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:29.290897 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd8636e9-2db8-4b5a-905d-770ac7f34c6c-config-file" (OuterVolumeSpecName: "config-file") pod "bd8636e9-2db8-4b5a-905d-770ac7f34c6c" (UID: "bd8636e9-2db8-4b5a-905d-770ac7f34c6c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:48:29.292575 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:29.292545 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd8636e9-2db8-4b5a-905d-770ac7f34c6c-kube-api-access-fbj2k" (OuterVolumeSpecName: "kube-api-access-fbj2k") pod "bd8636e9-2db8-4b5a-905d-770ac7f34c6c" (UID: "bd8636e9-2db8-4b5a-905d-770ac7f34c6c"). InnerVolumeSpecName "kube-api-access-fbj2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:48:29.391331 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:29.391281 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbj2k\" (UniqueName: \"kubernetes.io/projected/bd8636e9-2db8-4b5a-905d-770ac7f34c6c-kube-api-access-fbj2k\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:48:29.391331 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:29.391320 2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bd8636e9-2db8-4b5a-905d-770ac7f34c6c-config-file\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:48:29.668502 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:29.668461 2572 generic.go:356] "Generic (PLEG): container finished" podID="bd8636e9-2db8-4b5a-905d-770ac7f34c6c" containerID="cbb1162e26491dab715a75f216c39ee452ba9f4292952d9d2402403f4c569d42" exitCode=0 Jul 07 15:48:29.668502 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:29.668506 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" Jul 07 15:48:29.669065 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:29.668536 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" event={"ID":"bd8636e9-2db8-4b5a-905d-770ac7f34c6c","Type":"ContainerDied","Data":"cbb1162e26491dab715a75f216c39ee452ba9f4292952d9d2402403f4c569d42"} Jul 07 15:48:29.669065 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:29.668583 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tq79c" event={"ID":"bd8636e9-2db8-4b5a-905d-770ac7f34c6c","Type":"ContainerDied","Data":"fbcfea3d4a19d49c7d480d3e04b4127f53f516eb3eb4a236392dab9678577738"} Jul 07 15:48:29.669065 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:29.668607 2572 scope.go:117] "RemoveContainer" containerID="cbb1162e26491dab715a75f216c39ee452ba9f4292952d9d2402403f4c569d42" Jul 07 15:48:29.677595 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:29.677575 2572 scope.go:117] "RemoveContainer" containerID="cbb1162e26491dab715a75f216c39ee452ba9f4292952d9d2402403f4c569d42" Jul 07 15:48:29.677847 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:48:29.677828 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbb1162e26491dab715a75f216c39ee452ba9f4292952d9d2402403f4c569d42\": container with ID starting with cbb1162e26491dab715a75f216c39ee452ba9f4292952d9d2402403f4c569d42 not found: ID does not exist" containerID="cbb1162e26491dab715a75f216c39ee452ba9f4292952d9d2402403f4c569d42" Jul 07 15:48:29.677918 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:29.677874 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbb1162e26491dab715a75f216c39ee452ba9f4292952d9d2402403f4c569d42"} err="failed to get container status \"cbb1162e26491dab715a75f216c39ee452ba9f4292952d9d2402403f4c569d42\": rpc error: code = NotFound desc = could not find container \"cbb1162e26491dab715a75f216c39ee452ba9f4292952d9d2402403f4c569d42\": container with ID starting with cbb1162e26491dab715a75f216c39ee452ba9f4292952d9d2402403f4c569d42 not found: ID does not exist" Jul 07 15:48:29.691447 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:29.691420 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tq79c"] Jul 07 15:48:29.697405 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:29.697384 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tq79c"] Jul 07 15:48:30.377659 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:30.377622 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd8636e9-2db8-4b5a-905d-770ac7f34c6c" path="/var/lib/kubelet/pods/bd8636e9-2db8-4b5a-905d-770ac7f34c6c/volumes" Jul 07 15:48:33.245664 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:33.245630 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-52l8l"] Jul 07 15:48:33.246104 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:33.246083 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd8636e9-2db8-4b5a-905d-770ac7f34c6c" containerName="limitador" Jul 07 15:48:33.246104 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:33.246103 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd8636e9-2db8-4b5a-905d-770ac7f34c6c" containerName="limitador" Jul 07 15:48:33.246339 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:33.246317 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd8636e9-2db8-4b5a-905d-770ac7f34c6c" containerName="limitador" Jul 07 15:48:33.251253 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:33.251116 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-52l8l" Jul 07 15:48:33.253632 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:33.253612 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 07 15:48:33.253768 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:33.253653 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ghr89\"" Jul 07 15:48:33.258294 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:33.258270 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-52l8l"] Jul 07 15:48:33.280104 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:33.280058 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:33.326818 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:33.326779 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/77588649-5830-451e-b810-e0d725b7a2aa-data\") pod \"postgres-69fb4594cf-52l8l\" (UID: \"77588649-5830-451e-b810-e0d725b7a2aa\") " pod="opendatahub/postgres-69fb4594cf-52l8l" Jul 07 15:48:33.327007 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:33.326920 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9q9h\" (UniqueName: \"kubernetes.io/projected/77588649-5830-451e-b810-e0d725b7a2aa-kube-api-access-f9q9h\") pod \"postgres-69fb4594cf-52l8l\" (UID: \"77588649-5830-451e-b810-e0d725b7a2aa\") " pod="opendatahub/postgres-69fb4594cf-52l8l" Jul 07 15:48:33.427893 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:33.427839 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9q9h\" (UniqueName: \"kubernetes.io/projected/77588649-5830-451e-b810-e0d725b7a2aa-kube-api-access-f9q9h\") pod \"postgres-69fb4594cf-52l8l\" (UID: \"77588649-5830-451e-b810-e0d725b7a2aa\") " pod="opendatahub/postgres-69fb4594cf-52l8l" Jul 07 15:48:33.428062 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:33.427906 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/77588649-5830-451e-b810-e0d725b7a2aa-data\") pod \"postgres-69fb4594cf-52l8l\" (UID: \"77588649-5830-451e-b810-e0d725b7a2aa\") " pod="opendatahub/postgres-69fb4594cf-52l8l" Jul 07 15:48:33.428295 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:33.428276 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/77588649-5830-451e-b810-e0d725b7a2aa-data\") pod \"postgres-69fb4594cf-52l8l\" (UID: \"77588649-5830-451e-b810-e0d725b7a2aa\") " pod="opendatahub/postgres-69fb4594cf-52l8l" Jul 07 15:48:33.436426 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:33.436393 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9q9h\" (UniqueName: \"kubernetes.io/projected/77588649-5830-451e-b810-e0d725b7a2aa-kube-api-access-f9q9h\") pod \"postgres-69fb4594cf-52l8l\" (UID: \"77588649-5830-451e-b810-e0d725b7a2aa\") " pod="opendatahub/postgres-69fb4594cf-52l8l" Jul 07 15:48:33.564035 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:33.563940 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-52l8l" Jul 07 15:48:33.701029 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:33.700998 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-52l8l"] Jul 07 15:48:33.703345 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:48:33.703317 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77588649_5830_451e_b810_e0d725b7a2aa.slice/crio-8a56c15e85774218e51495097d5d94fa87e39402f2810b1836cd5e31607f8cf9 WatchSource:0}: Error finding container 8a56c15e85774218e51495097d5d94fa87e39402f2810b1836cd5e31607f8cf9: Status 404 returned error can't find the container with id 8a56c15e85774218e51495097d5d94fa87e39402f2810b1836cd5e31607f8cf9 Jul 07 15:48:34.694165 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:34.694132 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-52l8l" event={"ID":"77588649-5830-451e-b810-e0d725b7a2aa","Type":"ContainerStarted","Data":"8a56c15e85774218e51495097d5d94fa87e39402f2810b1836cd5e31607f8cf9"} Jul 07 15:48:39.727654 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:39.727613 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-52l8l" event={"ID":"77588649-5830-451e-b810-e0d725b7a2aa","Type":"ContainerStarted","Data":"a4495a8e6e3f8f7d32671b4e0ec708a4b76a0206b4ccc2637acb058b687dd55e"} Jul 07 15:48:39.728107 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:39.727718 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-52l8l" Jul 07 15:48:39.749210 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:39.749156 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-52l8l" podStartSLOduration=1.114042326 podStartE2EDuration="6.749138867s" totalImagesPullingTime="5.635096541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:48:39.746429311 +0000 UTC m=+477.896289821" watchObservedRunningTime="2026-07-07 15:48:39.749138867 +0000 UTC m=+477.898999373" Jul 07 15:48:45.764493 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:45.764459 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-52l8l" Jul 07 15:48:46.095289 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:46.095198 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:46.712378 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:46.712341 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:53.143964 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:53.143933 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d85d5c6dc-jz2xx"] Jul 07 15:48:53.149231 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:53.149201 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:53.152051 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:53.152034 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" Jul 07 15:48:53.154990 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:53.154960 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 07 15:48:53.155119 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:53.155041 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pgh4d\"" Jul 07 15:48:53.155657 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:53.155639 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 15:48:53.161090 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:53.161068 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d85d5c6dc-jz2xx"] Jul 07 15:48:53.246630 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:53.246599 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:53.315311 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:53.315276 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5h2s\" (UniqueName: \"kubernetes.io/projected/a7aa17b7-3950-490f-80c2-b2d10256a0d0-kube-api-access-n5h2s\") pod \"maas-controller-7d85d5c6dc-jz2xx\" (UID: \"a7aa17b7-3950-490f-80c2-b2d10256a0d0\") " pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" Jul 07 15:48:53.315480 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:53.315332 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7aa17b7-3950-490f-80c2-b2d10256a0d0-webhook-cert\") pod \"maas-controller-7d85d5c6dc-jz2xx\" (UID: \"a7aa17b7-3950-490f-80c2-b2d10256a0d0\") " pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" Jul 07 15:48:53.325103 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:53.325070 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:53.416794 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:53.416710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5h2s\" (UniqueName: \"kubernetes.io/projected/a7aa17b7-3950-490f-80c2-b2d10256a0d0-kube-api-access-n5h2s\") pod \"maas-controller-7d85d5c6dc-jz2xx\" (UID: \"a7aa17b7-3950-490f-80c2-b2d10256a0d0\") " pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" Jul 07 15:48:53.416794 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:53.416766 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7aa17b7-3950-490f-80c2-b2d10256a0d0-webhook-cert\") pod \"maas-controller-7d85d5c6dc-jz2xx\" (UID: \"a7aa17b7-3950-490f-80c2-b2d10256a0d0\") " pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" Jul 07 15:48:53.417007 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:48:53.416888 2572 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 07 15:48:53.417007 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:48:53.416941 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7aa17b7-3950-490f-80c2-b2d10256a0d0-webhook-cert podName:a7aa17b7-3950-490f-80c2-b2d10256a0d0 nodeName:}" failed. No retries permitted until 2026-07-07 15:48:53.91692562 +0000 UTC m=+492.066786104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a7aa17b7-3950-490f-80c2-b2d10256a0d0-webhook-cert") pod "maas-controller-7d85d5c6dc-jz2xx" (UID: "a7aa17b7-3950-490f-80c2-b2d10256a0d0") : secret "maas-controller-webhook-cert" not found Jul 07 15:48:53.428124 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:53.428085 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5h2s\" (UniqueName: \"kubernetes.io/projected/a7aa17b7-3950-490f-80c2-b2d10256a0d0-kube-api-access-n5h2s\") pod \"maas-controller-7d85d5c6dc-jz2xx\" (UID: \"a7aa17b7-3950-490f-80c2-b2d10256a0d0\") " pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" Jul 07 15:48:53.528249 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:53.528220 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:53.922030 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:53.921993 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7aa17b7-3950-490f-80c2-b2d10256a0d0-webhook-cert\") pod \"maas-controller-7d85d5c6dc-jz2xx\" (UID: \"a7aa17b7-3950-490f-80c2-b2d10256a0d0\") " pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" Jul 07 15:48:53.924512 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:53.924486 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7aa17b7-3950-490f-80c2-b2d10256a0d0-webhook-cert\") pod \"maas-controller-7d85d5c6dc-jz2xx\" (UID: \"a7aa17b7-3950-490f-80c2-b2d10256a0d0\") " pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" Jul 07 15:48:54.064757 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:54.064719 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" Jul 07 15:48:54.204139 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:54.204113 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d85d5c6dc-jz2xx"] Jul 07 15:48:54.205658 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:48:54.205634 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7aa17b7_3950_490f_80c2_b2d10256a0d0.slice/crio-b4c633a2bf77e6ac64528b9984fdbe28f2aa88c86356a03ac14d59eec6ea00d3 WatchSource:0}: Error finding container b4c633a2bf77e6ac64528b9984fdbe28f2aa88c86356a03ac14d59eec6ea00d3: Status 404 returned error can't find the container with id b4c633a2bf77e6ac64528b9984fdbe28f2aa88c86356a03ac14d59eec6ea00d3 Jul 07 15:48:54.804283 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:54.804201 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" event={"ID":"a7aa17b7-3950-490f-80c2-b2d10256a0d0","Type":"ContainerStarted","Data":"b4c633a2bf77e6ac64528b9984fdbe28f2aa88c86356a03ac14d59eec6ea00d3"} Jul 07 15:48:56.078145 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:56.078114 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:56.168013 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:56.167983 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:56.815402 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:56.815364 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" event={"ID":"a7aa17b7-3950-490f-80c2-b2d10256a0d0","Type":"ContainerStarted","Data":"868225f94bdea6fe0c0b7348aed99cc9bed1b1260e48d7c2676730221c88c0ad"} Jul 07 15:48:56.815609 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:56.815503 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" Jul 07 15:48:56.836918 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:48:56.836871 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" podStartSLOduration=2.189520458 podStartE2EDuration="3.836841823s" totalImagesPullingTime="1.647321365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:48:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:48:56.834724726 +0000 UTC m=+494.984585231" watchObservedRunningTime="2026-07-07 15:48:56.836841823 +0000 UTC m=+494.986702329" Jul 07 15:49:07.326206 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.326169 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d85d5c6dc-jz2xx"] Jul 07 15:49:07.326597 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.326383 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" podUID="a7aa17b7-3950-490f-80c2-b2d10256a0d0" containerName="manager" containerID="cri-o://868225f94bdea6fe0c0b7348aed99cc9bed1b1260e48d7c2676730221c88c0ad" gracePeriod=30 Jul 07 15:49:07.334743 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.334715 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" Jul 07 15:49:07.570528 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.570501 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" Jul 07 15:49:07.642124 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.642097 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7aa17b7-3950-490f-80c2-b2d10256a0d0-webhook-cert\") pod \"a7aa17b7-3950-490f-80c2-b2d10256a0d0\" (UID: \"a7aa17b7-3950-490f-80c2-b2d10256a0d0\") " Jul 07 15:49:07.642376 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.642179 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5h2s\" (UniqueName: \"kubernetes.io/projected/a7aa17b7-3950-490f-80c2-b2d10256a0d0-kube-api-access-n5h2s\") pod \"a7aa17b7-3950-490f-80c2-b2d10256a0d0\" (UID: \"a7aa17b7-3950-490f-80c2-b2d10256a0d0\") " Jul 07 15:49:07.644416 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.644379 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7aa17b7-3950-490f-80c2-b2d10256a0d0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a7aa17b7-3950-490f-80c2-b2d10256a0d0" (UID: "a7aa17b7-3950-490f-80c2-b2d10256a0d0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:49:07.644524 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.644400 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7aa17b7-3950-490f-80c2-b2d10256a0d0-kube-api-access-n5h2s" (OuterVolumeSpecName: "kube-api-access-n5h2s") pod "a7aa17b7-3950-490f-80c2-b2d10256a0d0" (UID: "a7aa17b7-3950-490f-80c2-b2d10256a0d0"). InnerVolumeSpecName "kube-api-access-n5h2s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:49:07.743258 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.743221 2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7aa17b7-3950-490f-80c2-b2d10256a0d0-webhook-cert\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:49:07.743258 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.743251 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5h2s\" (UniqueName: \"kubernetes.io/projected/a7aa17b7-3950-490f-80c2-b2d10256a0d0-kube-api-access-n5h2s\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 15:49:07.869710 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.869674 2572 generic.go:356] "Generic (PLEG): container finished" podID="a7aa17b7-3950-490f-80c2-b2d10256a0d0" containerID="868225f94bdea6fe0c0b7348aed99cc9bed1b1260e48d7c2676730221c88c0ad" exitCode=0 Jul 07 15:49:07.869900 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.869717 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" Jul 07 15:49:07.869900 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.869734 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" event={"ID":"a7aa17b7-3950-490f-80c2-b2d10256a0d0","Type":"ContainerDied","Data":"868225f94bdea6fe0c0b7348aed99cc9bed1b1260e48d7c2676730221c88c0ad"} Jul 07 15:49:07.869900 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.869774 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d85d5c6dc-jz2xx" event={"ID":"a7aa17b7-3950-490f-80c2-b2d10256a0d0","Type":"ContainerDied","Data":"b4c633a2bf77e6ac64528b9984fdbe28f2aa88c86356a03ac14d59eec6ea00d3"} Jul 07 15:49:07.869900 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.869796 2572 scope.go:117] "RemoveContainer" containerID="868225f94bdea6fe0c0b7348aed99cc9bed1b1260e48d7c2676730221c88c0ad" Jul 07 15:49:07.880569 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.880549 2572 scope.go:117] "RemoveContainer" containerID="868225f94bdea6fe0c0b7348aed99cc9bed1b1260e48d7c2676730221c88c0ad" Jul 07 15:49:07.880897 ip-10-0-138-64 kubenswrapper[2572]: E0707 15:49:07.880872 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"868225f94bdea6fe0c0b7348aed99cc9bed1b1260e48d7c2676730221c88c0ad\": container with ID starting with 868225f94bdea6fe0c0b7348aed99cc9bed1b1260e48d7c2676730221c88c0ad not found: ID does not exist" containerID="868225f94bdea6fe0c0b7348aed99cc9bed1b1260e48d7c2676730221c88c0ad" Jul 07 15:49:07.880950 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.880908 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868225f94bdea6fe0c0b7348aed99cc9bed1b1260e48d7c2676730221c88c0ad"} err="failed to get container status \"868225f94bdea6fe0c0b7348aed99cc9bed1b1260e48d7c2676730221c88c0ad\": rpc error: code = NotFound desc = could not find container \"868225f94bdea6fe0c0b7348aed99cc9bed1b1260e48d7c2676730221c88c0ad\": container with ID starting with 868225f94bdea6fe0c0b7348aed99cc9bed1b1260e48d7c2676730221c88c0ad not found: ID does not exist" Jul 07 15:49:07.892395 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.892321 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d85d5c6dc-jz2xx"] Jul 07 15:49:07.898088 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:07.898062 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7d85d5c6dc-jz2xx"] Jul 07 15:49:08.377170 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:08.377140 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7aa17b7-3950-490f-80c2-b2d10256a0d0" path="/var/lib/kubelet/pods/a7aa17b7-3950-490f-80c2-b2d10256a0d0/volumes" Jul 07 15:49:28.075664 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:28.075627 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:29.090431 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:29.090398 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:29.574078 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:29.574017 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:29.949104 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:29.949070 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:30.047323 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.047284 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:30.114886 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.114819 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:30.118232 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.118199 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8452z"] Jul 07 15:49:30.118578 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.118565 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7aa17b7-3950-490f-80c2-b2d10256a0d0" containerName="manager" Jul 07 15:49:30.118631 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.118580 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7aa17b7-3950-490f-80c2-b2d10256a0d0" containerName="manager" Jul 07 15:49:30.118667 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.118645 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7aa17b7-3950-490f-80c2-b2d10256a0d0" containerName="manager" Jul 07 15:49:30.144009 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.143976 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8452z"] Jul 07 15:49:30.144166 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.144089 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-8452z" Jul 07 15:49:30.151199 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.151134 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 07 15:49:30.151339 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.151320 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bcvwz\"" Jul 07 15:49:30.245020 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.244934 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82txr\" (UniqueName: \"kubernetes.io/projected/a8b90c74-2524-44fb-83ba-73cd37ddcf99-kube-api-access-82txr\") pod \"payload-pre-processing-7964457696-8452z\" (UID: \"a8b90c74-2524-44fb-83ba-73cd37ddcf99\") " pod="openshift-ingress/payload-pre-processing-7964457696-8452z" Jul 07 15:49:30.245020 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.244998 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8b90c74-2524-44fb-83ba-73cd37ddcf99-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8452z\" (UID: \"a8b90c74-2524-44fb-83ba-73cd37ddcf99\") " pod="openshift-ingress/payload-pre-processing-7964457696-8452z" Jul 07 15:49:30.345868 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.345819 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82txr\" (UniqueName: \"kubernetes.io/projected/a8b90c74-2524-44fb-83ba-73cd37ddcf99-kube-api-access-82txr\") pod \"payload-pre-processing-7964457696-8452z\" (UID: \"a8b90c74-2524-44fb-83ba-73cd37ddcf99\") " pod="openshift-ingress/payload-pre-processing-7964457696-8452z" Jul 07 15:49:30.346034 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.345897 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8b90c74-2524-44fb-83ba-73cd37ddcf99-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8452z\" (UID: \"a8b90c74-2524-44fb-83ba-73cd37ddcf99\") " pod="openshift-ingress/payload-pre-processing-7964457696-8452z" Jul 07 15:49:30.346537 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.346520 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8b90c74-2524-44fb-83ba-73cd37ddcf99-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8452z\" (UID: \"a8b90c74-2524-44fb-83ba-73cd37ddcf99\") " pod="openshift-ingress/payload-pre-processing-7964457696-8452z" Jul 07 15:49:30.354550 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.354513 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82txr\" (UniqueName: \"kubernetes.io/projected/a8b90c74-2524-44fb-83ba-73cd37ddcf99-kube-api-access-82txr\") pod \"payload-pre-processing-7964457696-8452z\" (UID: \"a8b90c74-2524-44fb-83ba-73cd37ddcf99\") " pod="openshift-ingress/payload-pre-processing-7964457696-8452z" Jul 07 15:49:30.456425 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.456394 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-8452z" Jul 07 15:49:30.593806 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.593778 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8452z"] Jul 07 15:49:30.596608 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:49:30.596581 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b90c74_2524_44fb_83ba_73cd37ddcf99.slice/crio-8ea937dc1fe71416a9982f8da4d1c38de591206e106b61e68486ee5a7606832b WatchSource:0}: Error finding container 8ea937dc1fe71416a9982f8da4d1c38de591206e106b61e68486ee5a7606832b: Status 404 returned error can't find the container with id 8ea937dc1fe71416a9982f8da4d1c38de591206e106b61e68486ee5a7606832b Jul 07 15:49:30.976881 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:30.976812 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-8452z" event={"ID":"a8b90c74-2524-44fb-83ba-73cd37ddcf99","Type":"ContainerStarted","Data":"8ea937dc1fe71416a9982f8da4d1c38de591206e106b61e68486ee5a7606832b"} Jul 07 15:49:32.987755 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:32.987720 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-8452z" event={"ID":"a8b90c74-2524-44fb-83ba-73cd37ddcf99","Type":"ContainerStarted","Data":"0da023c3e72942ef9ed0bad26a04faca37bc4056ef2753beca9b32962c330b7d"} Jul 07 15:49:32.988188 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:32.987847 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-8452z" Jul 07 15:49:38.016077 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:38.015994 2572 generic.go:356] "Generic (PLEG): container finished" podID="e589c1a2-1e65-4826-b0d7-4145df69b5b4" containerID="b21b989ddaee759eb57686c22beda027032f50a922c57b98a1a12c7fa323eab3" exitCode=0 Jul 07 15:49:38.016077 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:38.016047 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" event={"ID":"e589c1a2-1e65-4826-b0d7-4145df69b5b4","Type":"ContainerDied","Data":"b21b989ddaee759eb57686c22beda027032f50a922c57b98a1a12c7fa323eab3"} Jul 07 15:49:38.016554 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:38.016423 2572 scope.go:117] "RemoveContainer" containerID="b21b989ddaee759eb57686c22beda027032f50a922c57b98a1a12c7fa323eab3" Jul 07 15:49:38.017460 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:38.017400 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 15:49:38.017564 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:38.017521 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 15:49:38.017626 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:38.017575 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 15:49:38.040838 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:38.040788 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-8452z" podStartSLOduration=6.410602346 podStartE2EDuration="8.04077092s" totalImagesPullingTime="1.630168574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:49:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:49:33.011963659 +0000 UTC m=+531.161824168" watchObservedRunningTime="2026-07-07 15:49:38.04077092 +0000 UTC m=+536.190631427" Jul 07 15:49:39.024751 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:39.024714 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" event={"ID":"e589c1a2-1e65-4826-b0d7-4145df69b5b4","Type":"ContainerStarted","Data":"958eddeba30cfae80ad22c7ea65bd9394dcba341a7f5523e611f11708dad99af"} Jul 07 15:49:39.619499 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:39.619458 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:39.629911 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:39.629880 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:49:39.631044 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:39.631015 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9lxm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 07 15:49:39.631181 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:39.631076 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" podUID="e589c1a2-1e65-4826-b0d7-4145df69b5b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 07 15:49:40.499462 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:40.499302 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:40.596763 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:40.596728 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:40.630665 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:40.630628 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9lxm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 07 15:49:40.630814 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:40.630686 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" podUID="e589c1a2-1e65-4826-b0d7-4145df69b5b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 07 15:49:41.630610 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:41.630573 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9lxm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 07 15:49:41.631026 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:41.630645 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" podUID="e589c1a2-1e65-4826-b0d7-4145df69b5b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 07 15:49:42.582042 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:42.581947 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:49:42.630285 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:42.630250 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9lxm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 07 15:49:42.630467 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:42.630310 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" podUID="e589c1a2-1e65-4826-b0d7-4145df69b5b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 07 15:49:43.634489 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:43.634455 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:49:43.635474 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:43.635454 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9lxm9" Jul 07 15:49:43.995330 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:43.995251 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-8452z" Jul 07 15:49:45.921692 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:45.921660 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss"] Jul 07 15:49:45.924947 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:45.924929 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:45.927607 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:45.927588 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 15:49:45.928028 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:45.928011 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jn8gz\"" Jul 07 15:49:45.928927 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:45.928906 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 07 15:49:45.929078 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:45.929055 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 15:49:45.935715 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:45.935695 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss"] Jul 07 15:49:45.963191 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:45.963158 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:46.094520 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.094488 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52618558-e0b0-4bf5-b273-d150862891b6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.094685 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.094534 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52618558-e0b0-4bf5-b273-d150862891b6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.094685 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.094557 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52618558-e0b0-4bf5-b273-d150862891b6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.094685 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.094639 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktjm5\" (UniqueName: \"kubernetes.io/projected/52618558-e0b0-4bf5-b273-d150862891b6-kube-api-access-ktjm5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.094685 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.094677 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52618558-e0b0-4bf5-b273-d150862891b6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.094815 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.094692 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52618558-e0b0-4bf5-b273-d150862891b6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.195305 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.195221 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52618558-e0b0-4bf5-b273-d150862891b6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.195305 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.195260 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52618558-e0b0-4bf5-b273-d150862891b6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.195305 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.195281 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52618558-e0b0-4bf5-b273-d150862891b6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.195568 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.195349 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktjm5\" (UniqueName: \"kubernetes.io/projected/52618558-e0b0-4bf5-b273-d150862891b6-kube-api-access-ktjm5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.195568 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.195413 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52618558-e0b0-4bf5-b273-d150862891b6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.195568 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.195434 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52618558-e0b0-4bf5-b273-d150862891b6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.195705 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.195661 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52618558-e0b0-4bf5-b273-d150862891b6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.195757 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.195703 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52618558-e0b0-4bf5-b273-d150862891b6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.195809 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.195772 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52618558-e0b0-4bf5-b273-d150862891b6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.197688 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.197666 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52618558-e0b0-4bf5-b273-d150862891b6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.197835 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.197817 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52618558-e0b0-4bf5-b273-d150862891b6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.205888 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.205837 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktjm5\" (UniqueName: \"kubernetes.io/projected/52618558-e0b0-4bf5-b273-d150862891b6-kube-api-access-ktjm5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss\" (UID: \"52618558-e0b0-4bf5-b273-d150862891b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.236837 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.236801 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:46.380310 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:49:46.380255 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52618558_e0b0_4bf5_b273_d150862891b6.slice/crio-add0f8553d37734cb3077aed627ce7f4f5f2abe9484d3e6c22373cedcd1a18ca WatchSource:0}: Error finding container add0f8553d37734cb3077aed627ce7f4f5f2abe9484d3e6c22373cedcd1a18ca: Status 404 returned error can't find the container with id add0f8553d37734cb3077aed627ce7f4f5f2abe9484d3e6c22373cedcd1a18ca Jul 07 15:49:46.381736 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:46.381700 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss"] Jul 07 15:49:47.070063 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:47.070031 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" event={"ID":"52618558-e0b0-4bf5-b273-d150862891b6","Type":"ContainerStarted","Data":"add0f8553d37734cb3077aed627ce7f4f5f2abe9484d3e6c22373cedcd1a18ca"} Jul 07 15:49:48.076525 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:48.076429 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" event={"ID":"52618558-e0b0-4bf5-b273-d150862891b6","Type":"ContainerStarted","Data":"245648a7bd1d9311d0ebfef402e37e200fe2015ef58e65598a0819e4315e780f"} Jul 07 15:49:56.237257 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:56.237221 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:56.237720 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:56.237288 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:56.249735 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:56.249709 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:49:56.269763 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:56.269721 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" podStartSLOduration=10.016118888 podStartE2EDuration="11.269708654s" totalImagesPullingTime="1.253589766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:49:48.10147694 +0000 UTC m=+546.251337448" watchObservedRunningTime="2026-07-07 15:49:56.269708654 +0000 UTC m=+554.419569159" Jul 07 15:49:57.131437 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:49:57.131409 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss" Jul 07 15:50:04.144424 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.144386 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8"] Jul 07 15:50:04.146914 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.146892 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.149649 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.149627 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 07 15:50:04.163195 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.163160 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8"] Jul 07 15:50:04.177886 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.177837 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:04.252625 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.252591 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5lkq\" (UniqueName: \"kubernetes.io/projected/3f2c456c-f1f1-48ac-a820-185a070e321e-kube-api-access-f5lkq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.252625 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.252629 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f2c456c-f1f1-48ac-a820-185a070e321e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.252911 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.252669 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f2c456c-f1f1-48ac-a820-185a070e321e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.252911 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.252735 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f2c456c-f1f1-48ac-a820-185a070e321e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.252911 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.252759 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f2c456c-f1f1-48ac-a820-185a070e321e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.252911 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.252880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f2c456c-f1f1-48ac-a820-185a070e321e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.353875 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.353825 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5lkq\" (UniqueName: \"kubernetes.io/projected/3f2c456c-f1f1-48ac-a820-185a070e321e-kube-api-access-f5lkq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.354082 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.353909 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f2c456c-f1f1-48ac-a820-185a070e321e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.354082 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.353959 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f2c456c-f1f1-48ac-a820-185a070e321e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.354082 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.353988 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f2c456c-f1f1-48ac-a820-185a070e321e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.354233 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.354100 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f2c456c-f1f1-48ac-a820-185a070e321e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.354233 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.354217 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f2c456c-f1f1-48ac-a820-185a070e321e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.354344 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.354326 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f2c456c-f1f1-48ac-a820-185a070e321e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.354447 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.354424 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f2c456c-f1f1-48ac-a820-185a070e321e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.354507 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.354487 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f2c456c-f1f1-48ac-a820-185a070e321e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.356425 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.356397 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f2c456c-f1f1-48ac-a820-185a070e321e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.356651 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.356633 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f2c456c-f1f1-48ac-a820-185a070e321e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.363502 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.363474 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5lkq\" (UniqueName: \"kubernetes.io/projected/3f2c456c-f1f1-48ac-a820-185a070e321e-kube-api-access-f5lkq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7wqw8\" (UID: \"3f2c456c-f1f1-48ac-a820-185a070e321e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.458707 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.458606 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:04.604500 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:04.604471 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8"] Jul 07 15:50:04.606323 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:50:04.606297 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2c456c_f1f1_48ac_a820_185a070e321e.slice/crio-38e6c2a6a1755f073678baa8c25edc1c789a3205c781628dc377ada251357e1e WatchSource:0}: Error finding container 38e6c2a6a1755f073678baa8c25edc1c789a3205c781628dc377ada251357e1e: Status 404 returned error can't find the container with id 38e6c2a6a1755f073678baa8c25edc1c789a3205c781628dc377ada251357e1e Jul 07 15:50:05.163626 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:05.163594 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" event={"ID":"3f2c456c-f1f1-48ac-a820-185a070e321e","Type":"ContainerStarted","Data":"38e6c2a6a1755f073678baa8c25edc1c789a3205c781628dc377ada251357e1e"} Jul 07 15:50:06.169799 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:06.169765 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" event={"ID":"3f2c456c-f1f1-48ac-a820-185a070e321e","Type":"ContainerStarted","Data":"d6bead63fc99f307a0bb00254e48cdf37740dd8f961d7ce4cea405c87af444eb"} Jul 07 15:50:06.207328 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:06.207269 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" podStartSLOduration=1.643763004 podStartE2EDuration="2.207251655s" totalImagesPullingTime="563.488651ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:50:06.205528493 +0000 UTC m=+564.355389000" watchObservedRunningTime="2026-07-07 15:50:06.207251655 +0000 UTC m=+564.357112160" Jul 07 15:50:14.165265 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:14.165234 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:14.459263 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:14.459173 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:14.459263 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:14.459240 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:14.471746 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:14.471722 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:15.226153 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:15.226125 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7wqw8" Jul 07 15:50:26.629053 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:26.629021 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:39.238951 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.238916 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s"] Jul 07 15:50:39.241589 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.241571 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.245456 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.245432 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 07 15:50:39.252504 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.252481 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s"] Jul 07 15:50:39.291941 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.291905 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.292113 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.291964 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5bjp\" (UniqueName: \"kubernetes.io/projected/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-kube-api-access-s5bjp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.292113 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.292036 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.292113 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.292072 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.292113 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.292097 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.292269 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.292147 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.354477 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.354439 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:39.393130 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.393098 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5bjp\" (UniqueName: \"kubernetes.io/projected/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-kube-api-access-s5bjp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.393130 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.393136 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.393686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.393160 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.393686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.393182 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.393686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.393203 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.393686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.393271 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.393686 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.393617 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.393911 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.393703 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.393911 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.393725 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.395510 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.395493 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.395750 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.395732 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.402546 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.402523 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5bjp\" (UniqueName: \"kubernetes.io/projected/cf1ae12e-9d55-4d9c-b76d-0c42313f8af9-kube-api-access-s5bjp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-d4n8s\" (UID: \"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.553165 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.553069 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:39.690453 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:39.690423 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s"] Jul 07 15:50:39.692642 ip-10-0-138-64 kubenswrapper[2572]: W0707 15:50:39.692601 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1ae12e_9d55_4d9c_b76d_0c42313f8af9.slice/crio-4a60d62bd87d9be5e3d3b4b8e046f99d8b87bf2bf978dcd3c489bf873788c22a WatchSource:0}: Error finding container 4a60d62bd87d9be5e3d3b4b8e046f99d8b87bf2bf978dcd3c489bf873788c22a: Status 404 returned error can't find the container with id 4a60d62bd87d9be5e3d3b4b8e046f99d8b87bf2bf978dcd3c489bf873788c22a Jul 07 15:50:40.339121 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:40.339036 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" event={"ID":"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9","Type":"ContainerStarted","Data":"41848c17c4289cb976843a9f09821e33e9b2453b56aa47756b70884b40210c30"} Jul 07 15:50:40.339121 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:40.339084 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" event={"ID":"cf1ae12e-9d55-4d9c-b76d-0c42313f8af9","Type":"ContainerStarted","Data":"4a60d62bd87d9be5e3d3b4b8e046f99d8b87bf2bf978dcd3c489bf873788c22a"} Jul 07 15:50:40.359341 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:40.359284 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" podStartSLOduration=1.164023252 podStartE2EDuration="1.359266811s" totalImagesPullingTime="195.243559ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:50:40.358028889 +0000 UTC m=+598.507889398" watchObservedRunningTime="2026-07-07 15:50:40.359266811 +0000 UTC m=+598.509127317" Jul 07 15:50:42.291173 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:42.291147 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 15:50:42.291638 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:42.291361 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 15:50:47.758230 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:47.758188 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:49.554287 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:49.554250 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:49.554704 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:49.554313 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:49.566574 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:49.566550 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:50:50.397281 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:50:50.397253 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-d4n8s" Jul 07 15:51:03.877591 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:51:03.877499 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:03.930272 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:51:03.930238 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:21.082517 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:51:21.082474 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:50.555590 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:51:50.555557 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:50.628411 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:51:50.628377 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:51.794982 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:51:51.794938 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:51.891324 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:51:51.891284 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:25.864342 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:52:25.864307 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:25.968992 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:52:25.968958 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:26.065003 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:52:26.064975 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:26.601226 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:52:26.601197 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:26.702438 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:52:26.702404 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:36.734365 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:52:36.734267 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:36.791167 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:52:36.791132 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:36.852110 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:52:36.852070 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:48.171583 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:52:48.171543 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:04.979502 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:53:04.979469 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:06.432116 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:53:06.432086 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:47.428276 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:53:47.428238 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:47.527933 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:53:47.527892 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:47.627719 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:53:47.627674 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:53.818534 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:53:53.818497 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:53.922469 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:53:53.922432 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:54.037151 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:53:54.037120 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:54.269071 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:53:54.269024 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:00.317613 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:54:00.317576 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:00.385441 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:54:00.385411 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:18.126824 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:54:18.126741 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:41.504736 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:54:41.504701 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:55:06.414055 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:55:06.414015 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:55:14.804792 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:55:14.804758 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:55:22.192844 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:55:22.192801 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:55:22.292443 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:55:22.292404 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 15:55:42.322457 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:55:42.322428 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 15:55:42.323083 ip-10-0-138-64 kubenswrapper[2572]: I0707 15:55:42.323067 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 16:00:34.391167 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:00:34.391133 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:00:42.359522 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:00:42.359493 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 16:00:42.360599 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:00:42.360579 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 16:01:09.775010 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:01:09.774978 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:03:02.873317 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:03:02.873236 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:04:24.617306 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:04:24.617260 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:04:24.717616 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:04:24.717562 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:04:35.767267 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:04:35.767155 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:04:41.251614 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:04:41.251124 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:04:49.523224 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:04:49.523184 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:04:54.685145 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:04:54.685081 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:04:57.783748 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:04:57.783693 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:04:57.972639 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:04:57.972611 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:04:58.534799 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:04:58.534759 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:04.010085 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.010044 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:04.113201 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.113167 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:04.192173 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.192136 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs"] Jul 07 16:05:04.196244 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.196208 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.199777 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.199757 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7eb372bb-openshift-default-dockercfg-2pdtj\"" Jul 07 16:05:04.225012 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.224977 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs"] Jul 07 16:05:04.242402 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.242375 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:04.268464 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.268365 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-credential-socket\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.268464 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.268411 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istiod-ca-cert\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.268653 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.268513 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-envoy\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.268653 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.268543 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-data\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.268653 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.268586 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-podinfo\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.268653 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.268633 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-workload-certs\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.268653 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.268650 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-token\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.268810 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.268696 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbb2d\" (UniqueName: \"kubernetes.io/projected/9a214e12-b2fe-4671-b2e8-f42830fe81d9-kube-api-access-lbb2d\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.268810 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.268731 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-workload-socket\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.369437 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.369337 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-token\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.369437 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.369403 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbb2d\" (UniqueName: \"kubernetes.io/projected/9a214e12-b2fe-4671-b2e8-f42830fe81d9-kube-api-access-lbb2d\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.369437 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.369442 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-workload-socket\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.370218 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.369473 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-credential-socket\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.370218 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.369491 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istiod-ca-cert\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.370218 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.369536 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-envoy\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.370218 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.369560 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-data\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.370218 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.369607 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-podinfo\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.370218 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.369658 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-workload-certs\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.370218 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.369956 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-workload-socket\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.370218 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.370027 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-workload-certs\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.370218 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.370096 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-data\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.370948 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.370472 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istiod-ca-cert\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.370948 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.370521 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-credential-socket\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.372761 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.372738 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-envoy\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.373091 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.373070 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-podinfo\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.390252 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.390220 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbb2d\" (UniqueName: \"kubernetes.io/projected/9a214e12-b2fe-4671-b2e8-f42830fe81d9-kube-api-access-lbb2d\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.404813 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.404782 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-token\") pod \"e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.507434 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.507389 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:04.581305 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.581266 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:04.654540 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.654503 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs"] Jul 07 16:05:04.657918 ip-10-0-138-64 kubenswrapper[2572]: W0707 16:05:04.657892 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a214e12_b2fe_4671_b2e8_f42830fe81d9.slice/crio-e215c6187179a553fe31a0c1c368603980263a8d02b2af5ae62ea99f9be79f89 WatchSource:0}: Error finding container e215c6187179a553fe31a0c1c368603980263a8d02b2af5ae62ea99f9be79f89: Status 404 returned error can't find the container with id e215c6187179a553fe31a0c1c368603980263a8d02b2af5ae62ea99f9be79f89 Jul 07 16:05:04.659973 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.659937 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:05:04.660083 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.660021 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:05:04.660083 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:04.660074 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:05:05.472812 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:05.472777 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:05.572766 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:05.572701 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:05.578671 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:05.578640 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" event={"ID":"9a214e12-b2fe-4671-b2e8-f42830fe81d9","Type":"ContainerStarted","Data":"bb3f57b61c15c762b2add725c4d50646bf69b882a4a57749efe0b50f0e821688"} Jul 07 16:05:05.578846 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:05.578691 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" event={"ID":"9a214e12-b2fe-4671-b2e8-f42830fe81d9","Type":"ContainerStarted","Data":"e215c6187179a553fe31a0c1c368603980263a8d02b2af5ae62ea99f9be79f89"} Jul 07 16:05:05.612002 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:05.611943 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" podStartSLOduration=1.611923676 podStartE2EDuration="1.611923676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:05:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:05:05.609136845 +0000 UTC m=+1463.758997352" watchObservedRunningTime="2026-07-07 16:05:05.611923676 +0000 UTC m=+1463.761784181" Jul 07 16:05:05.655586 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:05.655548 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:06.010292 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:06.010247 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:06.219064 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:06.219027 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:06.318743 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:06.318654 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:06.507682 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:06.507636 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:06.512539 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:06.512511 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:06.583724 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:06.583642 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:06.584662 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:06.584643 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:08.217106 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:08.217070 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:10.527190 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:10.527142 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:10.688390 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:10.688355 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs"] Jul 07 16:05:10.688593 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:10.688566 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" podUID="9a214e12-b2fe-4671-b2e8-f42830fe81d9" containerName="istio-proxy" containerID="cri-o://bb3f57b61c15c762b2add725c4d50646bf69b882a4a57749efe0b50f0e821688" gracePeriod=30 Jul 07 16:05:10.720838 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:10.720768 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:10.819751 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:10.819636 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:10.942060 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:10.942030 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:14.592353 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:14.592322 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:16.775118 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:16.775077 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:16.859870 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:16.859823 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:16.964157 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:16.964117 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8"] Jul 07 16:05:16.967757 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:16.967731 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:16.970826 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:16.970805 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-18541f86-openshift-default-dockercfg-4vxc5\"" Jul 07 16:05:16.980903 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:16.980875 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8"] Jul 07 16:05:17.003870 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.003829 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-data\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.004092 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.003902 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-envoy\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.004092 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.003943 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istiod-ca-cert\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.004092 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.003978 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-workload-socket\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.004092 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.004026 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-credential-socket\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.004092 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.004054 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-token\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.004092 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.004080 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hmgq\" (UniqueName: \"kubernetes.io/projected/aa34da09-dbe2-48ee-bfc1-7427eda1526b-kube-api-access-8hmgq\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.004413 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.004099 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-podinfo\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.004413 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.004116 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:17.004413 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.004135 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-workload-certs\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.103973 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.103847 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:17.104942 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.104920 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-workload-socket\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.105025 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.104977 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-credential-socket\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.105025 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.105007 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-token\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.105125 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.105032 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hmgq\" (UniqueName: \"kubernetes.io/projected/aa34da09-dbe2-48ee-bfc1-7427eda1526b-kube-api-access-8hmgq\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.105125 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.105050 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-podinfo\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.105125 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.105096 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-workload-certs\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.105287 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.105138 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-data\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.105287 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.105173 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-envoy\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.105287 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.105207 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istiod-ca-cert\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.105437 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.105400 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-workload-socket\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.105592 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.105565 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-credential-socket\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.105592 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.105580 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-data\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.105721 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.105663 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-workload-certs\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.105889 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.105870 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istiod-ca-cert\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.107527 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.107496 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-envoy\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.107668 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.107646 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-podinfo\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.114018 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.113992 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hmgq\" (UniqueName: \"kubernetes.io/projected/aa34da09-dbe2-48ee-bfc1-7427eda1526b-kube-api-access-8hmgq\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.114729 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.114710 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-token\") pod \"e2e-ait-18541f86-openshift-default-cd6b58965-swms8\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.281106 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.281066 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:17.449863 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.449822 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8"] Jul 07 16:05:17.496057 ip-10-0-138-64 kubenswrapper[2572]: W0707 16:05:17.496018 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa34da09_dbe2_48ee_bfc1_7427eda1526b.slice/crio-31f817cc305a76229259298c2a43081bfe737f485500b87224d60f11d5205acb WatchSource:0}: Error finding container 31f817cc305a76229259298c2a43081bfe737f485500b87224d60f11d5205acb: Status 404 returned error can't find the container with id 31f817cc305a76229259298c2a43081bfe737f485500b87224d60f11d5205acb Jul 07 16:05:17.498227 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.498190 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:05:17.498334 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.498266 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:05:17.498334 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.498296 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:05:17.639893 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.639816 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:17.650509 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.650473 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" event={"ID":"aa34da09-dbe2-48ee-bfc1-7427eda1526b","Type":"ContainerStarted","Data":"52c98402e84f3f9f06e0d5d00a0f8930e2bd9948fb83cfc28b736ba28a98c5fa"} Jul 07 16:05:17.650680 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.650539 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" event={"ID":"aa34da09-dbe2-48ee-bfc1-7427eda1526b","Type":"ContainerStarted","Data":"31f817cc305a76229259298c2a43081bfe737f485500b87224d60f11d5205acb"} Jul 07 16:05:17.652099 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.652067 2572 generic.go:356] "Generic (PLEG): container finished" podID="9a214e12-b2fe-4671-b2e8-f42830fe81d9" containerID="bb3f57b61c15c762b2add725c4d50646bf69b882a4a57749efe0b50f0e821688" exitCode=0 Jul 07 16:05:17.652236 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.652102 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" event={"ID":"9a214e12-b2fe-4671-b2e8-f42830fe81d9","Type":"ContainerDied","Data":"bb3f57b61c15c762b2add725c4d50646bf69b882a4a57749efe0b50f0e821688"} Jul 07 16:05:17.652236 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.652159 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" event={"ID":"9a214e12-b2fe-4671-b2e8-f42830fe81d9","Type":"ContainerDied","Data":"e215c6187179a553fe31a0c1c368603980263a8d02b2af5ae62ea99f9be79f89"} Jul 07 16:05:17.652236 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.652109 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs" Jul 07 16:05:17.652391 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.652183 2572 scope.go:117] "RemoveContainer" containerID="bb3f57b61c15c762b2add725c4d50646bf69b882a4a57749efe0b50f0e821688" Jul 07 16:05:17.666992 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.666887 2572 scope.go:117] "RemoveContainer" containerID="bb3f57b61c15c762b2add725c4d50646bf69b882a4a57749efe0b50f0e821688" Jul 07 16:05:17.667480 ip-10-0-138-64 kubenswrapper[2572]: E0707 16:05:17.667448 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb3f57b61c15c762b2add725c4d50646bf69b882a4a57749efe0b50f0e821688\": container with ID starting with bb3f57b61c15c762b2add725c4d50646bf69b882a4a57749efe0b50f0e821688 not found: ID does not exist" containerID="bb3f57b61c15c762b2add725c4d50646bf69b882a4a57749efe0b50f0e821688" Jul 07 16:05:17.667674 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.667642 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb3f57b61c15c762b2add725c4d50646bf69b882a4a57749efe0b50f0e821688"} err="failed to get container status \"bb3f57b61c15c762b2add725c4d50646bf69b882a4a57749efe0b50f0e821688\": rpc error: code = NotFound desc = could not find container \"bb3f57b61c15c762b2add725c4d50646bf69b882a4a57749efe0b50f0e821688\": container with ID starting with bb3f57b61c15c762b2add725c4d50646bf69b882a4a57749efe0b50f0e821688 not found: ID does not exist" Jul 07 16:05:17.708738 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.708679 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" podStartSLOduration=1.708660483 podStartE2EDuration="1.708660483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:05:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:05:17.706719283 +0000 UTC m=+1475.856579790" watchObservedRunningTime="2026-07-07 16:05:17.708660483 +0000 UTC m=+1475.858520988" Jul 07 16:05:17.710267 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.710243 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-envoy\") pod \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " Jul 07 16:05:17.710420 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.710280 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istiod-ca-cert\") pod \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " Jul 07 16:05:17.710893 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.710790 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9a214e12-b2fe-4671-b2e8-f42830fe81d9" (UID: "9a214e12-b2fe-4671-b2e8-f42830fe81d9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:05:17.713320 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.713297 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9a214e12-b2fe-4671-b2e8-f42830fe81d9" (UID: "9a214e12-b2fe-4671-b2e8-f42830fe81d9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:05:17.810966 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.810929 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-token\") pod \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " Jul 07 16:05:17.811392 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.810998 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-credential-socket\") pod \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " Jul 07 16:05:17.811392 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.811027 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-workload-certs\") pod \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " Jul 07 16:05:17.811392 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.811058 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-workload-socket\") pod \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " Jul 07 16:05:17.811392 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.811103 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbb2d\" (UniqueName: \"kubernetes.io/projected/9a214e12-b2fe-4671-b2e8-f42830fe81d9-kube-api-access-lbb2d\") pod \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " Jul 07 16:05:17.811392 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.811131 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-podinfo\") pod \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " Jul 07 16:05:17.811392 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.811171 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-data\") pod \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\" (UID: \"9a214e12-b2fe-4671-b2e8-f42830fe81d9\") " Jul 07 16:05:17.811392 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.811266 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9a214e12-b2fe-4671-b2e8-f42830fe81d9" (UID: "9a214e12-b2fe-4671-b2e8-f42830fe81d9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:05:17.811392 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.811298 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9a214e12-b2fe-4671-b2e8-f42830fe81d9" (UID: "9a214e12-b2fe-4671-b2e8-f42830fe81d9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:05:17.811922 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.811406 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9a214e12-b2fe-4671-b2e8-f42830fe81d9" (UID: "9a214e12-b2fe-4671-b2e8-f42830fe81d9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:05:17.811922 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.811723 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-envoy\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:17.811922 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.811745 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istiod-ca-cert\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:17.811922 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.811760 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-credential-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:17.811922 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.811773 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-workload-certs\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:17.811922 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.811787 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-workload-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:17.812242 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.812218 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-data" (OuterVolumeSpecName: "istio-data") pod "9a214e12-b2fe-4671-b2e8-f42830fe81d9" (UID: "9a214e12-b2fe-4671-b2e8-f42830fe81d9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:05:17.813298 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.813264 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-token" (OuterVolumeSpecName: "istio-token") pod "9a214e12-b2fe-4671-b2e8-f42830fe81d9" (UID: "9a214e12-b2fe-4671-b2e8-f42830fe81d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:05:17.813562 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.813541 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a214e12-b2fe-4671-b2e8-f42830fe81d9-kube-api-access-lbb2d" (OuterVolumeSpecName: "kube-api-access-lbb2d") pod "9a214e12-b2fe-4671-b2e8-f42830fe81d9" (UID: "9a214e12-b2fe-4671-b2e8-f42830fe81d9"). InnerVolumeSpecName "kube-api-access-lbb2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:05:17.813647 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.813624 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9a214e12-b2fe-4671-b2e8-f42830fe81d9" (UID: "9a214e12-b2fe-4671-b2e8-f42830fe81d9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 16:05:17.912888 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.912778 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-podinfo\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:17.912888 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.912807 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-data\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:17.912888 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.912816 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a214e12-b2fe-4671-b2e8-f42830fe81d9-istio-token\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:17.912888 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.912825 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbb2d\" (UniqueName: \"kubernetes.io/projected/9a214e12-b2fe-4671-b2e8-f42830fe81d9-kube-api-access-lbb2d\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:17.979616 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.979580 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs"] Jul 07 16:05:17.983432 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:17.983404 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7eb372bb-openshift-default-66f596984c-gcmqs"] Jul 07 16:05:18.186812 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:18.186701 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:18.281209 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:18.281184 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:18.281728 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:18.281706 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:18.286487 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:18.286459 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:18.376960 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:18.376926 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:18.379795 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:18.379761 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a214e12-b2fe-4671-b2e8-f42830fe81d9" path="/var/lib/kubelet/pods/9a214e12-b2fe-4671-b2e8-f42830fe81d9/volumes" Jul 07 16:05:18.658717 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:18.658683 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:18.659737 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:18.659716 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:18.698711 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:18.698674 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:18.806550 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:18.806520 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:18.903531 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:18.903498 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:20.329205 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:20.329168 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:23.253370 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:23.253328 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:23.626487 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:23.626451 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:29.362678 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.362589 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8"] Jul 07 16:05:29.363216 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.362825 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" podUID="aa34da09-dbe2-48ee-bfc1-7427eda1526b" containerName="istio-proxy" containerID="cri-o://52c98402e84f3f9f06e0d5d00a0f8930e2bd9948fb83cfc28b736ba28a98c5fa" gracePeriod=30 Jul 07 16:05:29.390999 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.390964 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:29.490907 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.490880 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:29.509928 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.509896 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:29.625288 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.625256 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istiod-ca-cert\") pod \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " Jul 07 16:05:29.625470 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.625301 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-podinfo\") pod \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " Jul 07 16:05:29.625470 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.625319 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-workload-certs\") pod \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " Jul 07 16:05:29.625470 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.625351 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-workload-socket\") pod \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " Jul 07 16:05:29.625470 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.625387 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-credential-socket\") pod \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " Jul 07 16:05:29.625470 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.625402 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-envoy\") pod \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " Jul 07 16:05:29.625720 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.625483 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-token\") pod \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " Jul 07 16:05:29.625720 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.625506 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-data\") pod \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " Jul 07 16:05:29.625720 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.625528 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hmgq\" (UniqueName: \"kubernetes.io/projected/aa34da09-dbe2-48ee-bfc1-7427eda1526b-kube-api-access-8hmgq\") pod \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\" (UID: \"aa34da09-dbe2-48ee-bfc1-7427eda1526b\") " Jul 07 16:05:29.625720 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.625663 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa34da09-dbe2-48ee-bfc1-7427eda1526b" (UID: "aa34da09-dbe2-48ee-bfc1-7427eda1526b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:05:29.625947 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.625714 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa34da09-dbe2-48ee-bfc1-7427eda1526b" (UID: "aa34da09-dbe2-48ee-bfc1-7427eda1526b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:05:29.625947 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.625752 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa34da09-dbe2-48ee-bfc1-7427eda1526b" (UID: "aa34da09-dbe2-48ee-bfc1-7427eda1526b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:05:29.625947 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.625815 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa34da09-dbe2-48ee-bfc1-7427eda1526b" (UID: "aa34da09-dbe2-48ee-bfc1-7427eda1526b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:05:29.626103 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.625949 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istiod-ca-cert\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:29.626103 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.625969 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-workload-certs\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:29.626103 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.625983 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-workload-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:29.626103 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.625995 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-credential-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:29.626783 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.626757 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa34da09-dbe2-48ee-bfc1-7427eda1526b" (UID: "aa34da09-dbe2-48ee-bfc1-7427eda1526b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:05:29.627598 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.627572 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa34da09-dbe2-48ee-bfc1-7427eda1526b" (UID: "aa34da09-dbe2-48ee-bfc1-7427eda1526b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 16:05:29.627823 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.627795 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa34da09-dbe2-48ee-bfc1-7427eda1526b-kube-api-access-8hmgq" (OuterVolumeSpecName: "kube-api-access-8hmgq") pod "aa34da09-dbe2-48ee-bfc1-7427eda1526b" (UID: "aa34da09-dbe2-48ee-bfc1-7427eda1526b"). InnerVolumeSpecName "kube-api-access-8hmgq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:05:29.627934 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.627826 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa34da09-dbe2-48ee-bfc1-7427eda1526b" (UID: "aa34da09-dbe2-48ee-bfc1-7427eda1526b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:05:29.627934 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.627903 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa34da09-dbe2-48ee-bfc1-7427eda1526b" (UID: "aa34da09-dbe2-48ee-bfc1-7427eda1526b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:05:29.712825 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.712739 2572 generic.go:356] "Generic (PLEG): container finished" podID="aa34da09-dbe2-48ee-bfc1-7427eda1526b" containerID="52c98402e84f3f9f06e0d5d00a0f8930e2bd9948fb83cfc28b736ba28a98c5fa" exitCode=0 Jul 07 16:05:29.712825 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.712786 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" Jul 07 16:05:29.712825 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.712809 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" event={"ID":"aa34da09-dbe2-48ee-bfc1-7427eda1526b","Type":"ContainerDied","Data":"52c98402e84f3f9f06e0d5d00a0f8930e2bd9948fb83cfc28b736ba28a98c5fa"} Jul 07 16:05:29.713085 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.712871 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8" event={"ID":"aa34da09-dbe2-48ee-bfc1-7427eda1526b","Type":"ContainerDied","Data":"31f817cc305a76229259298c2a43081bfe737f485500b87224d60f11d5205acb"} Jul 07 16:05:29.713085 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.712899 2572 scope.go:117] "RemoveContainer" containerID="52c98402e84f3f9f06e0d5d00a0f8930e2bd9948fb83cfc28b736ba28a98c5fa" Jul 07 16:05:29.722774 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.722754 2572 scope.go:117] "RemoveContainer" containerID="52c98402e84f3f9f06e0d5d00a0f8930e2bd9948fb83cfc28b736ba28a98c5fa" Jul 07 16:05:29.723082 ip-10-0-138-64 kubenswrapper[2572]: E0707 16:05:29.723061 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52c98402e84f3f9f06e0d5d00a0f8930e2bd9948fb83cfc28b736ba28a98c5fa\": container with ID starting with 52c98402e84f3f9f06e0d5d00a0f8930e2bd9948fb83cfc28b736ba28a98c5fa not found: ID does not exist" containerID="52c98402e84f3f9f06e0d5d00a0f8930e2bd9948fb83cfc28b736ba28a98c5fa" Jul 07 16:05:29.723164 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.723097 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52c98402e84f3f9f06e0d5d00a0f8930e2bd9948fb83cfc28b736ba28a98c5fa"} err="failed to get container status \"52c98402e84f3f9f06e0d5d00a0f8930e2bd9948fb83cfc28b736ba28a98c5fa\": rpc error: code = NotFound desc = could not find container \"52c98402e84f3f9f06e0d5d00a0f8930e2bd9948fb83cfc28b736ba28a98c5fa\": container with ID starting with 52c98402e84f3f9f06e0d5d00a0f8930e2bd9948fb83cfc28b736ba28a98c5fa not found: ID does not exist" Jul 07 16:05:29.726741 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.726720 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-token\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:29.726825 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.726742 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-data\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:29.726825 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.726755 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hmgq\" (UniqueName: \"kubernetes.io/projected/aa34da09-dbe2-48ee-bfc1-7427eda1526b-kube-api-access-8hmgq\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:29.726825 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.726768 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-podinfo\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:29.726825 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.726780 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa34da09-dbe2-48ee-bfc1-7427eda1526b-istio-envoy\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:29.735915 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.735890 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8"] Jul 07 16:05:29.741197 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:29.741175 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-18541f86-openshift-default-cd6b58965-swms8"] Jul 07 16:05:30.377577 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:30.377540 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa34da09-dbe2-48ee-bfc1-7427eda1526b" path="/var/lib/kubelet/pods/aa34da09-dbe2-48ee-bfc1-7427eda1526b/volumes" Jul 07 16:05:30.938664 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:30.938623 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:35.365366 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.365322 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:35.437924 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.437887 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:35.566725 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.566692 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg"] Jul 07 16:05:35.567151 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.567137 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a214e12-b2fe-4671-b2e8-f42830fe81d9" containerName="istio-proxy" Jul 07 16:05:35.567219 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.567154 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a214e12-b2fe-4671-b2e8-f42830fe81d9" containerName="istio-proxy" Jul 07 16:05:35.567219 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.567180 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa34da09-dbe2-48ee-bfc1-7427eda1526b" containerName="istio-proxy" Jul 07 16:05:35.567219 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.567185 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa34da09-dbe2-48ee-bfc1-7427eda1526b" containerName="istio-proxy" Jul 07 16:05:35.567329 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.567245 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a214e12-b2fe-4671-b2e8-f42830fe81d9" containerName="istio-proxy" Jul 07 16:05:35.567329 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.567256 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa34da09-dbe2-48ee-bfc1-7427eda1526b" containerName="istio-proxy" Jul 07 16:05:35.570651 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.570627 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.573765 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.573747 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-15eb70f8-openshift-default-dockercfg-5b5vn\"" Jul 07 16:05:35.587714 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.587686 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg"] Jul 07 16:05:35.618395 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.618366 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:35.686341 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.686293 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd7rv\" (UniqueName: \"kubernetes.io/projected/2d729992-b47a-4797-a71f-3639d1888fb6-kube-api-access-wd7rv\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.686341 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.686357 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-credential-socket\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.686580 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.686381 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-istio-data\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.686580 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.686440 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-workload-certs\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.686580 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.686551 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d729992-b47a-4797-a71f-3639d1888fb6-istiod-ca-cert\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.686711 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.686581 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d729992-b47a-4797-a71f-3639d1888fb6-istio-podinfo\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.686711 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.686606 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-workload-socket\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.686711 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.686688 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d729992-b47a-4797-a71f-3639d1888fb6-istio-token\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.686829 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.686713 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-istio-envoy\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.721565 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.721525 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:35.794414 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.788214 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-workload-socket\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.794414 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.788302 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d729992-b47a-4797-a71f-3639d1888fb6-istio-token\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.794414 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.788337 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-istio-envoy\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.794414 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.788398 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd7rv\" (UniqueName: \"kubernetes.io/projected/2d729992-b47a-4797-a71f-3639d1888fb6-kube-api-access-wd7rv\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.794414 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.788460 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-credential-socket\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.794414 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.788490 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-istio-data\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.794414 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.788526 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-workload-certs\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.794414 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.788614 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d729992-b47a-4797-a71f-3639d1888fb6-istiod-ca-cert\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.794414 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.788649 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d729992-b47a-4797-a71f-3639d1888fb6-istio-podinfo\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.794414 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.792063 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d729992-b47a-4797-a71f-3639d1888fb6-istio-podinfo\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.794414 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.792381 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-workload-socket\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.795106 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.794779 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-workload-certs\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.795106 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.794914 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-credential-socket\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.795106 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.794931 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-istio-data\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.795507 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.795365 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d729992-b47a-4797-a71f-3639d1888fb6-istiod-ca-cert\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.795651 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.795628 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-istio-envoy\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.803475 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.803451 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d729992-b47a-4797-a71f-3639d1888fb6-istio-token\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.809052 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.809029 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd7rv\" (UniqueName: \"kubernetes.io/projected/2d729992-b47a-4797-a71f-3639d1888fb6-kube-api-access-wd7rv\") pod \"e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:35.880810 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:35.880713 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:36.027382 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:36.027341 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg"] Jul 07 16:05:36.035445 ip-10-0-138-64 kubenswrapper[2572]: W0707 16:05:36.035416 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d729992_b47a_4797_a71f_3639d1888fb6.slice/crio-86bd76755c5baf924231d810d697704c3a7573f48d2b363cf24eabbd3e0fe32a WatchSource:0}: Error finding container 86bd76755c5baf924231d810d697704c3a7573f48d2b363cf24eabbd3e0fe32a: Status 404 returned error can't find the container with id 86bd76755c5baf924231d810d697704c3a7573f48d2b363cf24eabbd3e0fe32a Jul 07 16:05:36.037631 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:36.037597 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:05:36.037695 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:36.037668 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:05:36.037732 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:36.037697 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:05:36.712637 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:36.712604 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:36.755221 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:36.755182 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" event={"ID":"2d729992-b47a-4797-a71f-3639d1888fb6","Type":"ContainerStarted","Data":"b8945eabb5677e038a9193b3c0e941cc3c3c65232706b2f3697257b00aac867a"} Jul 07 16:05:36.755399 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:36.755239 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" event={"ID":"2d729992-b47a-4797-a71f-3639d1888fb6","Type":"ContainerStarted","Data":"86bd76755c5baf924231d810d697704c3a7573f48d2b363cf24eabbd3e0fe32a"} Jul 07 16:05:36.790457 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:36.790393 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" podStartSLOduration=1.7903716520000001 podStartE2EDuration="1.790371652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:05:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:05:36.788625093 +0000 UTC m=+1494.938485604" watchObservedRunningTime="2026-07-07 16:05:36.790371652 +0000 UTC m=+1494.940232159" Jul 07 16:05:36.878781 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:36.878750 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:36.881653 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:36.881632 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:37.019929 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:37.019815 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:37.338184 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:37.338090 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:37.885714 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:37.885687 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:38.690186 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:38.690151 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:38.766620 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:38.766594 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:38.767545 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:38.767524 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:38.969151 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:38.969109 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:41.188381 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:41.188342 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:41.350241 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:41.350208 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg"] Jul 07 16:05:41.371145 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:41.371099 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:41.484082 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:41.483982 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:41.585540 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:41.585511 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:41.780975 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:41.780871 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" podUID="2d729992-b47a-4797-a71f-3639d1888fb6" containerName="istio-proxy" containerID="cri-o://b8945eabb5677e038a9193b3c0e941cc3c3c65232706b2f3697257b00aac867a" gracePeriod=30 Jul 07 16:05:42.391567 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:42.391541 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 16:05:42.393219 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:42.393195 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 16:05:43.627896 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:43.627794 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:47.201345 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.201314 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:47.263367 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.263341 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:47.332076 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.332052 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:47.408454 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.408417 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d729992-b47a-4797-a71f-3639d1888fb6-istio-podinfo\") pod \"2d729992-b47a-4797-a71f-3639d1888fb6\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " Jul 07 16:05:47.408627 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.408473 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-workload-socket\") pod \"2d729992-b47a-4797-a71f-3639d1888fb6\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " Jul 07 16:05:47.408627 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.408509 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-istio-envoy\") pod \"2d729992-b47a-4797-a71f-3639d1888fb6\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " Jul 07 16:05:47.408627 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.408604 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d729992-b47a-4797-a71f-3639d1888fb6-istiod-ca-cert\") pod \"2d729992-b47a-4797-a71f-3639d1888fb6\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " Jul 07 16:05:47.408749 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.408634 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-istio-data\") pod \"2d729992-b47a-4797-a71f-3639d1888fb6\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " Jul 07 16:05:47.408749 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.408675 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-workload-certs\") pod \"2d729992-b47a-4797-a71f-3639d1888fb6\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " Jul 07 16:05:47.408749 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.408711 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-credential-socket\") pod \"2d729992-b47a-4797-a71f-3639d1888fb6\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " Jul 07 16:05:47.408749 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.408741 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d729992-b47a-4797-a71f-3639d1888fb6-istio-token\") pod \"2d729992-b47a-4797-a71f-3639d1888fb6\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " Jul 07 16:05:47.408986 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.408769 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wd7rv\" (UniqueName: \"kubernetes.io/projected/2d729992-b47a-4797-a71f-3639d1888fb6-kube-api-access-wd7rv\") pod \"2d729992-b47a-4797-a71f-3639d1888fb6\" (UID: \"2d729992-b47a-4797-a71f-3639d1888fb6\") " Jul 07 16:05:47.408986 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.408881 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d729992-b47a-4797-a71f-3639d1888fb6" (UID: "2d729992-b47a-4797-a71f-3639d1888fb6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:05:47.409098 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.409051 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d729992-b47a-4797-a71f-3639d1888fb6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d729992-b47a-4797-a71f-3639d1888fb6" (UID: "2d729992-b47a-4797-a71f-3639d1888fb6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:05:47.409218 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.409179 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d729992-b47a-4797-a71f-3639d1888fb6" (UID: "2d729992-b47a-4797-a71f-3639d1888fb6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:05:47.409297 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.409221 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d729992-b47a-4797-a71f-3639d1888fb6" (UID: "2d729992-b47a-4797-a71f-3639d1888fb6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:05:47.409297 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.409275 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d729992-b47a-4797-a71f-3639d1888fb6-istiod-ca-cert\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:47.409420 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.409298 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-credential-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:47.409476 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.409417 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d729992-b47a-4797-a71f-3639d1888fb6" (UID: "2d729992-b47a-4797-a71f-3639d1888fb6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:05:47.409476 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.409398 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-workload-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:47.410914 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.410833 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d729992-b47a-4797-a71f-3639d1888fb6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d729992-b47a-4797-a71f-3639d1888fb6" (UID: "2d729992-b47a-4797-a71f-3639d1888fb6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 16:05:47.410914 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.410877 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d729992-b47a-4797-a71f-3639d1888fb6" (UID: "2d729992-b47a-4797-a71f-3639d1888fb6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:05:47.411075 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.411056 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d729992-b47a-4797-a71f-3639d1888fb6-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d729992-b47a-4797-a71f-3639d1888fb6" (UID: "2d729992-b47a-4797-a71f-3639d1888fb6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:05:47.411276 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.411260 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d729992-b47a-4797-a71f-3639d1888fb6-kube-api-access-wd7rv" (OuterVolumeSpecName: "kube-api-access-wd7rv") pod "2d729992-b47a-4797-a71f-3639d1888fb6" (UID: "2d729992-b47a-4797-a71f-3639d1888fb6"). InnerVolumeSpecName "kube-api-access-wd7rv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:05:47.510787 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.510747 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d729992-b47a-4797-a71f-3639d1888fb6-istio-podinfo\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:47.510787 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.510786 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-istio-envoy\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:47.510787 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.510797 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-istio-data\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:47.511079 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.510807 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d729992-b47a-4797-a71f-3639d1888fb6-workload-certs\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:47.511079 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.510817 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d729992-b47a-4797-a71f-3639d1888fb6-istio-token\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:47.511079 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.510830 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd7rv\" (UniqueName: \"kubernetes.io/projected/2d729992-b47a-4797-a71f-3639d1888fb6-kube-api-access-wd7rv\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:05:47.703426 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.703337 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:47.814303 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.814268 2572 generic.go:356] "Generic (PLEG): container finished" podID="2d729992-b47a-4797-a71f-3639d1888fb6" containerID="b8945eabb5677e038a9193b3c0e941cc3c3c65232706b2f3697257b00aac867a" exitCode=0 Jul 07 16:05:47.814478 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.814316 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" Jul 07 16:05:47.814478 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.814346 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" event={"ID":"2d729992-b47a-4797-a71f-3639d1888fb6","Type":"ContainerDied","Data":"b8945eabb5677e038a9193b3c0e941cc3c3c65232706b2f3697257b00aac867a"} Jul 07 16:05:47.814478 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.814401 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg" event={"ID":"2d729992-b47a-4797-a71f-3639d1888fb6","Type":"ContainerDied","Data":"86bd76755c5baf924231d810d697704c3a7573f48d2b363cf24eabbd3e0fe32a"} Jul 07 16:05:47.814478 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.814425 2572 scope.go:117] "RemoveContainer" containerID="b8945eabb5677e038a9193b3c0e941cc3c3c65232706b2f3697257b00aac867a" Jul 07 16:05:47.827252 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.827114 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:47.827252 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.827244 2572 scope.go:117] "RemoveContainer" containerID="b8945eabb5677e038a9193b3c0e941cc3c3c65232706b2f3697257b00aac867a" Jul 07 16:05:47.827527 ip-10-0-138-64 kubenswrapper[2572]: E0707 16:05:47.827510 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8945eabb5677e038a9193b3c0e941cc3c3c65232706b2f3697257b00aac867a\": container with ID starting with b8945eabb5677e038a9193b3c0e941cc3c3c65232706b2f3697257b00aac867a not found: ID does not exist" containerID="b8945eabb5677e038a9193b3c0e941cc3c3c65232706b2f3697257b00aac867a" Jul 07 16:05:47.827572 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.827537 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8945eabb5677e038a9193b3c0e941cc3c3c65232706b2f3697257b00aac867a"} err="failed to get container status \"b8945eabb5677e038a9193b3c0e941cc3c3c65232706b2f3697257b00aac867a\": rpc error: code = NotFound desc = could not find container \"b8945eabb5677e038a9193b3c0e941cc3c3c65232706b2f3697257b00aac867a\": container with ID starting with b8945eabb5677e038a9193b3c0e941cc3c3c65232706b2f3697257b00aac867a not found: ID does not exist" Jul 07 16:05:47.846354 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.846322 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg"] Jul 07 16:05:47.855768 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.855727 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-15eb70f8-openshift-default-79fbfbbd4c-fjbzg"] Jul 07 16:05:47.930313 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:47.930278 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:48.378180 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:48.378149 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d729992-b47a-4797-a71f-3639d1888fb6" path="/var/lib/kubelet/pods/2d729992-b47a-4797-a71f-3639d1888fb6/volumes" Jul 07 16:05:49.405842 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:49.405806 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:55.074802 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:55.074753 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:55.185432 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:55.185395 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:55.313035 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:55.313002 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:05:55.795816 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:05:55.795781 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:06:21.803162 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:06:21.803120 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:06:28.078338 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:06:28.078294 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:06:28.232011 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:06:28.231973 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:06:28.360088 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:06:28.360009 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:06:44.231130 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:06:44.231091 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:06:50.245478 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:06:50.245443 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:06:50.375632 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:06:50.375592 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:06:50.533924 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:06:50.533803 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:01.000926 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:01.000894 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:01.871787 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:01.871748 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:07.748162 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:07.748126 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:07.862020 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:07.861977 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:07.948160 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:07.948130 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:08.048662 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:08.048574 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:08.151991 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:08.151947 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:08.943107 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:08.943075 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:09.046615 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:09.046582 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:09.142269 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:09.142222 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:10.846203 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:10.846159 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:16.629306 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:16.629270 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:16.728157 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:16.728120 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:17.349070 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:17.349034 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:22.622707 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:22.622667 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:22.723128 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:22.723088 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:23.355058 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:23.355027 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:23.453642 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:23.453608 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:23.651984 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:23.651929 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:23.914593 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:23.914510 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96"] Jul 07 16:07:23.914963 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:23.914947 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d729992-b47a-4797-a71f-3639d1888fb6" containerName="istio-proxy" Jul 07 16:07:23.915011 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:23.914966 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d729992-b47a-4797-a71f-3639d1888fb6" containerName="istio-proxy" Jul 07 16:07:23.915055 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:23.915046 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d729992-b47a-4797-a71f-3639d1888fb6" containerName="istio-proxy" Jul 07 16:07:23.917357 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:23.917340 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:23.920111 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:23.920090 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1cc03dc5-openshift-default-dockercfg-5dklq\"" Jul 07 16:07:23.941403 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:23.941372 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96"] Jul 07 16:07:23.942535 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:23.942510 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:24.059251 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.059210 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-workload-socket\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.059251 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.059252 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-data\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.059457 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.059275 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-credential-socket\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.059457 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.059364 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrnxf\" (UniqueName: \"kubernetes.io/projected/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-kube-api-access-hrnxf\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.059457 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.059401 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-envoy\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.059560 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.059476 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-workload-certs\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.059560 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.059502 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-token\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.059560 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.059532 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-podinfo\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.059654 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.059562 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istiod-ca-cert\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.066527 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.066498 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:24.160692 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.160648 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-podinfo\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.160919 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.160699 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istiod-ca-cert\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.160919 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.160751 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-workload-socket\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.160919 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.160771 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-data\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.160919 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.160791 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-credential-socket\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.160919 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.160822 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrnxf\" (UniqueName: \"kubernetes.io/projected/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-kube-api-access-hrnxf\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.160919 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.160882 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-envoy\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.161203 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.160940 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-workload-certs\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.161203 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.160960 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-token\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.161305 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.161258 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-workload-socket\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.161361 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.161339 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-credential-socket\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.161415 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.161379 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-data\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.161581 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.161563 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istiod-ca-cert\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.161724 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.161703 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-workload-certs\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.163267 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.163245 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-envoy\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.163363 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.163315 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-podinfo\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.169573 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.169515 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrnxf\" (UniqueName: \"kubernetes.io/projected/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-kube-api-access-hrnxf\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.169648 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.169591 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-token\") pod \"e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.227135 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.227100 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:24.366987 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.366961 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96"] Jul 07 16:07:24.369261 ip-10-0-138-64 kubenswrapper[2572]: W0707 16:07:24.369232 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5a8ace_f90b_4aba_a4ba_68ffe65c10e9.slice/crio-9b56117cadbe6cb0a31fef7175e9471c96fe0a8509bf743fb2767f96371d9bee WatchSource:0}: Error finding container 9b56117cadbe6cb0a31fef7175e9471c96fe0a8509bf743fb2767f96371d9bee: Status 404 returned error can't find the container with id 9b56117cadbe6cb0a31fef7175e9471c96fe0a8509bf743fb2767f96371d9bee Jul 07 16:07:24.371335 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.371298 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:07:24.371422 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.371368 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:07:24.371422 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:24.371396 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:07:25.285715 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:25.285677 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" event={"ID":"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9","Type":"ContainerStarted","Data":"a17a24c6bafc98a95a1b034619e6581d14327c8e3a748dc94afa67848af7584a"} Jul 07 16:07:25.286152 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:25.285742 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" event={"ID":"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9","Type":"ContainerStarted","Data":"9b56117cadbe6cb0a31fef7175e9471c96fe0a8509bf743fb2767f96371d9bee"} Jul 07 16:07:25.312378 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:25.312326 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" podStartSLOduration=2.312303284 podStartE2EDuration="2.312303284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:07:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:07:25.309356595 +0000 UTC m=+1603.459217101" watchObservedRunningTime="2026-07-07 16:07:25.312303284 +0000 UTC m=+1603.462163790" Jul 07 16:07:26.227845 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:26.227804 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:26.232337 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:26.232313 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:26.290555 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:26.290527 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:26.291440 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:26.291422 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:27.297495 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:27.297463 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:27.400252 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:27.400215 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:27.470093 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:27.470064 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:27.908469 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:27.908431 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:28.117235 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:28.117203 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:28.218937 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:28.218842 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:31.808775 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:31.808740 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:32.508613 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:32.508574 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:32.607106 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:32.607013 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:32.960002 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:32.959971 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:38.867774 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:38.867738 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:38.968573 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:38.968538 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:39.306889 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:39.306790 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:39.711848 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:39.711807 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:39.779914 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:39.779884 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:40.363765 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:40.363731 2572 generic.go:356] "Generic (PLEG): container finished" podID="7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" containerID="a17a24c6bafc98a95a1b034619e6581d14327c8e3a748dc94afa67848af7584a" exitCode=0 Jul 07 16:07:40.364166 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:40.363807 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" event={"ID":"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9","Type":"ContainerDied","Data":"a17a24c6bafc98a95a1b034619e6581d14327c8e3a748dc94afa67848af7584a"} Jul 07 16:07:40.364292 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:40.364277 2572 scope.go:117] "RemoveContainer" containerID="a17a24c6bafc98a95a1b034619e6581d14327c8e3a748dc94afa67848af7584a" Jul 07 16:07:40.365326 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:40.365296 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:07:40.365402 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:40.365386 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:07:40.365451 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:40.365437 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:07:41.291417 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:41.291375 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:41.371244 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:41.371202 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" event={"ID":"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9","Type":"ContainerStarted","Data":"95e057d94d03dfdb2bb8ae636ca4fea692b3f3887dc3c35750eae9f524d49425"} Jul 07 16:07:42.227826 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:42.227787 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:42.229010 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:42.228983 2572 patch_prober.go:28] interesting pod/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 07 16:07:42.229147 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:42.229036 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" podUID="7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 07 16:07:43.228009 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:43.227969 2572 patch_prober.go:28] interesting pod/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 07 16:07:43.228478 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:43.228040 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" podUID="7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 07 16:07:44.228296 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:44.228252 2572 patch_prober.go:28] interesting pod/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 07 16:07:44.228792 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:44.228326 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" podUID="7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 07 16:07:45.227662 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:45.227621 2572 patch_prober.go:28] interesting pod/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 07 16:07:45.227903 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:45.227683 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" podUID="7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 07 16:07:45.777980 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:45.777950 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:45.887332 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:45.887298 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:46.040955 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:46.040876 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96"] Jul 07 16:07:46.041102 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:46.041081 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" podUID="7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" containerName="istio-proxy" containerID="cri-o://95e057d94d03dfdb2bb8ae636ca4fea692b3f3887dc3c35750eae9f524d49425" gracePeriod=30 Jul 07 16:07:46.066949 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:46.066907 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:46.303084 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:46.302979 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:46.462740 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:46.462710 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:46.584335 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:46.584249 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:46.803875 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:46.803805 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:51.292130 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.292105 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:51.340270 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.340171 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-data\") pod \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " Jul 07 16:07:51.340270 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.340216 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrnxf\" (UniqueName: \"kubernetes.io/projected/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-kube-api-access-hrnxf\") pod \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " Jul 07 16:07:51.340270 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.340240 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istiod-ca-cert\") pod \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " Jul 07 16:07:51.340270 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.340265 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-credential-socket\") pod \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " Jul 07 16:07:51.340596 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.340324 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-workload-socket\") pod \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " Jul 07 16:07:51.340596 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.340384 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-workload-certs\") pod \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " Jul 07 16:07:51.340596 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.340406 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-token\") pod \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " Jul 07 16:07:51.340596 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.340427 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-podinfo\") pod \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " Jul 07 16:07:51.340596 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.340553 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-envoy\") pod \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\" (UID: \"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9\") " Jul 07 16:07:51.340596 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.340568 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" (UID: "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:07:51.340596 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.340582 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" (UID: "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:07:51.340976 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.340899 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-credential-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:07:51.340976 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.340920 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-workload-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:07:51.340976 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.340957 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" (UID: "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:07:51.341199 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.341175 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" (UID: "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:07:51.341266 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.341197 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-data" (OuterVolumeSpecName: "istio-data") pod "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" (UID: "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:07:51.342889 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.342836 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" (UID: "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 16:07:51.343037 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.342890 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-token" (OuterVolumeSpecName: "istio-token") pod "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" (UID: "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:07:51.343243 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.343222 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-kube-api-access-hrnxf" (OuterVolumeSpecName: "kube-api-access-hrnxf") pod "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" (UID: "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9"). InnerVolumeSpecName "kube-api-access-hrnxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:07:51.343319 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.343237 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" (UID: "7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:07:51.421018 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.420984 2572 generic.go:356] "Generic (PLEG): container finished" podID="7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" containerID="95e057d94d03dfdb2bb8ae636ca4fea692b3f3887dc3c35750eae9f524d49425" exitCode=0 Jul 07 16:07:51.421174 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.421035 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" Jul 07 16:07:51.421174 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.421069 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" event={"ID":"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9","Type":"ContainerDied","Data":"95e057d94d03dfdb2bb8ae636ca4fea692b3f3887dc3c35750eae9f524d49425"} Jul 07 16:07:51.421174 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.421121 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96" event={"ID":"7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9","Type":"ContainerDied","Data":"9b56117cadbe6cb0a31fef7175e9471c96fe0a8509bf743fb2767f96371d9bee"} Jul 07 16:07:51.421174 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.421142 2572 scope.go:117] "RemoveContainer" containerID="95e057d94d03dfdb2bb8ae636ca4fea692b3f3887dc3c35750eae9f524d49425" Jul 07 16:07:51.438323 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.438300 2572 scope.go:117] "RemoveContainer" containerID="a17a24c6bafc98a95a1b034619e6581d14327c8e3a748dc94afa67848af7584a" Jul 07 16:07:51.441915 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.441889 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-envoy\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:07:51.442041 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.441917 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-data\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:07:51.442041 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.441931 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrnxf\" (UniqueName: \"kubernetes.io/projected/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-kube-api-access-hrnxf\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:07:51.442041 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.441945 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istiod-ca-cert\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:07:51.442041 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.441958 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-workload-certs\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:07:51.442041 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.441971 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-token\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:07:51.442041 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.441983 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9-istio-podinfo\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:07:51.446656 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.446638 2572 scope.go:117] "RemoveContainer" containerID="95e057d94d03dfdb2bb8ae636ca4fea692b3f3887dc3c35750eae9f524d49425" Jul 07 16:07:51.446952 ip-10-0-138-64 kubenswrapper[2572]: E0707 16:07:51.446931 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95e057d94d03dfdb2bb8ae636ca4fea692b3f3887dc3c35750eae9f524d49425\": container with ID starting with 95e057d94d03dfdb2bb8ae636ca4fea692b3f3887dc3c35750eae9f524d49425 not found: ID does not exist" containerID="95e057d94d03dfdb2bb8ae636ca4fea692b3f3887dc3c35750eae9f524d49425" Jul 07 16:07:51.447018 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.446960 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95e057d94d03dfdb2bb8ae636ca4fea692b3f3887dc3c35750eae9f524d49425"} err="failed to get container status \"95e057d94d03dfdb2bb8ae636ca4fea692b3f3887dc3c35750eae9f524d49425\": rpc error: code = NotFound desc = could not find container \"95e057d94d03dfdb2bb8ae636ca4fea692b3f3887dc3c35750eae9f524d49425\": container with ID starting with 95e057d94d03dfdb2bb8ae636ca4fea692b3f3887dc3c35750eae9f524d49425 not found: ID does not exist" Jul 07 16:07:51.447018 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.446978 2572 scope.go:117] "RemoveContainer" containerID="a17a24c6bafc98a95a1b034619e6581d14327c8e3a748dc94afa67848af7584a" Jul 07 16:07:51.447190 ip-10-0-138-64 kubenswrapper[2572]: E0707 16:07:51.447173 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a17a24c6bafc98a95a1b034619e6581d14327c8e3a748dc94afa67848af7584a\": container with ID starting with a17a24c6bafc98a95a1b034619e6581d14327c8e3a748dc94afa67848af7584a not found: ID does not exist" containerID="a17a24c6bafc98a95a1b034619e6581d14327c8e3a748dc94afa67848af7584a" Jul 07 16:07:51.447228 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.447195 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a17a24c6bafc98a95a1b034619e6581d14327c8e3a748dc94afa67848af7584a"} err="failed to get container status \"a17a24c6bafc98a95a1b034619e6581d14327c8e3a748dc94afa67848af7584a\": rpc error: code = NotFound desc = could not find container \"a17a24c6bafc98a95a1b034619e6581d14327c8e3a748dc94afa67848af7584a\": container with ID starting with a17a24c6bafc98a95a1b034619e6581d14327c8e3a748dc94afa67848af7584a not found: ID does not exist" Jul 07 16:07:51.451014 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.450985 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96"] Jul 07 16:07:51.457765 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:51.457744 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1cc03dc5-openshift-default-6fc9d7f5dc-77c96"] Jul 07 16:07:52.377608 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:52.377569 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" path="/var/lib/kubelet/pods/7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9/volumes" Jul 07 16:07:52.543050 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:52.543017 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:52.624589 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:52.624549 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:52.715273 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:52.715180 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:52.904453 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:52.904422 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:58.685609 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:58.685546 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:58.786339 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:07:58.786309 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:05.631439 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:05.631401 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:05.936347 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:05.936270 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw"] Jul 07 16:08:05.936697 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:05.936684 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" containerName="istio-proxy" Jul 07 16:08:05.936740 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:05.936699 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" containerName="istio-proxy" Jul 07 16:08:05.936740 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:05.936712 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" containerName="istio-proxy" Jul 07 16:08:05.936740 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:05.936717 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" containerName="istio-proxy" Jul 07 16:08:05.936839 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:05.936779 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" containerName="istio-proxy" Jul 07 16:08:05.940619 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:05.940597 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:05.943482 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:05.943457 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-30f6fc42-openshift-default-dockercfg-klz5d\"" Jul 07 16:08:05.953271 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:05.953247 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw"] Jul 07 16:08:05.972989 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:05.972953 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:06.083485 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.083444 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/387bd374-b036-4112-b384-6e603433f5ab-istio-token\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.083676 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.083498 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-istio-data\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.083676 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.083597 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-workload-socket\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.083676 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.083628 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-credential-socket\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.083676 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.083654 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/387bd374-b036-4112-b384-6e603433f5ab-istio-podinfo\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.083676 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.083669 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b6xc\" (UniqueName: \"kubernetes.io/projected/387bd374-b036-4112-b384-6e603433f5ab-kube-api-access-8b6xc\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.083905 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.083692 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-istio-envoy\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.083905 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.083747 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/387bd374-b036-4112-b384-6e603433f5ab-istiod-ca-cert\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.083905 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.083791 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-workload-certs\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.185119 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.185080 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-istio-data\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.185312 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.185149 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-workload-socket\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.185312 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.185179 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-credential-socket\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.185312 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.185212 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/387bd374-b036-4112-b384-6e603433f5ab-istio-podinfo\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.185464 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.185360 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b6xc\" (UniqueName: \"kubernetes.io/projected/387bd374-b036-4112-b384-6e603433f5ab-kube-api-access-8b6xc\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.185464 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.185422 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-istio-envoy\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.185578 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.185474 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/387bd374-b036-4112-b384-6e603433f5ab-istiod-ca-cert\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.185578 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.185530 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-istio-data\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.185578 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.185538 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-workload-certs\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.185578 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.185567 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-workload-socket\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.185791 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.185616 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/387bd374-b036-4112-b384-6e603433f5ab-istio-token\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.185912 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.185888 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-workload-certs\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.186027 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.186009 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-credential-socket\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.186243 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.186226 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/387bd374-b036-4112-b384-6e603433f5ab-istiod-ca-cert\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.187820 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.187778 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-istio-envoy\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.187820 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.187781 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/387bd374-b036-4112-b384-6e603433f5ab-istio-podinfo\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.194257 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.194236 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/387bd374-b036-4112-b384-6e603433f5ab-istio-token\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.194535 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.194514 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b6xc\" (UniqueName: \"kubernetes.io/projected/387bd374-b036-4112-b384-6e603433f5ab-kube-api-access-8b6xc\") pod \"e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.250942 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.250913 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:06.374030 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.373995 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:06.398283 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.398246 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw"] Jul 07 16:08:06.401661 ip-10-0-138-64 kubenswrapper[2572]: W0707 16:08:06.401633 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod387bd374_b036_4112_b384_6e603433f5ab.slice/crio-77a94b28fd21f3585e89dc8655f40a1dfd141e468b60f7dde585b63a5f24687b WatchSource:0}: Error finding container 77a94b28fd21f3585e89dc8655f40a1dfd141e468b60f7dde585b63a5f24687b: Status 404 returned error can't find the container with id 77a94b28fd21f3585e89dc8655f40a1dfd141e468b60f7dde585b63a5f24687b Jul 07 16:08:06.403711 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.403680 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:08:06.403772 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.403753 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:08:06.403809 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.403785 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:08:06.496301 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.496262 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" event={"ID":"387bd374-b036-4112-b384-6e603433f5ab","Type":"ContainerStarted","Data":"9607885af62a0409328ca4362727362a0136983472065ca711dd5a47837b482f"} Jul 07 16:08:06.496477 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.496321 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" event={"ID":"387bd374-b036-4112-b384-6e603433f5ab","Type":"ContainerStarted","Data":"77a94b28fd21f3585e89dc8655f40a1dfd141e468b60f7dde585b63a5f24687b"} Jul 07 16:08:06.517270 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:06.517210 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" podStartSLOduration=1.517189992 podStartE2EDuration="1.517189992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:08:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:08:06.516104749 +0000 UTC m=+1644.665965256" watchObservedRunningTime="2026-07-07 16:08:06.517189992 +0000 UTC m=+1644.667050503" Jul 07 16:08:07.251333 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:07.251295 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:07.256200 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:07.256164 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:07.501966 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:07.501886 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:07.502930 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:07.502913 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:08.489881 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:08.486237 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:08.597159 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:08.597122 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:08.693677 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:08.693633 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:08.808814 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:08.808726 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:09.293067 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:09.293037 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:09.394554 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:09.394508 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:13.005980 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:13.005947 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:23.430719 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:23.430080 2572 patch_prober.go:28] interesting pod/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": read tcp 10.134.0.2:40974->10.134.0.39:15021: read: connection reset by peer" start-of-body= Jul 07 16:08:23.430719 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:23.430143 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" podUID="387bd374-b036-4112-b384-6e603433f5ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": read tcp 10.134.0.2:40974->10.134.0.39:15021: read: connection reset by peer" Jul 07 16:08:23.583023 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:23.582981 2572 generic.go:356] "Generic (PLEG): container finished" podID="387bd374-b036-4112-b384-6e603433f5ab" containerID="9607885af62a0409328ca4362727362a0136983472065ca711dd5a47837b482f" exitCode=0 Jul 07 16:08:23.583218 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:23.583150 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" event={"ID":"387bd374-b036-4112-b384-6e603433f5ab","Type":"ContainerDied","Data":"9607885af62a0409328ca4362727362a0136983472065ca711dd5a47837b482f"} Jul 07 16:08:23.583631 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:23.583610 2572 scope.go:117] "RemoveContainer" containerID="9607885af62a0409328ca4362727362a0136983472065ca711dd5a47837b482f" Jul 07 16:08:23.584757 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:23.584725 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:08:23.584837 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:23.584818 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:08:23.584910 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:23.584893 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:08:24.256744 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:24.256713 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:24.589486 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:24.589408 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" event={"ID":"387bd374-b036-4112-b384-6e603433f5ab","Type":"ContainerStarted","Data":"49c696058f10e62226bb5f17034e3e4c52a72ef654af1d7da36ad3e71a9508e9"} Jul 07 16:08:25.251129 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:25.251090 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:25.251326 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:25.251303 2572 patch_prober.go:28] interesting pod/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 07 16:08:25.251372 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:25.251353 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" podUID="387bd374-b036-4112-b384-6e603433f5ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 07 16:08:26.251436 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:26.251400 2572 patch_prober.go:28] interesting pod/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 07 16:08:26.251822 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:26.251460 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" podUID="387bd374-b036-4112-b384-6e603433f5ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 07 16:08:27.251707 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:27.251671 2572 patch_prober.go:28] interesting pod/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 07 16:08:27.252106 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:27.251728 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" podUID="387bd374-b036-4112-b384-6e603433f5ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 07 16:08:28.252189 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:28.252152 2572 patch_prober.go:28] interesting pod/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 07 16:08:28.252543 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:28.252212 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" podUID="387bd374-b036-4112-b384-6e603433f5ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 07 16:08:29.254987 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:29.254958 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:29.255390 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:29.255370 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:29.256072 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:29.256057 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:08:29.635839 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:29.635806 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:29.737284 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:29.737238 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:30.546144 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:30.546102 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:30.648357 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:30.648319 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:55.773296 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:55.773260 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:56.186804 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:08:56.186773 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:01.927517 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:01.927476 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:06.960086 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:06.959996 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:43.658392 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:43.658356 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:44.509204 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:44.509152 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:50.165185 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:50.165142 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:50.264001 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:50.263955 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:50.428533 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:50.428446 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw"] Jul 07 16:09:50.428691 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:50.428666 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" podUID="387bd374-b036-4112-b384-6e603433f5ab" containerName="istio-proxy" containerID="cri-o://49c696058f10e62226bb5f17034e3e4c52a72ef654af1d7da36ad3e71a9508e9" gracePeriod=30 Jul 07 16:09:50.454864 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:50.454810 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:50.745652 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:50.745564 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:51.896937 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:51.896903 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:51.997755 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:51.997721 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:52.095242 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:52.095209 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:52.882950 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:52.882905 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:52.982706 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:52.982676 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:53.083466 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:53.083434 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:54.569152 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:54.569121 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:55.681639 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.681607 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:09:55.785392 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.785300 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-istio-envoy\") pod \"387bd374-b036-4112-b384-6e603433f5ab\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " Jul 07 16:09:55.785392 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.785350 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/387bd374-b036-4112-b384-6e603433f5ab-istio-podinfo\") pod \"387bd374-b036-4112-b384-6e603433f5ab\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " Jul 07 16:09:55.785392 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.785376 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/387bd374-b036-4112-b384-6e603433f5ab-istiod-ca-cert\") pod \"387bd374-b036-4112-b384-6e603433f5ab\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " Jul 07 16:09:55.785669 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.785406 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-credential-socket\") pod \"387bd374-b036-4112-b384-6e603433f5ab\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " Jul 07 16:09:55.785669 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.785452 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/387bd374-b036-4112-b384-6e603433f5ab-istio-token\") pod \"387bd374-b036-4112-b384-6e603433f5ab\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " Jul 07 16:09:55.785669 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.785482 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-istio-data\") pod \"387bd374-b036-4112-b384-6e603433f5ab\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " Jul 07 16:09:55.785669 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.785534 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-workload-certs\") pod \"387bd374-b036-4112-b384-6e603433f5ab\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " Jul 07 16:09:55.785669 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.785563 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8b6xc\" (UniqueName: \"kubernetes.io/projected/387bd374-b036-4112-b384-6e603433f5ab-kube-api-access-8b6xc\") pod \"387bd374-b036-4112-b384-6e603433f5ab\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " Jul 07 16:09:55.785669 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.785591 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-workload-socket\") pod \"387bd374-b036-4112-b384-6e603433f5ab\" (UID: \"387bd374-b036-4112-b384-6e603433f5ab\") " Jul 07 16:09:55.786021 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.785712 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "387bd374-b036-4112-b384-6e603433f5ab" (UID: "387bd374-b036-4112-b384-6e603433f5ab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:09:55.786021 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.785801 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/387bd374-b036-4112-b384-6e603433f5ab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "387bd374-b036-4112-b384-6e603433f5ab" (UID: "387bd374-b036-4112-b384-6e603433f5ab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:09:55.786021 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.785978 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "387bd374-b036-4112-b384-6e603433f5ab" (UID: "387bd374-b036-4112-b384-6e603433f5ab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:09:55.786180 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.785995 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "387bd374-b036-4112-b384-6e603433f5ab" (UID: "387bd374-b036-4112-b384-6e603433f5ab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:09:55.786237 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.786186 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/387bd374-b036-4112-b384-6e603433f5ab-istiod-ca-cert\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:09:55.786237 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.786204 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-credential-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:09:55.786237 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.786220 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-workload-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:09:55.786816 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.786785 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-istio-data" (OuterVolumeSpecName: "istio-data") pod "387bd374-b036-4112-b384-6e603433f5ab" (UID: "387bd374-b036-4112-b384-6e603433f5ab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:09:55.787688 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.787664 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/387bd374-b036-4112-b384-6e603433f5ab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "387bd374-b036-4112-b384-6e603433f5ab" (UID: "387bd374-b036-4112-b384-6e603433f5ab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 16:09:55.787924 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.787905 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/387bd374-b036-4112-b384-6e603433f5ab-kube-api-access-8b6xc" (OuterVolumeSpecName: "kube-api-access-8b6xc") pod "387bd374-b036-4112-b384-6e603433f5ab" (UID: "387bd374-b036-4112-b384-6e603433f5ab"). InnerVolumeSpecName "kube-api-access-8b6xc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:09:55.788155 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.788135 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "387bd374-b036-4112-b384-6e603433f5ab" (UID: "387bd374-b036-4112-b384-6e603433f5ab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:09:55.788221 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.788135 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/387bd374-b036-4112-b384-6e603433f5ab-istio-token" (OuterVolumeSpecName: "istio-token") pod "387bd374-b036-4112-b384-6e603433f5ab" (UID: "387bd374-b036-4112-b384-6e603433f5ab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:09:55.886896 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.886839 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-workload-certs\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:09:55.886896 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.886893 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8b6xc\" (UniqueName: \"kubernetes.io/projected/387bd374-b036-4112-b384-6e603433f5ab-kube-api-access-8b6xc\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:09:55.887086 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.886905 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-istio-envoy\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:09:55.887086 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.886915 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/387bd374-b036-4112-b384-6e603433f5ab-istio-podinfo\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:09:55.887086 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.886923 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/387bd374-b036-4112-b384-6e603433f5ab-istio-token\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:09:55.887086 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:55.886930 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/387bd374-b036-4112-b384-6e603433f5ab-istio-data\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:09:56.056529 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:56.056437 2572 generic.go:356] "Generic (PLEG): container finished" podID="387bd374-b036-4112-b384-6e603433f5ab" containerID="49c696058f10e62226bb5f17034e3e4c52a72ef654af1d7da36ad3e71a9508e9" exitCode=0 Jul 07 16:09:56.056529 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:56.056500 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" Jul 07 16:09:56.056529 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:56.056518 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" event={"ID":"387bd374-b036-4112-b384-6e603433f5ab","Type":"ContainerDied","Data":"49c696058f10e62226bb5f17034e3e4c52a72ef654af1d7da36ad3e71a9508e9"} Jul 07 16:09:56.056744 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:56.056592 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw" event={"ID":"387bd374-b036-4112-b384-6e603433f5ab","Type":"ContainerDied","Data":"77a94b28fd21f3585e89dc8655f40a1dfd141e468b60f7dde585b63a5f24687b"} Jul 07 16:09:56.056744 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:56.056614 2572 scope.go:117] "RemoveContainer" containerID="49c696058f10e62226bb5f17034e3e4c52a72ef654af1d7da36ad3e71a9508e9" Jul 07 16:09:56.066095 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:56.066079 2572 scope.go:117] "RemoveContainer" containerID="9607885af62a0409328ca4362727362a0136983472065ca711dd5a47837b482f" Jul 07 16:09:56.074218 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:56.074200 2572 scope.go:117] "RemoveContainer" containerID="49c696058f10e62226bb5f17034e3e4c52a72ef654af1d7da36ad3e71a9508e9" Jul 07 16:09:56.074450 ip-10-0-138-64 kubenswrapper[2572]: E0707 16:09:56.074430 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49c696058f10e62226bb5f17034e3e4c52a72ef654af1d7da36ad3e71a9508e9\": container with ID starting with 49c696058f10e62226bb5f17034e3e4c52a72ef654af1d7da36ad3e71a9508e9 not found: ID does not exist" containerID="49c696058f10e62226bb5f17034e3e4c52a72ef654af1d7da36ad3e71a9508e9" Jul 07 16:09:56.074496 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:56.074459 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49c696058f10e62226bb5f17034e3e4c52a72ef654af1d7da36ad3e71a9508e9"} err="failed to get container status \"49c696058f10e62226bb5f17034e3e4c52a72ef654af1d7da36ad3e71a9508e9\": rpc error: code = NotFound desc = could not find container \"49c696058f10e62226bb5f17034e3e4c52a72ef654af1d7da36ad3e71a9508e9\": container with ID starting with 49c696058f10e62226bb5f17034e3e4c52a72ef654af1d7da36ad3e71a9508e9 not found: ID does not exist" Jul 07 16:09:56.074496 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:56.074476 2572 scope.go:117] "RemoveContainer" containerID="9607885af62a0409328ca4362727362a0136983472065ca711dd5a47837b482f" Jul 07 16:09:56.074732 ip-10-0-138-64 kubenswrapper[2572]: E0707 16:09:56.074714 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9607885af62a0409328ca4362727362a0136983472065ca711dd5a47837b482f\": container with ID starting with 9607885af62a0409328ca4362727362a0136983472065ca711dd5a47837b482f not found: ID does not exist" containerID="9607885af62a0409328ca4362727362a0136983472065ca711dd5a47837b482f" Jul 07 16:09:56.074773 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:56.074738 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9607885af62a0409328ca4362727362a0136983472065ca711dd5a47837b482f"} err="failed to get container status \"9607885af62a0409328ca4362727362a0136983472065ca711dd5a47837b482f\": rpc error: code = NotFound desc = could not find container \"9607885af62a0409328ca4362727362a0136983472065ca711dd5a47837b482f\": container with ID starting with 9607885af62a0409328ca4362727362a0136983472065ca711dd5a47837b482f not found: ID does not exist" Jul 07 16:09:56.079716 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:56.079689 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw"] Jul 07 16:09:56.083488 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:56.083467 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-30f6fc42-openshift-default-76bfdc58dc-cf4cw"] Jul 07 16:09:56.378067 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:09:56.378040 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="387bd374-b036-4112-b384-6e603433f5ab" path="/var/lib/kubelet/pods/387bd374-b036-4112-b384-6e603433f5ab/volumes" Jul 07 16:10:00.396903 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:00.396869 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:00.497368 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:00.497332 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:01.113075 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:01.113033 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:04.245538 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:04.245490 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:07.028896 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:07.028835 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:07.205883 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:07.205840 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:07.316185 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:07.316081 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:17.825276 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:17.825240 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:18.196485 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:18.196445 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:39.200815 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:39.200778 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:42.421086 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:42.421054 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 16:10:42.450915 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:42.450891 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 16:10:45.072200 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.072150 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:45.172256 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.172221 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:45.434648 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.434615 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:45.715426 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.715329 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9"] Jul 07 16:10:45.715812 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.715795 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="387bd374-b036-4112-b384-6e603433f5ab" containerName="istio-proxy" Jul 07 16:10:45.715812 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.715812 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="387bd374-b036-4112-b384-6e603433f5ab" containerName="istio-proxy" Jul 07 16:10:45.715968 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.715823 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="387bd374-b036-4112-b384-6e603433f5ab" containerName="istio-proxy" Jul 07 16:10:45.715968 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.715829 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="387bd374-b036-4112-b384-6e603433f5ab" containerName="istio-proxy" Jul 07 16:10:45.715968 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.715919 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="387bd374-b036-4112-b384-6e603433f5ab" containerName="istio-proxy" Jul 07 16:10:45.716149 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.715976 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="387bd374-b036-4112-b384-6e603433f5ab" containerName="istio-proxy" Jul 07 16:10:45.716149 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.715984 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e5a8ace-f90b-4aba-a4ba-68ffe65c10e9" containerName="istio-proxy" Jul 07 16:10:45.719164 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.719144 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.723155 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.723125 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-e6fe85-openshift-default-dockercfg-ps6gs\"" Jul 07 16:10:45.733368 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.733342 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9"] Jul 07 16:10:45.737312 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.737277 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:45.776726 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.776693 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-envoy\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.776917 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.776736 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-workload-certs\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.776917 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.776831 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9mb9\" (UniqueName: \"kubernetes.io/projected/561359f0-811b-4452-a9c4-c606bb0eceb8-kube-api-access-r9mb9\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.776917 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.776882 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-token\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.776917 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.776908 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-data\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.777153 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.776953 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-podinfo\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.777153 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.776984 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/561359f0-811b-4452-a9c4-c606bb0eceb8-istiod-ca-cert\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.777153 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.777056 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-credential-socket\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.777153 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.777079 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-workload-socket\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.878602 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.878568 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-credential-socket\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.878602 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.878615 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-workload-socket\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.878933 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.878646 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-envoy\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.878933 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.878669 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-workload-certs\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.878933 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.878844 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9mb9\" (UniqueName: \"kubernetes.io/projected/561359f0-811b-4452-a9c4-c606bb0eceb8-kube-api-access-r9mb9\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.878933 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.878906 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-token\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.878933 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.878927 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-data\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.879142 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.878951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-podinfo\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.879142 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.878989 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/561359f0-811b-4452-a9c4-c606bb0eceb8-istiod-ca-cert\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.879142 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.879063 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-credential-socket\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.879142 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.879075 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-workload-socket\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.879510 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.879491 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-workload-certs\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.879628 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.879567 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-data\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.879682 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.879669 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/561359f0-811b-4452-a9c4-c606bb0eceb8-istiod-ca-cert\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.881563 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.881538 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-envoy\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.881650 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.881633 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-podinfo\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.891136 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.891112 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-token\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.891796 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.891773 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9mb9\" (UniqueName: \"kubernetes.io/projected/561359f0-811b-4452-a9c4-c606bb0eceb8-kube-api-access-r9mb9\") pod \"e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:45.913120 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:45.913097 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:46.029779 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:46.029680 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:46.171904 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:46.171875 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9"] Jul 07 16:10:46.173584 ip-10-0-138-64 kubenswrapper[2572]: W0707 16:10:46.173562 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561359f0_811b_4452_a9c4_c606bb0eceb8.slice/crio-667a882142a62dd321edf8768d9ff7e73b4dc66ed6bed190c661c988d40c50d5 WatchSource:0}: Error finding container 667a882142a62dd321edf8768d9ff7e73b4dc66ed6bed190c661c988d40c50d5: Status 404 returned error can't find the container with id 667a882142a62dd321edf8768d9ff7e73b4dc66ed6bed190c661c988d40c50d5 Jul 07 16:10:46.175666 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:46.175634 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:10:46.175742 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:46.175699 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:10:46.175742 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:46.175730 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:10:46.305559 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:46.305456 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" event={"ID":"561359f0-811b-4452-a9c4-c606bb0eceb8","Type":"ContainerStarted","Data":"d235bd8bf2b7af9a8d4b1b932d966008ed5bf3057f72447cc8ebc05dcecd120b"} Jul 07 16:10:46.305559 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:46.305525 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" event={"ID":"561359f0-811b-4452-a9c4-c606bb0eceb8","Type":"ContainerStarted","Data":"667a882142a62dd321edf8768d9ff7e73b4dc66ed6bed190c661c988d40c50d5"} Jul 07 16:10:46.328442 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:46.328390 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" podStartSLOduration=1.328372814 podStartE2EDuration="1.328372814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:10:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:10:46.326483126 +0000 UTC m=+1804.476343635" watchObservedRunningTime="2026-07-07 16:10:46.328372814 +0000 UTC m=+1804.478233360" Jul 07 16:10:47.030663 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:47.030625 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:47.035009 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:47.034979 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:47.311047 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:47.310963 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:47.311999 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:47.311979 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:10:48.399400 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:48.399368 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:48.492229 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:48.492186 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:48.609696 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:48.609661 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:48.942172 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:48.942134 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:49.056545 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:49.056513 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:49.202194 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:49.202109 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:52.806831 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:52.806798 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:53.166627 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.166591 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:53.426542 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.426458 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h"] Jul 07 16:10:53.429947 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.429929 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.445233 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.445200 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h"] Jul 07 16:10:53.447651 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.447630 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-11d09f-openshift-default-dockercfg-nbc8j\"" Jul 07 16:10:53.475563 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.475536 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:53.556975 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.556941 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-envoy\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.557162 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.556980 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-podinfo\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.557162 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.557052 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwz7q\" (UniqueName: \"kubernetes.io/projected/a645a244-f6b5-49e5-a2a7-c76847d02797-kube-api-access-rwz7q\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.557162 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.557080 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-data\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.557162 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.557119 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-token\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.557162 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.557148 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-credential-socket\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.557367 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.557181 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-workload-certs\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.557367 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.557228 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-workload-socket\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.557367 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.557257 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a645a244-f6b5-49e5-a2a7-c76847d02797-istiod-ca-cert\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.658422 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.658388 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-envoy\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.658422 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.658428 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-podinfo\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.658658 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.658485 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwz7q\" (UniqueName: \"kubernetes.io/projected/a645a244-f6b5-49e5-a2a7-c76847d02797-kube-api-access-rwz7q\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.658658 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.658520 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-data\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.658658 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.658597 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-token\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.658658 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.658640 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-credential-socket\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.658968 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.658672 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-workload-certs\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.658968 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.658715 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-workload-socket\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.658968 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.658742 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a645a244-f6b5-49e5-a2a7-c76847d02797-istiod-ca-cert\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.659124 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.659091 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-data\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.659450 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.659190 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-credential-socket\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.659450 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.659229 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-workload-certs\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.659450 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.659419 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-workload-socket\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.659651 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.659584 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a645a244-f6b5-49e5-a2a7-c76847d02797-istiod-ca-cert\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.661395 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.661370 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-envoy\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.661504 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.661408 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-podinfo\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.666666 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.666642 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-token\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.666813 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.666796 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwz7q\" (UniqueName: \"kubernetes.io/projected/a645a244-f6b5-49e5-a2a7-c76847d02797-kube-api-access-rwz7q\") pod \"e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.667001 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.666983 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:53.740644 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.740555 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:53.881591 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.881565 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h"] Jul 07 16:10:53.883635 ip-10-0-138-64 kubenswrapper[2572]: W0707 16:10:53.883608 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda645a244_f6b5_49e5_a2a7_c76847d02797.slice/crio-a86812b6144667d331702d08b185a71f11d165e990d0d1cc286448ac539f0f11 WatchSource:0}: Error finding container a86812b6144667d331702d08b185a71f11d165e990d0d1cc286448ac539f0f11: Status 404 returned error can't find the container with id a86812b6144667d331702d08b185a71f11d165e990d0d1cc286448ac539f0f11 Jul 07 16:10:53.885627 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.885596 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:10:53.885706 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.885662 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:10:53.885706 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:53.885694 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:10:54.349981 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:54.349945 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" event={"ID":"a645a244-f6b5-49e5-a2a7-c76847d02797","Type":"ContainerStarted","Data":"04aa61d02c5ec1639d003e09eaf20400dafb93e51b43e638139fe4c1068410cb"} Jul 07 16:10:54.350159 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:54.350034 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" event={"ID":"a645a244-f6b5-49e5-a2a7-c76847d02797","Type":"ContainerStarted","Data":"a86812b6144667d331702d08b185a71f11d165e990d0d1cc286448ac539f0f11"} Jul 07 16:10:54.741458 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:54.741422 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:54.746626 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:54.746598 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:54.768246 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:54.768202 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" podStartSLOduration=1.768188319 podStartE2EDuration="1.768188319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:10:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:10:54.369940017 +0000 UTC m=+1812.519800524" watchObservedRunningTime="2026-07-07 16:10:54.768188319 +0000 UTC m=+1812.918048836" Jul 07 16:10:55.355545 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:55.355510 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:55.356482 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:55.356466 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:10:56.323111 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:56.323079 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:56.419976 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:56.419884 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:56.482013 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:56.481968 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:56.585345 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:56.585254 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:57.008602 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:57.008543 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:57.091002 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:10:57.090972 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:11:00.857200 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:00.857159 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:11:02.755324 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:02.754893 2572 patch_prober.go:28] interesting pod/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": read tcp 10.134.0.2:35106->10.134.0.40:15021: read: connection reset by peer" start-of-body= Jul 07 16:11:02.755324 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:02.754979 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" podUID="561359f0-811b-4452-a9c4-c606bb0eceb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": read tcp 10.134.0.2:35106->10.134.0.40:15021: read: connection reset by peer" Jul 07 16:11:03.398333 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:03.398289 2572 generic.go:356] "Generic (PLEG): container finished" podID="561359f0-811b-4452-a9c4-c606bb0eceb8" containerID="d235bd8bf2b7af9a8d4b1b932d966008ed5bf3057f72447cc8ebc05dcecd120b" exitCode=0 Jul 07 16:11:03.398550 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:03.398365 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" event={"ID":"561359f0-811b-4452-a9c4-c606bb0eceb8","Type":"ContainerDied","Data":"d235bd8bf2b7af9a8d4b1b932d966008ed5bf3057f72447cc8ebc05dcecd120b"} Jul 07 16:11:03.398964 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:03.398941 2572 scope.go:117] "RemoveContainer" containerID="d235bd8bf2b7af9a8d4b1b932d966008ed5bf3057f72447cc8ebc05dcecd120b" Jul 07 16:11:03.400845 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:03.400796 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:11:03.400980 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:03.400931 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:11:03.401049 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:03.400978 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:11:04.408558 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:04.408514 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" event={"ID":"561359f0-811b-4452-a9c4-c606bb0eceb8","Type":"ContainerStarted","Data":"a79cf45ea59dafc44de052ee6197630f5ad3b16bc9bf8011ffdbf0cbfa2ea237"} Jul 07 16:11:04.840893 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:04.840781 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:11:05.030207 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:05.030161 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:11:05.030406 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:05.030383 2572 patch_prober.go:28] interesting pod/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 07 16:11:05.030461 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:05.030431 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" podUID="561359f0-811b-4452-a9c4-c606bb0eceb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 07 16:11:06.030983 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:06.030945 2572 patch_prober.go:28] interesting pod/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 07 16:11:06.031471 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:06.031008 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" podUID="561359f0-811b-4452-a9c4-c606bb0eceb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 07 16:11:07.030404 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:07.030369 2572 patch_prober.go:28] interesting pod/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 07 16:11:07.030594 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:07.030440 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" podUID="561359f0-811b-4452-a9c4-c606bb0eceb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 07 16:11:08.030026 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:08.029985 2572 patch_prober.go:28] interesting pod/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 07 16:11:08.030440 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:08.030045 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" podUID="561359f0-811b-4452-a9c4-c606bb0eceb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 07 16:11:08.434203 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:08.434159 2572 generic.go:356] "Generic (PLEG): container finished" podID="a645a244-f6b5-49e5-a2a7-c76847d02797" containerID="04aa61d02c5ec1639d003e09eaf20400dafb93e51b43e638139fe4c1068410cb" exitCode=0 Jul 07 16:11:08.434203 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:08.434201 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" event={"ID":"a645a244-f6b5-49e5-a2a7-c76847d02797","Type":"ContainerDied","Data":"04aa61d02c5ec1639d003e09eaf20400dafb93e51b43e638139fe4c1068410cb"} Jul 07 16:11:08.434602 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:08.434586 2572 scope.go:117] "RemoveContainer" containerID="04aa61d02c5ec1639d003e09eaf20400dafb93e51b43e638139fe4c1068410cb" Jul 07 16:11:08.435670 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:08.435643 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:11:08.435723 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:08.435711 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:11:08.435762 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:08.435741 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:11:09.034177 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:09.034140 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:11:09.034621 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:09.034468 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:11:09.035284 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:09.035264 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:11:09.441557 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:09.441524 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" event={"ID":"a645a244-f6b5-49e5-a2a7-c76847d02797","Type":"ContainerStarted","Data":"c251a2019125070ca05e076af7ba83d00206789ab394d99f73daaba16be99d7f"} Jul 07 16:11:09.741816 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:09.741723 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:11:09.742952 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:09.742927 2572 patch_prober.go:28] interesting pod/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 07 16:11:09.743071 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:09.742975 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" podUID="a645a244-f6b5-49e5-a2a7-c76847d02797" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 07 16:11:09.896429 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:09.896358 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:11:09.997196 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:09.997045 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:11:10.355930 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:10.355808 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:11:10.741960 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:10.741921 2572 patch_prober.go:28] interesting pod/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 07 16:11:10.742127 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:10.741986 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" podUID="a645a244-f6b5-49e5-a2a7-c76847d02797" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 07 16:11:11.741283 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:11.741240 2572 patch_prober.go:28] interesting pod/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 07 16:11:11.741677 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:11.741346 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" podUID="a645a244-f6b5-49e5-a2a7-c76847d02797" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 07 16:11:12.741617 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:12.741572 2572 patch_prober.go:28] interesting pod/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 07 16:11:12.742042 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:12.741641 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" podUID="a645a244-f6b5-49e5-a2a7-c76847d02797" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 07 16:11:13.745075 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:13.745046 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:11:13.745956 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:13.745939 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:11:17.866140 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:17.866106 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:11:18.728009 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:18.727978 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:11:18.828584 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:18.828551 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:11:40.553434 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:40.553399 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:11:59.686270 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:11:59.686232 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:00.757686 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:00.757657 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:00.907351 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:00.907312 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:01.307553 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:01.307516 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:01.410616 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:01.410580 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:01.509030 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:01.508996 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:01.628552 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:01.628522 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:06.383098 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:06.383019 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:39.800688 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:39.800652 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:39.901531 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:39.901494 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:43.243780 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:43.243747 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:43.488551 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:43.488517 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9"] Jul 07 16:12:43.488747 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:43.488722 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" podUID="561359f0-811b-4452-a9c4-c606bb0eceb8" containerName="istio-proxy" containerID="cri-o://a79cf45ea59dafc44de052ee6197630f5ad3b16bc9bf8011ffdbf0cbfa2ea237" gracePeriod=30 Jul 07 16:12:43.511587 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:43.511465 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:43.754158 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:43.754113 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:43.940559 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:43.940527 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:44.376515 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:44.376470 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:44.476115 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:44.476085 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:44.630114 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:44.629991 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:48.743747 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.743720 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:12:48.748300 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.748276 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-podinfo\") pod \"561359f0-811b-4452-a9c4-c606bb0eceb8\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " Jul 07 16:12:48.748435 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.748336 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-envoy\") pod \"561359f0-811b-4452-a9c4-c606bb0eceb8\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " Jul 07 16:12:48.748435 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.748360 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-workload-socket\") pod \"561359f0-811b-4452-a9c4-c606bb0eceb8\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " Jul 07 16:12:48.748435 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.748408 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-data\") pod \"561359f0-811b-4452-a9c4-c606bb0eceb8\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " Jul 07 16:12:48.748602 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.748435 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/561359f0-811b-4452-a9c4-c606bb0eceb8-istiod-ca-cert\") pod \"561359f0-811b-4452-a9c4-c606bb0eceb8\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " Jul 07 16:12:48.748602 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.748481 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-workload-certs\") pod \"561359f0-811b-4452-a9c4-c606bb0eceb8\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " Jul 07 16:12:48.748602 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.748506 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9mb9\" (UniqueName: \"kubernetes.io/projected/561359f0-811b-4452-a9c4-c606bb0eceb8-kube-api-access-r9mb9\") pod \"561359f0-811b-4452-a9c4-c606bb0eceb8\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " Jul 07 16:12:48.748602 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.748540 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-credential-socket\") pod \"561359f0-811b-4452-a9c4-c606bb0eceb8\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " Jul 07 16:12:48.748602 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.748581 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-token\") pod \"561359f0-811b-4452-a9c4-c606bb0eceb8\" (UID: \"561359f0-811b-4452-a9c4-c606bb0eceb8\") " Jul 07 16:12:48.749030 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.748707 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "561359f0-811b-4452-a9c4-c606bb0eceb8" (UID: "561359f0-811b-4452-a9c4-c606bb0eceb8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:12:48.749030 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.748907 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/561359f0-811b-4452-a9c4-c606bb0eceb8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "561359f0-811b-4452-a9c4-c606bb0eceb8" (UID: "561359f0-811b-4452-a9c4-c606bb0eceb8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:12:48.749030 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.748961 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-workload-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:48.749363 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.749152 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "561359f0-811b-4452-a9c4-c606bb0eceb8" (UID: "561359f0-811b-4452-a9c4-c606bb0eceb8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:12:48.749463 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.749422 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "561359f0-811b-4452-a9c4-c606bb0eceb8" (UID: "561359f0-811b-4452-a9c4-c606bb0eceb8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:12:48.749529 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.749485 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-data" (OuterVolumeSpecName: "istio-data") pod "561359f0-811b-4452-a9c4-c606bb0eceb8" (UID: "561359f0-811b-4452-a9c4-c606bb0eceb8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:12:48.750769 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.750743 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "561359f0-811b-4452-a9c4-c606bb0eceb8" (UID: "561359f0-811b-4452-a9c4-c606bb0eceb8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 16:12:48.751309 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.751272 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/561359f0-811b-4452-a9c4-c606bb0eceb8-kube-api-access-r9mb9" (OuterVolumeSpecName: "kube-api-access-r9mb9") pod "561359f0-811b-4452-a9c4-c606bb0eceb8" (UID: "561359f0-811b-4452-a9c4-c606bb0eceb8"). InnerVolumeSpecName "kube-api-access-r9mb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:12:48.751516 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.751494 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-token" (OuterVolumeSpecName: "istio-token") pod "561359f0-811b-4452-a9c4-c606bb0eceb8" (UID: "561359f0-811b-4452-a9c4-c606bb0eceb8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:12:48.751662 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.751628 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "561359f0-811b-4452-a9c4-c606bb0eceb8" (UID: "561359f0-811b-4452-a9c4-c606bb0eceb8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:12:48.849467 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.849409 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-envoy\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:48.849467 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.849454 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-data\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:48.849467 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.849466 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/561359f0-811b-4452-a9c4-c606bb0eceb8-istiod-ca-cert\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:48.849467 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.849475 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-workload-certs\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:48.849467 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.849483 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9mb9\" (UniqueName: \"kubernetes.io/projected/561359f0-811b-4452-a9c4-c606bb0eceb8-kube-api-access-r9mb9\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:48.849780 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.849493 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/561359f0-811b-4452-a9c4-c606bb0eceb8-credential-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:48.849780 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.849502 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-token\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:48.849780 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.849509 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/561359f0-811b-4452-a9c4-c606bb0eceb8-istio-podinfo\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:48.965009 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.964974 2572 generic.go:356] "Generic (PLEG): container finished" podID="561359f0-811b-4452-a9c4-c606bb0eceb8" containerID="a79cf45ea59dafc44de052ee6197630f5ad3b16bc9bf8011ffdbf0cbfa2ea237" exitCode=0 Jul 07 16:12:48.965183 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.965036 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" Jul 07 16:12:48.965183 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.965057 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" event={"ID":"561359f0-811b-4452-a9c4-c606bb0eceb8","Type":"ContainerDied","Data":"a79cf45ea59dafc44de052ee6197630f5ad3b16bc9bf8011ffdbf0cbfa2ea237"} Jul 07 16:12:48.965183 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.965137 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9" event={"ID":"561359f0-811b-4452-a9c4-c606bb0eceb8","Type":"ContainerDied","Data":"667a882142a62dd321edf8768d9ff7e73b4dc66ed6bed190c661c988d40c50d5"} Jul 07 16:12:48.965183 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.965159 2572 scope.go:117] "RemoveContainer" containerID="a79cf45ea59dafc44de052ee6197630f5ad3b16bc9bf8011ffdbf0cbfa2ea237" Jul 07 16:12:48.975166 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.975143 2572 scope.go:117] "RemoveContainer" containerID="d235bd8bf2b7af9a8d4b1b932d966008ed5bf3057f72447cc8ebc05dcecd120b" Jul 07 16:12:48.983503 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.983479 2572 scope.go:117] "RemoveContainer" containerID="a79cf45ea59dafc44de052ee6197630f5ad3b16bc9bf8011ffdbf0cbfa2ea237" Jul 07 16:12:48.983776 ip-10-0-138-64 kubenswrapper[2572]: E0707 16:12:48.983757 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a79cf45ea59dafc44de052ee6197630f5ad3b16bc9bf8011ffdbf0cbfa2ea237\": container with ID starting with a79cf45ea59dafc44de052ee6197630f5ad3b16bc9bf8011ffdbf0cbfa2ea237 not found: ID does not exist" containerID="a79cf45ea59dafc44de052ee6197630f5ad3b16bc9bf8011ffdbf0cbfa2ea237" Jul 07 16:12:48.983830 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.983788 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a79cf45ea59dafc44de052ee6197630f5ad3b16bc9bf8011ffdbf0cbfa2ea237"} err="failed to get container status \"a79cf45ea59dafc44de052ee6197630f5ad3b16bc9bf8011ffdbf0cbfa2ea237\": rpc error: code = NotFound desc = could not find container \"a79cf45ea59dafc44de052ee6197630f5ad3b16bc9bf8011ffdbf0cbfa2ea237\": container with ID starting with a79cf45ea59dafc44de052ee6197630f5ad3b16bc9bf8011ffdbf0cbfa2ea237 not found: ID does not exist" Jul 07 16:12:48.983830 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.983806 2572 scope.go:117] "RemoveContainer" containerID="d235bd8bf2b7af9a8d4b1b932d966008ed5bf3057f72447cc8ebc05dcecd120b" Jul 07 16:12:48.984040 ip-10-0-138-64 kubenswrapper[2572]: E0707 16:12:48.984026 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d235bd8bf2b7af9a8d4b1b932d966008ed5bf3057f72447cc8ebc05dcecd120b\": container with ID starting with d235bd8bf2b7af9a8d4b1b932d966008ed5bf3057f72447cc8ebc05dcecd120b not found: ID does not exist" containerID="d235bd8bf2b7af9a8d4b1b932d966008ed5bf3057f72447cc8ebc05dcecd120b" Jul 07 16:12:48.984081 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.984042 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d235bd8bf2b7af9a8d4b1b932d966008ed5bf3057f72447cc8ebc05dcecd120b"} err="failed to get container status \"d235bd8bf2b7af9a8d4b1b932d966008ed5bf3057f72447cc8ebc05dcecd120b\": rpc error: code = NotFound desc = could not find container \"d235bd8bf2b7af9a8d4b1b932d966008ed5bf3057f72447cc8ebc05dcecd120b\": container with ID starting with d235bd8bf2b7af9a8d4b1b932d966008ed5bf3057f72447cc8ebc05dcecd120b not found: ID does not exist" Jul 07 16:12:48.991423 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.991391 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9"] Jul 07 16:12:48.994781 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:48.994756 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-e6fe85-openshift-default-7c4d9ffb9f-2flp9"] Jul 07 16:12:50.220760 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:50.220714 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:50.321162 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:50.321130 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:50.377537 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:50.377504 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="561359f0-811b-4452-a9c4-c606bb0eceb8" path="/var/lib/kubelet/pods/561359f0-811b-4452-a9c4-c606bb0eceb8/volumes" Jul 07 16:12:50.488695 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:50.488599 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h"] Jul 07 16:12:50.488876 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:50.488811 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" podUID="a645a244-f6b5-49e5-a2a7-c76847d02797" containerName="istio-proxy" containerID="cri-o://c251a2019125070ca05e076af7ba83d00206789ab394d99f73daaba16be99d7f" gracePeriod=30 Jul 07 16:12:50.515327 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:50.515294 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:50.773169 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:50.773084 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:51.135232 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.135202 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:51.427449 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.427352 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj"] Jul 07 16:12:51.427864 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.427818 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="561359f0-811b-4452-a9c4-c606bb0eceb8" containerName="istio-proxy" Jul 07 16:12:51.427864 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.427831 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="561359f0-811b-4452-a9c4-c606bb0eceb8" containerName="istio-proxy" Jul 07 16:12:51.427957 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.427847 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="561359f0-811b-4452-a9c4-c606bb0eceb8" containerName="istio-proxy" Jul 07 16:12:51.427957 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.427886 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="561359f0-811b-4452-a9c4-c606bb0eceb8" containerName="istio-proxy" Jul 07 16:12:51.428027 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.427960 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="561359f0-811b-4452-a9c4-c606bb0eceb8" containerName="istio-proxy" Jul 07 16:12:51.431175 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.431159 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.434320 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.434303 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-0aba26-openshift-default-dockercfg-92rnk\"" Jul 07 16:12:51.442944 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.442919 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj"] Jul 07 16:12:51.459332 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.459310 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:51.471478 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.471452 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-workload-certs\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.471575 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.471489 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istiod-ca-cert\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.471575 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.471517 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-credential-socket\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.471665 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.471569 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-data\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.471665 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.471628 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-workload-socket\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.471727 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.471689 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-envoy\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.471767 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.471740 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sfln\" (UniqueName: \"kubernetes.io/projected/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-kube-api-access-8sfln\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.471767 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.471761 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-token\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.471843 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.471802 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-podinfo\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.572725 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.572678 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-workload-socket\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.572955 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.572740 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-envoy\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.572955 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.572787 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sfln\" (UniqueName: \"kubernetes.io/projected/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-kube-api-access-8sfln\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.572955 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.572805 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-token\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.572955 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.572844 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-podinfo\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.572955 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.572928 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-workload-certs\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.572955 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.572955 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istiod-ca-cert\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.573290 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.572981 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-credential-socket\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.573290 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.573006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-data\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.573290 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.573155 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-workload-socket\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.573449 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.573323 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-data\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.573449 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.573430 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-credential-socket\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.573564 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.573496 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-workload-certs\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.573761 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.573737 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istiod-ca-cert\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.575946 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.575923 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-envoy\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.576105 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.576090 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-podinfo\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.581178 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.581150 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-token\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.581412 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.581396 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sfln\" (UniqueName: \"kubernetes.io/projected/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-kube-api-access-8sfln\") pod \"e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.742492 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.742402 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:51.881641 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.881613 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj"] Jul 07 16:12:51.883791 ip-10-0-138-64 kubenswrapper[2572]: W0707 16:12:51.883755 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod507acdc5_c1ae_4c5a_861d_3980c7d7bbde.slice/crio-78599a7f64ba8f0dd30033a5135bc5e29174934ffb72aae54f8befdd9d1774e5 WatchSource:0}: Error finding container 78599a7f64ba8f0dd30033a5135bc5e29174934ffb72aae54f8befdd9d1774e5: Status 404 returned error can't find the container with id 78599a7f64ba8f0dd30033a5135bc5e29174934ffb72aae54f8befdd9d1774e5 Jul 07 16:12:51.885989 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.885952 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:12:51.886086 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.886020 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:12:51.886086 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.886053 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:12:51.944436 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.944401 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:51.984287 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.984249 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" event={"ID":"507acdc5-c1ae-4c5a-861d-3980c7d7bbde","Type":"ContainerStarted","Data":"ae485b1936b10ea57be5a283d25a036d1f362ff2ba2c4b2ca7d3ea196ad6abe5"} Jul 07 16:12:51.984465 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:51.984314 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" event={"ID":"507acdc5-c1ae-4c5a-861d-3980c7d7bbde","Type":"ContainerStarted","Data":"78599a7f64ba8f0dd30033a5135bc5e29174934ffb72aae54f8befdd9d1774e5"} Jul 07 16:12:52.012693 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:52.012562 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" podStartSLOduration=1.012546008 podStartE2EDuration="1.012546008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:12:52.010837551 +0000 UTC m=+1930.160698059" watchObservedRunningTime="2026-07-07 16:12:52.012546008 +0000 UTC m=+1930.162406514" Jul 07 16:12:52.743169 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:52.743128 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:52.747614 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:52.747593 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:52.990292 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:52.990259 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:52.991170 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:52.991150 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:12:53.971966 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:53.971925 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:54.077942 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:54.077908 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:54.164149 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:54.164109 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:54.310441 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:54.310355 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:54.761050 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:54.761016 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:54.869409 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:54.869369 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:55.743355 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.743331 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:12:55.811901 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.811792 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-podinfo\") pod \"a645a244-f6b5-49e5-a2a7-c76847d02797\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " Jul 07 16:12:55.811901 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.811843 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a645a244-f6b5-49e5-a2a7-c76847d02797-istiod-ca-cert\") pod \"a645a244-f6b5-49e5-a2a7-c76847d02797\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " Jul 07 16:12:55.812122 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.811928 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-workload-socket\") pod \"a645a244-f6b5-49e5-a2a7-c76847d02797\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " Jul 07 16:12:55.812122 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.811950 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwz7q\" (UniqueName: \"kubernetes.io/projected/a645a244-f6b5-49e5-a2a7-c76847d02797-kube-api-access-rwz7q\") pod \"a645a244-f6b5-49e5-a2a7-c76847d02797\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " Jul 07 16:12:55.812122 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.811992 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-token\") pod \"a645a244-f6b5-49e5-a2a7-c76847d02797\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " Jul 07 16:12:55.812122 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.812027 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-workload-certs\") pod \"a645a244-f6b5-49e5-a2a7-c76847d02797\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " Jul 07 16:12:55.812122 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.812075 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-envoy\") pod \"a645a244-f6b5-49e5-a2a7-c76847d02797\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " Jul 07 16:12:55.812122 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.812118 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-credential-socket\") pod \"a645a244-f6b5-49e5-a2a7-c76847d02797\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " Jul 07 16:12:55.813021 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.812152 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-data\") pod \"a645a244-f6b5-49e5-a2a7-c76847d02797\" (UID: \"a645a244-f6b5-49e5-a2a7-c76847d02797\") " Jul 07 16:12:55.813021 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.812283 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a645a244-f6b5-49e5-a2a7-c76847d02797" (UID: "a645a244-f6b5-49e5-a2a7-c76847d02797"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:12:55.813021 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.812328 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a645a244-f6b5-49e5-a2a7-c76847d02797" (UID: "a645a244-f6b5-49e5-a2a7-c76847d02797"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:12:55.813021 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.812349 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a645a244-f6b5-49e5-a2a7-c76847d02797-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a645a244-f6b5-49e5-a2a7-c76847d02797" (UID: "a645a244-f6b5-49e5-a2a7-c76847d02797"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:12:55.813021 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.812506 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a645a244-f6b5-49e5-a2a7-c76847d02797" (UID: "a645a244-f6b5-49e5-a2a7-c76847d02797"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:12:55.813021 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.812679 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a645a244-f6b5-49e5-a2a7-c76847d02797-istiod-ca-cert\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:55.813021 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.812697 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-workload-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:55.813021 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.812712 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-workload-certs\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:55.813021 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.812725 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-credential-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:55.813522 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.813075 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-data" (OuterVolumeSpecName: "istio-data") pod "a645a244-f6b5-49e5-a2a7-c76847d02797" (UID: "a645a244-f6b5-49e5-a2a7-c76847d02797"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:12:55.814180 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.814160 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a645a244-f6b5-49e5-a2a7-c76847d02797" (UID: "a645a244-f6b5-49e5-a2a7-c76847d02797"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 16:12:55.814492 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.814472 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a645a244-f6b5-49e5-a2a7-c76847d02797-kube-api-access-rwz7q" (OuterVolumeSpecName: "kube-api-access-rwz7q") pod "a645a244-f6b5-49e5-a2a7-c76847d02797" (UID: "a645a244-f6b5-49e5-a2a7-c76847d02797"). InnerVolumeSpecName "kube-api-access-rwz7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:12:55.814906 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.814882 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-token" (OuterVolumeSpecName: "istio-token") pod "a645a244-f6b5-49e5-a2a7-c76847d02797" (UID: "a645a244-f6b5-49e5-a2a7-c76847d02797"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:12:55.814988 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.814909 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a645a244-f6b5-49e5-a2a7-c76847d02797" (UID: "a645a244-f6b5-49e5-a2a7-c76847d02797"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:12:55.913259 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.913226 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-podinfo\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:55.913259 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.913257 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwz7q\" (UniqueName: \"kubernetes.io/projected/a645a244-f6b5-49e5-a2a7-c76847d02797-kube-api-access-rwz7q\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:55.913259 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.913267 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-token\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:55.913492 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.913276 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-envoy\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:55.913492 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:55.913283 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a645a244-f6b5-49e5-a2a7-c76847d02797-istio-data\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:12:56.005973 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:56.005937 2572 generic.go:356] "Generic (PLEG): container finished" podID="a645a244-f6b5-49e5-a2a7-c76847d02797" containerID="c251a2019125070ca05e076af7ba83d00206789ab394d99f73daaba16be99d7f" exitCode=0 Jul 07 16:12:56.006143 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:56.005987 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" Jul 07 16:12:56.006143 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:56.006026 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" event={"ID":"a645a244-f6b5-49e5-a2a7-c76847d02797","Type":"ContainerDied","Data":"c251a2019125070ca05e076af7ba83d00206789ab394d99f73daaba16be99d7f"} Jul 07 16:12:56.006143 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:56.006082 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h" event={"ID":"a645a244-f6b5-49e5-a2a7-c76847d02797","Type":"ContainerDied","Data":"a86812b6144667d331702d08b185a71f11d165e990d0d1cc286448ac539f0f11"} Jul 07 16:12:56.006143 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:56.006105 2572 scope.go:117] "RemoveContainer" containerID="c251a2019125070ca05e076af7ba83d00206789ab394d99f73daaba16be99d7f" Jul 07 16:12:56.015903 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:56.015841 2572 scope.go:117] "RemoveContainer" containerID="04aa61d02c5ec1639d003e09eaf20400dafb93e51b43e638139fe4c1068410cb" Jul 07 16:12:56.026342 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:56.026324 2572 scope.go:117] "RemoveContainer" containerID="c251a2019125070ca05e076af7ba83d00206789ab394d99f73daaba16be99d7f" Jul 07 16:12:56.026740 ip-10-0-138-64 kubenswrapper[2572]: E0707 16:12:56.026716 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c251a2019125070ca05e076af7ba83d00206789ab394d99f73daaba16be99d7f\": container with ID starting with c251a2019125070ca05e076af7ba83d00206789ab394d99f73daaba16be99d7f not found: ID does not exist" containerID="c251a2019125070ca05e076af7ba83d00206789ab394d99f73daaba16be99d7f" Jul 07 16:12:56.026792 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:56.026754 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c251a2019125070ca05e076af7ba83d00206789ab394d99f73daaba16be99d7f"} err="failed to get container status \"c251a2019125070ca05e076af7ba83d00206789ab394d99f73daaba16be99d7f\": rpc error: code = NotFound desc = could not find container \"c251a2019125070ca05e076af7ba83d00206789ab394d99f73daaba16be99d7f\": container with ID starting with c251a2019125070ca05e076af7ba83d00206789ab394d99f73daaba16be99d7f not found: ID does not exist" Jul 07 16:12:56.026792 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:56.026789 2572 scope.go:117] "RemoveContainer" containerID="04aa61d02c5ec1639d003e09eaf20400dafb93e51b43e638139fe4c1068410cb" Jul 07 16:12:56.027078 ip-10-0-138-64 kubenswrapper[2572]: E0707 16:12:56.027057 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04aa61d02c5ec1639d003e09eaf20400dafb93e51b43e638139fe4c1068410cb\": container with ID starting with 04aa61d02c5ec1639d003e09eaf20400dafb93e51b43e638139fe4c1068410cb not found: ID does not exist" containerID="04aa61d02c5ec1639d003e09eaf20400dafb93e51b43e638139fe4c1068410cb" Jul 07 16:12:56.027199 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:56.027086 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04aa61d02c5ec1639d003e09eaf20400dafb93e51b43e638139fe4c1068410cb"} err="failed to get container status \"04aa61d02c5ec1639d003e09eaf20400dafb93e51b43e638139fe4c1068410cb\": rpc error: code = NotFound desc = could not find container \"04aa61d02c5ec1639d003e09eaf20400dafb93e51b43e638139fe4c1068410cb\": container with ID starting with 04aa61d02c5ec1639d003e09eaf20400dafb93e51b43e638139fe4c1068410cb not found: ID does not exist" Jul 07 16:12:56.030127 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:56.030106 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h"] Jul 07 16:12:56.035195 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:56.035174 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-11d09f-openshift-default-6b77658f97-2476h"] Jul 07 16:12:56.377369 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:56.377328 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a645a244-f6b5-49e5-a2a7-c76847d02797" path="/var/lib/kubelet/pods/a645a244-f6b5-49e5-a2a7-c76847d02797/volumes" Jul 07 16:12:58.494178 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:58.494126 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:58.955128 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:58.955087 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:59.243037 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.242946 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk"] Jul 07 16:12:59.243617 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.243591 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a645a244-f6b5-49e5-a2a7-c76847d02797" containerName="istio-proxy" Jul 07 16:12:59.243617 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.243619 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a645a244-f6b5-49e5-a2a7-c76847d02797" containerName="istio-proxy" Jul 07 16:12:59.243792 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.243632 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a645a244-f6b5-49e5-a2a7-c76847d02797" containerName="istio-proxy" Jul 07 16:12:59.243792 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.243641 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a645a244-f6b5-49e5-a2a7-c76847d02797" containerName="istio-proxy" Jul 07 16:12:59.243792 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.243765 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a645a244-f6b5-49e5-a2a7-c76847d02797" containerName="istio-proxy" Jul 07 16:12:59.243792 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.243776 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="561359f0-811b-4452-a9c4-c606bb0eceb8" containerName="istio-proxy" Jul 07 16:12:59.247001 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.246982 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.250161 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.250135 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-7820dd-openshift-default-dockercfg-wf9w9\"" Jul 07 16:12:59.260250 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.260223 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk"] Jul 07 16:12:59.275726 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.275695 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:59.344987 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.344930 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-credential-socket\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.345320 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.345290 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-token\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.345438 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.345391 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjt9h\" (UniqueName: \"kubernetes.io/projected/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-kube-api-access-cjt9h\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.345438 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.345422 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-workload-socket\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.345546 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.345447 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-data\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.345546 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.345498 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-envoy\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.345546 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.345528 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istiod-ca-cert\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.345699 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.345622 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-workload-certs\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.345699 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.345648 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-podinfo\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.446824 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.446780 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjt9h\" (UniqueName: \"kubernetes.io/projected/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-kube-api-access-cjt9h\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.446824 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.446826 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-workload-socket\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.447070 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.446878 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-data\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.447070 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.447051 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-envoy\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.447146 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.447100 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istiod-ca-cert\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.447190 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.447178 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-workload-socket\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.447303 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.447204 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-workload-certs\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.447303 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.447232 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-podinfo\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.447303 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.447250 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-data\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.447303 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.447263 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-credential-socket\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.447520 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.447304 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-token\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.447520 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.447479 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-workload-certs\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.447622 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.447557 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-credential-socket\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.447885 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.447833 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istiod-ca-cert\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.449443 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.449416 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-envoy\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.449643 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.449626 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-podinfo\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.459669 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.459645 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-token\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.459776 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.459692 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjt9h\" (UniqueName: \"kubernetes.io/projected/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-kube-api-access-cjt9h\") pod \"e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.558559 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.558456 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:12:59.647909 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.647840 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:59.705973 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.705953 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk"] Jul 07 16:12:59.708382 ip-10-0-138-64 kubenswrapper[2572]: W0707 16:12:59.708358 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d0fc9ff_40a9_4b0a_8ef4_3ef07e102473.slice/crio-aed065acacb3b613e8afc1c085f3d1855ecaac5c119149af521b8271855f110c WatchSource:0}: Error finding container aed065acacb3b613e8afc1c085f3d1855ecaac5c119149af521b8271855f110c: Status 404 returned error can't find the container with id aed065acacb3b613e8afc1c085f3d1855ecaac5c119149af521b8271855f110c Jul 07 16:12:59.710573 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.710540 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:12:59.710669 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.710621 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:12:59.710733 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:12:59.710668 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:00.029103 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:00.029064 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" event={"ID":"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473","Type":"ContainerStarted","Data":"a5379d7913fcbc550e0d61e65bd30be30a6173687287130be0cdee2ddc3cd828"} Jul 07 16:13:00.029306 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:00.029125 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" event={"ID":"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473","Type":"ContainerStarted","Data":"aed065acacb3b613e8afc1c085f3d1855ecaac5c119149af521b8271855f110c"} Jul 07 16:13:00.050631 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:00.050572 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" podStartSLOduration=1.050551845 podStartE2EDuration="1.050551845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:12:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:13:00.048494758 +0000 UTC m=+1938.198355264" watchObservedRunningTime="2026-07-07 16:13:00.050551845 +0000 UTC m=+1938.200412353" Jul 07 16:13:00.558941 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:00.558899 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:13:00.563911 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:00.563888 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:13:01.033848 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:01.033816 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:13:01.034910 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:01.034892 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:13:01.992366 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:01.992325 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:02.075709 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:02.075670 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:02.148126 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:02.148093 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:02.568119 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:02.568082 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:02.667764 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:02.667725 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:06.501174 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:06.501123 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:09.031069 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:09.031021 2572 patch_prober.go:28] interesting pod/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 16:13:09.031464 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:09.031110 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" podUID="507acdc5-c1ae-4c5a-861d-3980c7d7bbde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 16:13:11.086114 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:11.086077 2572 generic.go:356] "Generic (PLEG): container finished" podID="507acdc5-c1ae-4c5a-861d-3980c7d7bbde" containerID="ae485b1936b10ea57be5a283d25a036d1f362ff2ba2c4b2ca7d3ea196ad6abe5" exitCode=0 Jul 07 16:13:11.086541 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:11.086120 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" event={"ID":"507acdc5-c1ae-4c5a-861d-3980c7d7bbde","Type":"ContainerDied","Data":"ae485b1936b10ea57be5a283d25a036d1f362ff2ba2c4b2ca7d3ea196ad6abe5"} Jul 07 16:13:11.086587 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:11.086562 2572 scope.go:117] "RemoveContainer" containerID="ae485b1936b10ea57be5a283d25a036d1f362ff2ba2c4b2ca7d3ea196ad6abe5" Jul 07 16:13:11.087611 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:11.087579 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:11.087672 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:11.087650 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:11.087707 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:11.087683 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:12.101439 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:12.101387 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" event={"ID":"507acdc5-c1ae-4c5a-861d-3980c7d7bbde","Type":"ContainerStarted","Data":"e0b2639e532640384e28cdb72183b3d013106948c0cdfbe25273de802d51723f"} Jul 07 16:13:12.743490 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:12.743443 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:13:12.743713 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:12.743582 2572 patch_prober.go:28] interesting pod/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 07 16:13:12.743713 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:12.743628 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" podUID="507acdc5-c1ae-4c5a-861d-3980c7d7bbde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 07 16:13:13.742882 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:13.742815 2572 patch_prober.go:28] interesting pod/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 07 16:13:13.743407 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:13.742929 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" podUID="507acdc5-c1ae-4c5a-861d-3980c7d7bbde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 07 16:13:14.734668 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:14.734630 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:14.746294 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:14.746258 2572 patch_prober.go:28] interesting pod/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 07 16:13:14.747256 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:14.746845 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" podUID="507acdc5-c1ae-4c5a-861d-3980c7d7bbde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 07 16:13:15.143914 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:15.143873 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:15.243062 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:15.243028 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:15.343438 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:15.343353 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:15.445499 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:15.445449 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:15.742830 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:15.742796 2572 patch_prober.go:28] interesting pod/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 07 16:13:15.743023 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:15.742887 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" podUID="507acdc5-c1ae-4c5a-861d-3980c7d7bbde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 07 16:13:16.746920 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:16.746878 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:13:16.747392 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:16.747155 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:13:16.747812 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:16.747794 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:13:17.076092 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:17.075992 2572 patch_prober.go:28] interesting pod/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 16:13:17.076092 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:17.076052 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" podUID="3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 16:13:18.142490 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:18.142456 2572 generic.go:356] "Generic (PLEG): container finished" podID="3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" containerID="a5379d7913fcbc550e0d61e65bd30be30a6173687287130be0cdee2ddc3cd828" exitCode=0 Jul 07 16:13:18.142930 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:18.142530 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" event={"ID":"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473","Type":"ContainerDied","Data":"a5379d7913fcbc550e0d61e65bd30be30a6173687287130be0cdee2ddc3cd828"} Jul 07 16:13:18.143066 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:18.143050 2572 scope.go:117] "RemoveContainer" containerID="a5379d7913fcbc550e0d61e65bd30be30a6173687287130be0cdee2ddc3cd828" Jul 07 16:13:18.144051 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:18.144026 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:18.144106 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:18.144090 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:18.144151 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:18.144143 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:19.149681 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:19.149642 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" event={"ID":"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473","Type":"ContainerStarted","Data":"5e8ca83fd4e38aa0b825bba7f1244fc8fdcca1246fe7fcce07a182c8e99fae25"} Jul 07 16:13:19.559620 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:19.559530 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:13:19.559799 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:19.559730 2572 patch_prober.go:28] interesting pod/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 07 16:13:19.559799 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:19.559783 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" podUID="3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 07 16:13:20.559337 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:20.559298 2572 patch_prober.go:28] interesting pod/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 07 16:13:20.559750 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:20.559359 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" podUID="3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 07 16:13:21.559062 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:21.559024 2572 patch_prober.go:28] interesting pod/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 07 16:13:21.559246 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:21.559113 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" podUID="3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 07 16:13:21.773774 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:21.773739 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:21.874044 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:21.874013 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:21.985061 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:21.985027 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj"] Jul 07 16:13:21.985250 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:21.985221 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" podUID="507acdc5-c1ae-4c5a-861d-3980c7d7bbde" containerName="istio-proxy" containerID="cri-o://e0b2639e532640384e28cdb72183b3d013106948c0cdfbe25273de802d51723f" gracePeriod=30 Jul 07 16:13:22.013677 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:22.013643 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:22.227835 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:22.227739 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:22.396171 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:22.396127 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:22.559182 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:22.559093 2572 patch_prober.go:28] interesting pod/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 07 16:13:22.559182 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:22.559148 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" podUID="3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 07 16:13:22.811775 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:22.811661 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:22.960410 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:22.960379 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:23.058552 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:23.058517 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:23.264170 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:23.264127 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:23.562469 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:23.562386 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:13:23.562738 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:23.562721 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:13:23.563511 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:23.563490 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:13:27.194724 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.194693 2572 generic.go:356] "Generic (PLEG): container finished" podID="507acdc5-c1ae-4c5a-861d-3980c7d7bbde" containerID="e0b2639e532640384e28cdb72183b3d013106948c0cdfbe25273de802d51723f" exitCode=0 Jul 07 16:13:27.195132 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.194767 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" event={"ID":"507acdc5-c1ae-4c5a-861d-3980c7d7bbde","Type":"ContainerDied","Data":"e0b2639e532640384e28cdb72183b3d013106948c0cdfbe25273de802d51723f"} Jul 07 16:13:27.195132 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.194837 2572 scope.go:117] "RemoveContainer" containerID="ae485b1936b10ea57be5a283d25a036d1f362ff2ba2c4b2ca7d3ea196ad6abe5" Jul 07 16:13:27.264650 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.264623 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:13:27.363280 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.363241 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istiod-ca-cert\") pod \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " Jul 07 16:13:27.363584 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.363326 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-workload-socket\") pod \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " Jul 07 16:13:27.363584 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.363347 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-credential-socket\") pod \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " Jul 07 16:13:27.363584 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.363386 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-podinfo\") pod \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " Jul 07 16:13:27.363584 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.363407 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sfln\" (UniqueName: \"kubernetes.io/projected/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-kube-api-access-8sfln\") pod \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " Jul 07 16:13:27.363584 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.363440 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-workload-certs\") pod \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " Jul 07 16:13:27.363584 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.363481 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-data\") pod \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " Jul 07 16:13:27.363584 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.363516 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-envoy\") pod \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " Jul 07 16:13:27.363584 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.363548 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-token\") pod \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\" (UID: \"507acdc5-c1ae-4c5a-861d-3980c7d7bbde\") " Jul 07 16:13:27.364047 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.363663 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "507acdc5-c1ae-4c5a-861d-3980c7d7bbde" (UID: "507acdc5-c1ae-4c5a-861d-3980c7d7bbde"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:13:27.364047 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.363825 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "507acdc5-c1ae-4c5a-861d-3980c7d7bbde" (UID: "507acdc5-c1ae-4c5a-861d-3980c7d7bbde"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:13:27.364047 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.363883 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "507acdc5-c1ae-4c5a-861d-3980c7d7bbde" (UID: "507acdc5-c1ae-4c5a-861d-3980c7d7bbde"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:13:27.364047 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.363957 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-workload-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:27.364047 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.363978 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-credential-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:27.364288 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.364163 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "507acdc5-c1ae-4c5a-861d-3980c7d7bbde" (UID: "507acdc5-c1ae-4c5a-861d-3980c7d7bbde"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:13:27.364614 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.364584 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-data" (OuterVolumeSpecName: "istio-data") pod "507acdc5-c1ae-4c5a-861d-3980c7d7bbde" (UID: "507acdc5-c1ae-4c5a-861d-3980c7d7bbde"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:13:27.365965 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.365943 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-kube-api-access-8sfln" (OuterVolumeSpecName: "kube-api-access-8sfln") pod "507acdc5-c1ae-4c5a-861d-3980c7d7bbde" (UID: "507acdc5-c1ae-4c5a-861d-3980c7d7bbde"). InnerVolumeSpecName "kube-api-access-8sfln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:13:27.366067 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.365965 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "507acdc5-c1ae-4c5a-861d-3980c7d7bbde" (UID: "507acdc5-c1ae-4c5a-861d-3980c7d7bbde"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:13:27.366306 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.366291 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "507acdc5-c1ae-4c5a-861d-3980c7d7bbde" (UID: "507acdc5-c1ae-4c5a-861d-3980c7d7bbde"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 16:13:27.366372 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.366316 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-token" (OuterVolumeSpecName: "istio-token") pod "507acdc5-c1ae-4c5a-861d-3980c7d7bbde" (UID: "507acdc5-c1ae-4c5a-861d-3980c7d7bbde"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:13:27.465255 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.465217 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-podinfo\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:27.465255 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.465249 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sfln\" (UniqueName: \"kubernetes.io/projected/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-kube-api-access-8sfln\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:27.465255 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.465260 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-workload-certs\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:27.465255 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.465269 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-data\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:27.465526 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.465276 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-envoy\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:27.465526 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.465283 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istio-token\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:27.465526 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:27.465290 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/507acdc5-c1ae-4c5a-861d-3980c7d7bbde-istiod-ca-cert\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:28.201342 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:28.201309 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" event={"ID":"507acdc5-c1ae-4c5a-861d-3980c7d7bbde","Type":"ContainerDied","Data":"78599a7f64ba8f0dd30033a5135bc5e29174934ffb72aae54f8befdd9d1774e5"} Jul 07 16:13:28.201342 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:28.201336 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj" Jul 07 16:13:28.201882 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:28.201371 2572 scope.go:117] "RemoveContainer" containerID="e0b2639e532640384e28cdb72183b3d013106948c0cdfbe25273de802d51723f" Jul 07 16:13:28.229229 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:28.229194 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj"] Jul 07 16:13:28.237883 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:28.236162 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-0aba26-openshift-default-86d49bd8cf-69cnj"] Jul 07 16:13:28.377551 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:28.377513 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="507acdc5-c1ae-4c5a-861d-3980c7d7bbde" path="/var/lib/kubelet/pods/507acdc5-c1ae-4c5a-861d-3980c7d7bbde/volumes" Jul 07 16:13:28.942760 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:28.942722 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:29.047125 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:29.047089 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:29.193034 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:29.192954 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk"] Jul 07 16:13:29.193194 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:29.193171 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" podUID="3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" containerName="istio-proxy" containerID="cri-o://5e8ca83fd4e38aa0b825bba7f1244fc8fdcca1246fe7fcce07a182c8e99fae25" gracePeriod=30 Jul 07 16:13:29.222555 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:29.222524 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:29.458147 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:29.458064 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:29.817900 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:29.817800 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:30.117905 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.117874 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2"] Jul 07 16:13:30.118474 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.118452 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="507acdc5-c1ae-4c5a-861d-3980c7d7bbde" containerName="istio-proxy" Jul 07 16:13:30.118474 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.118473 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="507acdc5-c1ae-4c5a-861d-3980c7d7bbde" containerName="istio-proxy" Jul 07 16:13:30.118651 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.118491 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="507acdc5-c1ae-4c5a-861d-3980c7d7bbde" containerName="istio-proxy" Jul 07 16:13:30.118651 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.118499 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="507acdc5-c1ae-4c5a-861d-3980c7d7bbde" containerName="istio-proxy" Jul 07 16:13:30.118651 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.118595 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="507acdc5-c1ae-4c5a-861d-3980c7d7bbde" containerName="istio-proxy" Jul 07 16:13:30.118651 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.118607 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a645a244-f6b5-49e5-a2a7-c76847d02797" containerName="istio-proxy" Jul 07 16:13:30.118651 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.118618 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="507acdc5-c1ae-4c5a-861d-3980c7d7bbde" containerName="istio-proxy" Jul 07 16:13:30.121808 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.121788 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.125156 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.125136 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-12f2df-openshift-default-dockercfg-r9crs\"" Jul 07 16:13:30.139744 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.139712 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2"] Jul 07 16:13:30.173178 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.173144 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:30.196819 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.196774 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-credential-socket\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.197112 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.197092 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm75r\" (UniqueName: \"kubernetes.io/projected/15fe2404-f4ff-4b60-a80f-f49136e63273-kube-api-access-qm75r\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.197284 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.197267 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-data\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.197477 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.197453 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-workload-certs\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.197626 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.197605 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-envoy\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.197764 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.197650 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-podinfo\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.197764 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.197677 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-workload-socket\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.197764 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.197741 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-token\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.198020 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.197847 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15fe2404-f4ff-4b60-a80f-f49136e63273-istiod-ca-cert\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.297256 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.297221 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:30.298444 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.298405 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-credential-socket\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.298599 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.298457 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm75r\" (UniqueName: \"kubernetes.io/projected/15fe2404-f4ff-4b60-a80f-f49136e63273-kube-api-access-qm75r\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.298599 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.298492 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-data\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.298599 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.298535 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-workload-certs\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.298599 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.298562 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-envoy\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.298599 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.298593 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-podinfo\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.298888 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.298738 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-workload-socket\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.298888 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.298820 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-token\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.298888 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.298844 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-credential-socket\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.299043 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.298938 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-data\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.299043 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.298995 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15fe2404-f4ff-4b60-a80f-f49136e63273-istiod-ca-cert\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.299043 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.299010 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-workload-certs\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.299208 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.299149 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-workload-socket\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.299570 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.299553 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15fe2404-f4ff-4b60-a80f-f49136e63273-istiod-ca-cert\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.301149 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.301129 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-envoy\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.301255 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.301238 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-podinfo\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.307692 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.307667 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-token\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.307931 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.307911 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm75r\" (UniqueName: \"kubernetes.io/projected/15fe2404-f4ff-4b60-a80f-f49136e63273-kube-api-access-qm75r\") pod \"e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.432889 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.432748 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:30.477887 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.477827 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:30.582755 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.582722 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:30.585014 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.584989 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2"] Jul 07 16:13:30.587167 ip-10-0-138-64 kubenswrapper[2572]: W0707 16:13:30.587138 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15fe2404_f4ff_4b60_a80f_f49136e63273.slice/crio-99c756bce67999f88969fe924353fa4b67bc5e95506d23f698d7583a98aae3bc WatchSource:0}: Error finding container 99c756bce67999f88969fe924353fa4b67bc5e95506d23f698d7583a98aae3bc: Status 404 returned error can't find the container with id 99c756bce67999f88969fe924353fa4b67bc5e95506d23f698d7583a98aae3bc Jul 07 16:13:30.589641 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.589610 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:30.589736 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.589676 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:30.589736 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:30.589707 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:31.221990 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:31.221948 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" event={"ID":"15fe2404-f4ff-4b60-a80f-f49136e63273","Type":"ContainerStarted","Data":"4e9f6892706339f7aa16f3a37095030b058513cbdbb269a1e8b547682bd9aee2"} Jul 07 16:13:31.222172 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:31.222012 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" event={"ID":"15fe2404-f4ff-4b60-a80f-f49136e63273","Type":"ContainerStarted","Data":"99c756bce67999f88969fe924353fa4b67bc5e95506d23f698d7583a98aae3bc"} Jul 07 16:13:31.248032 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:31.247977 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" podStartSLOduration=1.247960475 podStartE2EDuration="1.247960475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:13:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:13:31.245426194 +0000 UTC m=+1969.395286700" watchObservedRunningTime="2026-07-07 16:13:31.247960475 +0000 UTC m=+1969.397820981" Jul 07 16:13:31.433148 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:31.433109 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:31.438321 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:31.438296 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:32.226687 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:32.226651 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:32.227752 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:32.227735 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:33.242533 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:33.242482 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:33.363462 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:33.363430 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:33.449695 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:33.449650 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:33.568095 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:33.568000 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:33.919605 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:33.919573 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:34.020314 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.020280 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:34.445659 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.445635 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:13:34.544955 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.544834 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjt9h\" (UniqueName: \"kubernetes.io/projected/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-kube-api-access-cjt9h\") pod \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " Jul 07 16:13:34.544955 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.544924 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-podinfo\") pod \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " Jul 07 16:13:34.544955 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.544954 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istiod-ca-cert\") pod \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " Jul 07 16:13:34.545236 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.544989 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-workload-certs\") pod \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " Jul 07 16:13:34.545236 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.545014 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-token\") pod \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " Jul 07 16:13:34.545236 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.545159 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-data\") pod \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " Jul 07 16:13:34.545236 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.545219 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-workload-socket\") pod \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " Jul 07 16:13:34.545445 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.545243 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-envoy\") pod \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " Jul 07 16:13:34.545445 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.545322 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" (UID: "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:13:34.545445 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.545366 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-credential-socket\") pod \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\" (UID: \"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473\") " Jul 07 16:13:34.545445 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.545423 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" (UID: "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:13:34.545645 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.545544 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" (UID: "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:13:34.545700 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.545682 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" (UID: "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:13:34.545778 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.545763 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-workload-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:34.545818 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.545781 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-credential-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:34.545818 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.545789 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istiod-ca-cert\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:34.545818 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.545798 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-workload-certs\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:34.546489 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.546459 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" (UID: "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:13:34.547517 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.547483 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" (UID: "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:13:34.547517 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.547483 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" (UID: "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 16:13:34.547640 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.547542 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-kube-api-access-cjt9h" (OuterVolumeSpecName: "kube-api-access-cjt9h") pod "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" (UID: "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473"). InnerVolumeSpecName "kube-api-access-cjt9h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:13:34.548091 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.548063 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" (UID: "3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:13:34.647131 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.647091 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-token\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:34.647131 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.647123 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-data\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:34.647131 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.647132 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-envoy\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:34.647403 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.647142 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjt9h\" (UniqueName: \"kubernetes.io/projected/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-kube-api-access-cjt9h\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:34.647403 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:34.647155 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473-istio-podinfo\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:13:35.246760 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:35.246724 2572 generic.go:356] "Generic (PLEG): container finished" podID="3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" containerID="5e8ca83fd4e38aa0b825bba7f1244fc8fdcca1246fe7fcce07a182c8e99fae25" exitCode=0 Jul 07 16:13:35.246760 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:35.246766 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" event={"ID":"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473","Type":"ContainerDied","Data":"5e8ca83fd4e38aa0b825bba7f1244fc8fdcca1246fe7fcce07a182c8e99fae25"} Jul 07 16:13:35.247017 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:35.246776 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" Jul 07 16:13:35.247017 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:35.246809 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk" event={"ID":"3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473","Type":"ContainerDied","Data":"aed065acacb3b613e8afc1c085f3d1855ecaac5c119149af521b8271855f110c"} Jul 07 16:13:35.247017 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:35.246833 2572 scope.go:117] "RemoveContainer" containerID="5e8ca83fd4e38aa0b825bba7f1244fc8fdcca1246fe7fcce07a182c8e99fae25" Jul 07 16:13:35.256912 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:35.256841 2572 scope.go:117] "RemoveContainer" containerID="a5379d7913fcbc550e0d61e65bd30be30a6173687287130be0cdee2ddc3cd828" Jul 07 16:13:35.265532 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:35.265515 2572 scope.go:117] "RemoveContainer" containerID="5e8ca83fd4e38aa0b825bba7f1244fc8fdcca1246fe7fcce07a182c8e99fae25" Jul 07 16:13:35.265818 ip-10-0-138-64 kubenswrapper[2572]: E0707 16:13:35.265794 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e8ca83fd4e38aa0b825bba7f1244fc8fdcca1246fe7fcce07a182c8e99fae25\": container with ID starting with 5e8ca83fd4e38aa0b825bba7f1244fc8fdcca1246fe7fcce07a182c8e99fae25 not found: ID does not exist" containerID="5e8ca83fd4e38aa0b825bba7f1244fc8fdcca1246fe7fcce07a182c8e99fae25" Jul 07 16:13:35.265900 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:35.265827 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e8ca83fd4e38aa0b825bba7f1244fc8fdcca1246fe7fcce07a182c8e99fae25"} err="failed to get container status \"5e8ca83fd4e38aa0b825bba7f1244fc8fdcca1246fe7fcce07a182c8e99fae25\": rpc error: code = NotFound desc = could not find container \"5e8ca83fd4e38aa0b825bba7f1244fc8fdcca1246fe7fcce07a182c8e99fae25\": container with ID starting with 5e8ca83fd4e38aa0b825bba7f1244fc8fdcca1246fe7fcce07a182c8e99fae25 not found: ID does not exist" Jul 07 16:13:35.265900 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:35.265875 2572 scope.go:117] "RemoveContainer" containerID="a5379d7913fcbc550e0d61e65bd30be30a6173687287130be0cdee2ddc3cd828" Jul 07 16:13:35.266115 ip-10-0-138-64 kubenswrapper[2572]: E0707 16:13:35.266093 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5379d7913fcbc550e0d61e65bd30be30a6173687287130be0cdee2ddc3cd828\": container with ID starting with a5379d7913fcbc550e0d61e65bd30be30a6173687287130be0cdee2ddc3cd828 not found: ID does not exist" containerID="a5379d7913fcbc550e0d61e65bd30be30a6173687287130be0cdee2ddc3cd828" Jul 07 16:13:35.266169 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:35.266121 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5379d7913fcbc550e0d61e65bd30be30a6173687287130be0cdee2ddc3cd828"} err="failed to get container status \"a5379d7913fcbc550e0d61e65bd30be30a6173687287130be0cdee2ddc3cd828\": rpc error: code = NotFound desc = could not find container \"a5379d7913fcbc550e0d61e65bd30be30a6173687287130be0cdee2ddc3cd828\": container with ID starting with a5379d7913fcbc550e0d61e65bd30be30a6173687287130be0cdee2ddc3cd828 not found: ID does not exist" Jul 07 16:13:35.271053 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:35.271028 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk"] Jul 07 16:13:35.274865 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:35.274830 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-7820dd-openshift-default-c85cd5587-8sszk"] Jul 07 16:13:36.378156 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:36.378126 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" path="/var/lib/kubelet/pods/3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473/volumes" Jul 07 16:13:37.739450 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:37.739414 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:38.089882 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.089784 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:38.385092 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.385063 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp"] Jul 07 16:13:38.385559 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.385544 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" containerName="istio-proxy" Jul 07 16:13:38.385612 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.385562 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" containerName="istio-proxy" Jul 07 16:13:38.385612 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.385581 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" containerName="istio-proxy" Jul 07 16:13:38.385612 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.385587 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" containerName="istio-proxy" Jul 07 16:13:38.385700 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.385659 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" containerName="istio-proxy" Jul 07 16:13:38.385700 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.385666 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d0fc9ff-40a9-4b0a-8ef4-3ef07e102473" containerName="istio-proxy" Jul 07 16:13:38.389111 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.389083 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.391684 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.391663 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-ac6096-openshift-default-dockercfg-p7t8f\"" Jul 07 16:13:38.401753 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.401728 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp"] Jul 07 16:13:38.414716 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.414687 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:38.482973 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.482920 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istiod-ca-cert\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.483188 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.483004 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8jn8\" (UniqueName: \"kubernetes.io/projected/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-kube-api-access-f8jn8\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.483188 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.483056 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-podinfo\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.483188 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.483130 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-token\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.483352 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.483196 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-workload-socket\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.483352 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.483274 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-workload-certs\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.483352 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.483296 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-credential-socket\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.483352 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.483325 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-data\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.483564 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.483365 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-envoy\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.568680 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.568645 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:38.583900 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.583829 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-envoy\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.583900 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.583906 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istiod-ca-cert\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.584105 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.583940 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8jn8\" (UniqueName: \"kubernetes.io/projected/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-kube-api-access-f8jn8\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.584105 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.583967 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-podinfo\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.584105 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.583996 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-token\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.584105 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.584017 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-workload-socket\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.584105 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.584055 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-workload-certs\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.584105 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.584086 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-credential-socket\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.584452 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.584116 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-data\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.584520 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.584461 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-workload-certs\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.584520 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.584506 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-data\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.584733 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.584712 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-credential-socket\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.584816 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.584783 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istiod-ca-cert\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.584896 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.584841 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-workload-socket\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.586707 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.586680 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-envoy\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.587072 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.587055 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-podinfo\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.594108 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.594077 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-token\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.594200 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.594141 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8jn8\" (UniqueName: \"kubernetes.io/projected/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-kube-api-access-f8jn8\") pod \"e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.700292 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.700195 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:38.848377 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.848350 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp"] Jul 07 16:13:38.850276 ip-10-0-138-64 kubenswrapper[2572]: W0707 16:13:38.850245 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf05fd49c_5ba5_4b11_b1c1_0f0243af6303.slice/crio-295d6b59926cac59fb837fa3c595210ccba75f263fca43ba178094aa3cf5554e WatchSource:0}: Error finding container 295d6b59926cac59fb837fa3c595210ccba75f263fca43ba178094aa3cf5554e: Status 404 returned error can't find the container with id 295d6b59926cac59fb837fa3c595210ccba75f263fca43ba178094aa3cf5554e Jul 07 16:13:38.852580 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.852540 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:38.852668 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.852631 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:38.852712 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:38.852681 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:39.271303 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:39.271266 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" event={"ID":"f05fd49c-5ba5-4b11-b1c1-0f0243af6303","Type":"ContainerStarted","Data":"102815c64a6173a55369dc6b5a5452f8109234007637de0352f3f52948f1592c"} Jul 07 16:13:39.271472 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:39.271327 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" event={"ID":"f05fd49c-5ba5-4b11-b1c1-0f0243af6303","Type":"ContainerStarted","Data":"295d6b59926cac59fb837fa3c595210ccba75f263fca43ba178094aa3cf5554e"} Jul 07 16:13:39.291298 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:39.291233 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" podStartSLOduration=1.291210048 podStartE2EDuration="1.291210048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:13:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:13:39.290520581 +0000 UTC m=+1977.440381110" watchObservedRunningTime="2026-07-07 16:13:39.291210048 +0000 UTC m=+1977.441070552" Jul 07 16:13:39.700370 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:39.700335 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:39.705167 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:39.705142 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:40.277012 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:40.276982 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:40.278147 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:40.278129 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:41.247595 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:41.247556 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:41.355728 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:41.355687 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:41.429510 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:41.429479 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:41.825906 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:41.825845 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:41.926971 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:41.926933 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:42.053528 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:42.053496 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:45.742791 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:45.742749 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:47.362271 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:47.361902 2572 patch_prober.go:28] interesting pod/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:59104->10.134.0.44:15021: read: connection reset by peer" start-of-body= Jul 07 16:13:47.362271 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:47.361987 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" podUID="15fe2404-f4ff-4b60-a80f-f49136e63273" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:59104->10.134.0.44:15021: read: connection reset by peer" Jul 07 16:13:48.326934 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:48.326895 2572 generic.go:356] "Generic (PLEG): container finished" podID="15fe2404-f4ff-4b60-a80f-f49136e63273" containerID="4e9f6892706339f7aa16f3a37095030b058513cbdbb269a1e8b547682bd9aee2" exitCode=0 Jul 07 16:13:48.327114 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:48.326969 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" event={"ID":"15fe2404-f4ff-4b60-a80f-f49136e63273","Type":"ContainerDied","Data":"4e9f6892706339f7aa16f3a37095030b058513cbdbb269a1e8b547682bd9aee2"} Jul 07 16:13:48.327421 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:48.327400 2572 scope.go:117] "RemoveContainer" containerID="4e9f6892706339f7aa16f3a37095030b058513cbdbb269a1e8b547682bd9aee2" Jul 07 16:13:48.328462 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:48.328434 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:48.328581 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:48.328518 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:48.328581 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:48.328567 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:49.337422 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:49.337364 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" event={"ID":"15fe2404-f4ff-4b60-a80f-f49136e63273","Type":"ContainerStarted","Data":"6d98413788b85dd85e8cb3b1d1a49271ba5fea9e9f4ea1bfc6db15ec267219be"} Jul 07 16:13:49.434237 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:49.434195 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:49.434454 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:49.434334 2572 patch_prober.go:28] interesting pod/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 07 16:13:49.434454 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:49.434380 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" podUID="15fe2404-f4ff-4b60-a80f-f49136e63273" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 07 16:13:50.434232 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:50.434178 2572 patch_prober.go:28] interesting pod/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 07 16:13:50.434786 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:50.434267 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" podUID="15fe2404-f4ff-4b60-a80f-f49136e63273" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 07 16:13:51.433487 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:51.433445 2572 patch_prober.go:28] interesting pod/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 07 16:13:51.433677 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:51.433507 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" podUID="15fe2404-f4ff-4b60-a80f-f49136e63273" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 07 16:13:52.433216 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:52.433175 2572 patch_prober.go:28] interesting pod/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 07 16:13:52.433713 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:52.433252 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" podUID="15fe2404-f4ff-4b60-a80f-f49136e63273" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 07 16:13:53.436883 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:53.436835 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:53.437227 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:53.437130 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:53.437756 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:53.437740 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:13:54.368048 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:54.368014 2572 generic.go:356] "Generic (PLEG): container finished" podID="f05fd49c-5ba5-4b11-b1c1-0f0243af6303" containerID="102815c64a6173a55369dc6b5a5452f8109234007637de0352f3f52948f1592c" exitCode=0 Jul 07 16:13:54.368255 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:54.368084 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" event={"ID":"f05fd49c-5ba5-4b11-b1c1-0f0243af6303","Type":"ContainerDied","Data":"102815c64a6173a55369dc6b5a5452f8109234007637de0352f3f52948f1592c"} Jul 07 16:13:54.368629 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:54.368611 2572 scope.go:117] "RemoveContainer" containerID="102815c64a6173a55369dc6b5a5452f8109234007637de0352f3f52948f1592c" Jul 07 16:13:54.369603 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:54.369577 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:54.369655 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:54.369642 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:54.369691 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:54.369672 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 16:13:54.724992 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:54.724899 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:54.826338 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:54.826301 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:55.277262 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:55.277223 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:55.375451 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:55.375406 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" event={"ID":"f05fd49c-5ba5-4b11-b1c1-0f0243af6303","Type":"ContainerStarted","Data":"eb5351315c90b01276ba39af36492d8955894de2e3861d95564d14a91736bb38"} Jul 07 16:13:55.701150 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:55.701096 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:55.703041 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:55.702667 2572 patch_prober.go:28] interesting pod/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 07 16:13:55.703041 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:55.702727 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" podUID="f05fd49c-5ba5-4b11-b1c1-0f0243af6303" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 07 16:13:56.712374 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:56.712332 2572 patch_prober.go:28] interesting pod/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 07 16:13:56.712995 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:56.712959 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" podUID="f05fd49c-5ba5-4b11-b1c1-0f0243af6303" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 07 16:13:57.701000 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:57.700957 2572 patch_prober.go:28] interesting pod/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 07 16:13:57.701322 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:57.701293 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" podUID="f05fd49c-5ba5-4b11-b1c1-0f0243af6303" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 07 16:13:58.707365 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:58.707327 2572 patch_prober.go:28] interesting pod/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 07 16:13:58.708116 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:58.708079 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" podUID="f05fd49c-5ba5-4b11-b1c1-0f0243af6303" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 07 16:13:59.704367 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:59.704334 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:59.704651 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:59.704614 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:13:59.705483 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:13:59.705458 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:14:02.667028 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:14:02.666995 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:02.767789 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:14:02.767744 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:03.063418 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:14:03.063326 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:46.564664 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:14:46.564624 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:46.665896 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:14:46.665864 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:51.457826 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:14:51.457786 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:42.452554 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:15:42.452528 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 16:15:42.483781 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:15:42.483752 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 16:16:40.085111 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:16:40.085069 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:16:41.193239 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:16:41.193203 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:16:55.344613 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:16:55.344577 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:17:12.930101 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:17:12.930067 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:17:47.186195 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:17:47.186156 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:17:48.078915 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:17:48.078798 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:18:05.121711 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:18:05.121622 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:18:05.678406 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:18:05.678374 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:18:21.658688 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:18:21.658651 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:18:23.401371 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:18:23.401334 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:18:31.335820 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:18:31.335774 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:18:31.435797 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:18:31.435761 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:18:55.549738 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:18:55.549699 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:18:55.650958 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:18:55.650917 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:03.425789 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:03.425755 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:03.530640 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:03.530599 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:14.973253 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:14.973194 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:15.855592 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:15.855545 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:16.995270 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:16.995234 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:17.347655 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:17.347562 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:17.449747 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:17.449713 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:17.549638 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:17.549601 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:17.715499 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:17.715460 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:22.425110 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:22.425075 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:52.116876 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:52.116803 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:53.133480 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:53.133438 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:53.237011 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:53.236975 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:59.297445 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:59.297401 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:59.549287 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:59.549192 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2"] Jul 07 16:19:59.549511 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:59.549483 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" podUID="15fe2404-f4ff-4b60-a80f-f49136e63273" containerName="istio-proxy" containerID="cri-o://6d98413788b85dd85e8cb3b1d1a49271ba5fea9e9f4ea1bfc6db15ec267219be" gracePeriod=30 Jul 07 16:19:59.575167 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:59.575134 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:59.853454 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:19:59.853359 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:00.000393 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:00.000352 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:00.414486 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:00.414448 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:00.510246 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:00.510210 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:00.611051 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:00.611011 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:00.732794 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:00.732685 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:04.811307 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.811238 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:20:04.900507 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.900462 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm75r\" (UniqueName: \"kubernetes.io/projected/15fe2404-f4ff-4b60-a80f-f49136e63273-kube-api-access-qm75r\") pod \"15fe2404-f4ff-4b60-a80f-f49136e63273\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " Jul 07 16:20:04.900720 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.900530 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-credential-socket\") pod \"15fe2404-f4ff-4b60-a80f-f49136e63273\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " Jul 07 16:20:04.900720 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.900554 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-workload-socket\") pod \"15fe2404-f4ff-4b60-a80f-f49136e63273\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " Jul 07 16:20:04.900720 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.900610 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-data\") pod \"15fe2404-f4ff-4b60-a80f-f49136e63273\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " Jul 07 16:20:04.900720 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.900634 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-token\") pod \"15fe2404-f4ff-4b60-a80f-f49136e63273\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " Jul 07 16:20:04.900720 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.900675 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-envoy\") pod \"15fe2404-f4ff-4b60-a80f-f49136e63273\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " Jul 07 16:20:04.900720 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.900708 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-podinfo\") pod \"15fe2404-f4ff-4b60-a80f-f49136e63273\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " Jul 07 16:20:04.901078 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.900753 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15fe2404-f4ff-4b60-a80f-f49136e63273-istiod-ca-cert\") pod \"15fe2404-f4ff-4b60-a80f-f49136e63273\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " Jul 07 16:20:04.901078 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.900800 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-workload-certs\") pod \"15fe2404-f4ff-4b60-a80f-f49136e63273\" (UID: \"15fe2404-f4ff-4b60-a80f-f49136e63273\") " Jul 07 16:20:04.901078 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.900977 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "15fe2404-f4ff-4b60-a80f-f49136e63273" (UID: "15fe2404-f4ff-4b60-a80f-f49136e63273"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:20:04.901078 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.900992 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "15fe2404-f4ff-4b60-a80f-f49136e63273" (UID: "15fe2404-f4ff-4b60-a80f-f49136e63273"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:20:04.901284 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.901185 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "15fe2404-f4ff-4b60-a80f-f49136e63273" (UID: "15fe2404-f4ff-4b60-a80f-f49136e63273"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:20:04.901341 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.901288 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-credential-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:04.901341 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.901297 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15fe2404-f4ff-4b60-a80f-f49136e63273-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "15fe2404-f4ff-4b60-a80f-f49136e63273" (UID: "15fe2404-f4ff-4b60-a80f-f49136e63273"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:20:04.901341 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.901303 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-workload-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:04.901491 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.901350 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-workload-certs\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:04.901673 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.901545 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-data" (OuterVolumeSpecName: "istio-data") pod "15fe2404-f4ff-4b60-a80f-f49136e63273" (UID: "15fe2404-f4ff-4b60-a80f-f49136e63273"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:20:04.903268 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.903240 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "15fe2404-f4ff-4b60-a80f-f49136e63273" (UID: "15fe2404-f4ff-4b60-a80f-f49136e63273"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:20:04.903268 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.903253 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "15fe2404-f4ff-4b60-a80f-f49136e63273" (UID: "15fe2404-f4ff-4b60-a80f-f49136e63273"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 16:20:04.903458 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.903355 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15fe2404-f4ff-4b60-a80f-f49136e63273-kube-api-access-qm75r" (OuterVolumeSpecName: "kube-api-access-qm75r") pod "15fe2404-f4ff-4b60-a80f-f49136e63273" (UID: "15fe2404-f4ff-4b60-a80f-f49136e63273"). InnerVolumeSpecName "kube-api-access-qm75r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:20:04.903458 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:04.903377 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-token" (OuterVolumeSpecName: "istio-token") pod "15fe2404-f4ff-4b60-a80f-f49136e63273" (UID: "15fe2404-f4ff-4b60-a80f-f49136e63273"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:20:05.002140 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.002095 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm75r\" (UniqueName: \"kubernetes.io/projected/15fe2404-f4ff-4b60-a80f-f49136e63273-kube-api-access-qm75r\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:05.002140 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.002133 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-data\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:05.002140 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.002146 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-token\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:05.002385 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.002156 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-envoy\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:05.002385 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.002168 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15fe2404-f4ff-4b60-a80f-f49136e63273-istio-podinfo\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:05.002385 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.002179 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15fe2404-f4ff-4b60-a80f-f49136e63273-istiod-ca-cert\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:05.241498 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.241465 2572 generic.go:356] "Generic (PLEG): container finished" podID="15fe2404-f4ff-4b60-a80f-f49136e63273" containerID="6d98413788b85dd85e8cb3b1d1a49271ba5fea9e9f4ea1bfc6db15ec267219be" exitCode=0 Jul 07 16:20:05.241714 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.241525 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" Jul 07 16:20:05.241714 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.241557 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" event={"ID":"15fe2404-f4ff-4b60-a80f-f49136e63273","Type":"ContainerDied","Data":"6d98413788b85dd85e8cb3b1d1a49271ba5fea9e9f4ea1bfc6db15ec267219be"} Jul 07 16:20:05.241714 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.241624 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2" event={"ID":"15fe2404-f4ff-4b60-a80f-f49136e63273","Type":"ContainerDied","Data":"99c756bce67999f88969fe924353fa4b67bc5e95506d23f698d7583a98aae3bc"} Jul 07 16:20:05.241714 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.241649 2572 scope.go:117] "RemoveContainer" containerID="6d98413788b85dd85e8cb3b1d1a49271ba5fea9e9f4ea1bfc6db15ec267219be" Jul 07 16:20:05.251589 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.251565 2572 scope.go:117] "RemoveContainer" containerID="4e9f6892706339f7aa16f3a37095030b058513cbdbb269a1e8b547682bd9aee2" Jul 07 16:20:05.261440 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.260945 2572 scope.go:117] "RemoveContainer" containerID="6d98413788b85dd85e8cb3b1d1a49271ba5fea9e9f4ea1bfc6db15ec267219be" Jul 07 16:20:05.261613 ip-10-0-138-64 kubenswrapper[2572]: E0707 16:20:05.261452 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d98413788b85dd85e8cb3b1d1a49271ba5fea9e9f4ea1bfc6db15ec267219be\": container with ID starting with 6d98413788b85dd85e8cb3b1d1a49271ba5fea9e9f4ea1bfc6db15ec267219be not found: ID does not exist" containerID="6d98413788b85dd85e8cb3b1d1a49271ba5fea9e9f4ea1bfc6db15ec267219be" Jul 07 16:20:05.261613 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.261488 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d98413788b85dd85e8cb3b1d1a49271ba5fea9e9f4ea1bfc6db15ec267219be"} err="failed to get container status \"6d98413788b85dd85e8cb3b1d1a49271ba5fea9e9f4ea1bfc6db15ec267219be\": rpc error: code = NotFound desc = could not find container \"6d98413788b85dd85e8cb3b1d1a49271ba5fea9e9f4ea1bfc6db15ec267219be\": container with ID starting with 6d98413788b85dd85e8cb3b1d1a49271ba5fea9e9f4ea1bfc6db15ec267219be not found: ID does not exist" Jul 07 16:20:05.261613 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.261515 2572 scope.go:117] "RemoveContainer" containerID="4e9f6892706339f7aa16f3a37095030b058513cbdbb269a1e8b547682bd9aee2" Jul 07 16:20:05.261798 ip-10-0-138-64 kubenswrapper[2572]: E0707 16:20:05.261769 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e9f6892706339f7aa16f3a37095030b058513cbdbb269a1e8b547682bd9aee2\": container with ID starting with 4e9f6892706339f7aa16f3a37095030b058513cbdbb269a1e8b547682bd9aee2 not found: ID does not exist" containerID="4e9f6892706339f7aa16f3a37095030b058513cbdbb269a1e8b547682bd9aee2" Jul 07 16:20:05.261927 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.261795 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e9f6892706339f7aa16f3a37095030b058513cbdbb269a1e8b547682bd9aee2"} err="failed to get container status \"4e9f6892706339f7aa16f3a37095030b058513cbdbb269a1e8b547682bd9aee2\": rpc error: code = NotFound desc = could not find container \"4e9f6892706339f7aa16f3a37095030b058513cbdbb269a1e8b547682bd9aee2\": container with ID starting with 4e9f6892706339f7aa16f3a37095030b058513cbdbb269a1e8b547682bd9aee2 not found: ID does not exist" Jul 07 16:20:05.263650 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.263625 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2"] Jul 07 16:20:05.267486 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:05.267451 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-12f2df-openshift-default-7c88d66bbc-dwft2"] Jul 07 16:20:06.377224 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:06.377189 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15fe2404-f4ff-4b60-a80f-f49136e63273" path="/var/lib/kubelet/pods/15fe2404-f4ff-4b60-a80f-f49136e63273/volumes" Jul 07 16:20:06.404632 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:06.404600 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:06.461208 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:06.461175 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:06.656272 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:06.656188 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp"] Jul 07 16:20:06.656430 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:06.656407 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" podUID="f05fd49c-5ba5-4b11-b1c1-0f0243af6303" containerName="istio-proxy" containerID="cri-o://eb5351315c90b01276ba39af36492d8955894de2e3861d95564d14a91736bb38" gracePeriod=30 Jul 07 16:20:06.672974 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:06.672945 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:06.895599 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:06.895564 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:11.910079 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:11.910054 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:20:12.074053 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.073957 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8jn8\" (UniqueName: \"kubernetes.io/projected/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-kube-api-access-f8jn8\") pod \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " Jul 07 16:20:12.074053 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.074019 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istiod-ca-cert\") pod \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " Jul 07 16:20:12.074053 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.074043 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-workload-socket\") pod \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " Jul 07 16:20:12.074323 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.074090 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-podinfo\") pod \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " Jul 07 16:20:12.074323 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.074131 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-data\") pod \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " Jul 07 16:20:12.074323 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.074160 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-token\") pod \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " Jul 07 16:20:12.074323 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.074206 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-credential-socket\") pod \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " Jul 07 16:20:12.074323 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.074257 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-workload-certs\") pod \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " Jul 07 16:20:12.074585 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.074369 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f05fd49c-5ba5-4b11-b1c1-0f0243af6303" (UID: "f05fd49c-5ba5-4b11-b1c1-0f0243af6303"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:20:12.074585 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.074415 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-envoy\") pod \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\" (UID: \"f05fd49c-5ba5-4b11-b1c1-0f0243af6303\") " Jul 07 16:20:12.074585 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.074485 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f05fd49c-5ba5-4b11-b1c1-0f0243af6303" (UID: "f05fd49c-5ba5-4b11-b1c1-0f0243af6303"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:20:12.074585 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.074499 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f05fd49c-5ba5-4b11-b1c1-0f0243af6303" (UID: "f05fd49c-5ba5-4b11-b1c1-0f0243af6303"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:20:12.074801 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.074595 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f05fd49c-5ba5-4b11-b1c1-0f0243af6303" (UID: "f05fd49c-5ba5-4b11-b1c1-0f0243af6303"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:20:12.075056 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.074941 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-data" (OuterVolumeSpecName: "istio-data") pod "f05fd49c-5ba5-4b11-b1c1-0f0243af6303" (UID: "f05fd49c-5ba5-4b11-b1c1-0f0243af6303"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:20:12.075056 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.075031 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-data\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:12.075056 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.075045 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-credential-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:12.075223 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.075057 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-workload-certs\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:12.075223 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.075070 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istiod-ca-cert\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:12.075223 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.075080 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-workload-socket\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:12.076454 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.076423 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-kube-api-access-f8jn8" (OuterVolumeSpecName: "kube-api-access-f8jn8") pod "f05fd49c-5ba5-4b11-b1c1-0f0243af6303" (UID: "f05fd49c-5ba5-4b11-b1c1-0f0243af6303"). InnerVolumeSpecName "kube-api-access-f8jn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:20:12.076572 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.076457 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-token" (OuterVolumeSpecName: "istio-token") pod "f05fd49c-5ba5-4b11-b1c1-0f0243af6303" (UID: "f05fd49c-5ba5-4b11-b1c1-0f0243af6303"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:20:12.076614 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.076573 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f05fd49c-5ba5-4b11-b1c1-0f0243af6303" (UID: "f05fd49c-5ba5-4b11-b1c1-0f0243af6303"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:20:12.076764 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.076749 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f05fd49c-5ba5-4b11-b1c1-0f0243af6303" (UID: "f05fd49c-5ba5-4b11-b1c1-0f0243af6303"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 16:20:12.176528 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.176489 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8jn8\" (UniqueName: \"kubernetes.io/projected/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-kube-api-access-f8jn8\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:12.176528 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.176522 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-podinfo\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:12.176528 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.176531 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-token\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:12.176528 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.176539 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f05fd49c-5ba5-4b11-b1c1-0f0243af6303-istio-envoy\") on node \"ip-10-0-138-64.ec2.internal\" DevicePath \"\"" Jul 07 16:20:12.289428 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.289393 2572 generic.go:356] "Generic (PLEG): container finished" podID="f05fd49c-5ba5-4b11-b1c1-0f0243af6303" containerID="eb5351315c90b01276ba39af36492d8955894de2e3861d95564d14a91736bb38" exitCode=0 Jul 07 16:20:12.289604 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.289445 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" Jul 07 16:20:12.289604 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.289450 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" event={"ID":"f05fd49c-5ba5-4b11-b1c1-0f0243af6303","Type":"ContainerDied","Data":"eb5351315c90b01276ba39af36492d8955894de2e3861d95564d14a91736bb38"} Jul 07 16:20:12.289604 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.289497 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp" event={"ID":"f05fd49c-5ba5-4b11-b1c1-0f0243af6303","Type":"ContainerDied","Data":"295d6b59926cac59fb837fa3c595210ccba75f263fca43ba178094aa3cf5554e"} Jul 07 16:20:12.289604 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.289518 2572 scope.go:117] "RemoveContainer" containerID="eb5351315c90b01276ba39af36492d8955894de2e3861d95564d14a91736bb38" Jul 07 16:20:12.302112 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.302088 2572 scope.go:117] "RemoveContainer" containerID="102815c64a6173a55369dc6b5a5452f8109234007637de0352f3f52948f1592c" Jul 07 16:20:12.310808 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.310789 2572 scope.go:117] "RemoveContainer" containerID="eb5351315c90b01276ba39af36492d8955894de2e3861d95564d14a91736bb38" Jul 07 16:20:12.311094 ip-10-0-138-64 kubenswrapper[2572]: E0707 16:20:12.311073 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb5351315c90b01276ba39af36492d8955894de2e3861d95564d14a91736bb38\": container with ID starting with eb5351315c90b01276ba39af36492d8955894de2e3861d95564d14a91736bb38 not found: ID does not exist" containerID="eb5351315c90b01276ba39af36492d8955894de2e3861d95564d14a91736bb38" Jul 07 16:20:12.311143 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.311103 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb5351315c90b01276ba39af36492d8955894de2e3861d95564d14a91736bb38"} err="failed to get container status \"eb5351315c90b01276ba39af36492d8955894de2e3861d95564d14a91736bb38\": rpc error: code = NotFound desc = could not find container \"eb5351315c90b01276ba39af36492d8955894de2e3861d95564d14a91736bb38\": container with ID starting with eb5351315c90b01276ba39af36492d8955894de2e3861d95564d14a91736bb38 not found: ID does not exist" Jul 07 16:20:12.311143 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.311122 2572 scope.go:117] "RemoveContainer" containerID="102815c64a6173a55369dc6b5a5452f8109234007637de0352f3f52948f1592c" Jul 07 16:20:12.311337 ip-10-0-138-64 kubenswrapper[2572]: E0707 16:20:12.311319 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"102815c64a6173a55369dc6b5a5452f8109234007637de0352f3f52948f1592c\": container with ID starting with 102815c64a6173a55369dc6b5a5452f8109234007637de0352f3f52948f1592c not found: ID does not exist" containerID="102815c64a6173a55369dc6b5a5452f8109234007637de0352f3f52948f1592c" Jul 07 16:20:12.311393 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.311345 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"102815c64a6173a55369dc6b5a5452f8109234007637de0352f3f52948f1592c"} err="failed to get container status \"102815c64a6173a55369dc6b5a5452f8109234007637de0352f3f52948f1592c\": rpc error: code = NotFound desc = could not find container \"102815c64a6173a55369dc6b5a5452f8109234007637de0352f3f52948f1592c\": container with ID starting with 102815c64a6173a55369dc6b5a5452f8109234007637de0352f3f52948f1592c not found: ID does not exist" Jul 07 16:20:12.318736 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.318710 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp"] Jul 07 16:20:12.325148 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.325087 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-ac6096-openshift-default-c9c77c4d7-9b9sp"] Jul 07 16:20:12.380101 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:12.380064 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f05fd49c-5ba5-4b11-b1c1-0f0243af6303" path="/var/lib/kubelet/pods/f05fd49c-5ba5-4b11-b1c1-0f0243af6303/volumes" Jul 07 16:20:13.363691 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:13.363636 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77db849c7c-vvlzd_72ee07b1-5fc0-4b69-94b0-76f06b763edf/copy-manifests/0.log" Jul 07 16:20:13.369395 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:13.369370 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77db849c7c-vvlzd_72ee07b1-5fc0-4b69-94b0-76f06b763edf/manager/0.log" Jul 07 16:20:13.485429 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:13.485402 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-52l8l_77588649-5830-451e-b810-e0d725b7a2aa/postgres/0.log" Jul 07 16:20:16.119171 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:16.119131 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-m8h2b_5f5ad39c-5329-49c7-883c-67d1074bf5d4/discovery/0.log" Jul 07 16:20:16.466132 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:16.466027 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9lxm9_e589c1a2-1e65-4826-b0d7-4145df69b5b4/istio-proxy/1.log" Jul 07 16:20:16.587966 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:16.587928 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8452z_a8b90c74-2524-44fb-83ba-73cd37ddcf99/payload-pre-processing/0.log" Jul 07 16:20:17.200622 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:17.200586 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjss_52618558-e0b0-4bf5-b273-d150862891b6/main/0.log" Jul 07 16:20:17.309171 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:17.309122 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-7wqw8_3f2c456c-f1f1-48ac-a820-185a070e321e/main/0.log" Jul 07 16:20:17.664395 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:17.664343 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-d4n8s_cf1ae12e-9d55-4d9c-b76d-0c42313f8af9/main/0.log" Jul 07 16:20:22.175889 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:22.175840 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:22.271094 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:22.271051 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:24.975847 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:24.975813 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4q4t9_bd011bd6-abd7-4719-add3-7ba16ed962df/global-pull-secret-syncer/0.log" Jul 07 16:20:25.119732 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:25.119698 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5nrjp_708dd8c4-5687-42c0-b485-ec5cd5e0c8cd/konnectivity-agent/0.log" Jul 07 16:20:25.248383 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:25.248304 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-64.ec2.internal_929bfad889b023d7ee3168f8319c1420/haproxy/0.log" Jul 07 16:20:32.644983 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:32.644947 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_99b2647f-9b61-4d56-86e0-a9b118316c74/alertmanager/0.log" Jul 07 16:20:32.668447 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:32.668417 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_99b2647f-9b61-4d56-86e0-a9b118316c74/config-reloader/0.log" Jul 07 16:20:32.691702 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:32.691675 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_99b2647f-9b61-4d56-86e0-a9b118316c74/kube-rbac-proxy-web/0.log" Jul 07 16:20:32.714247 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:32.714221 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_99b2647f-9b61-4d56-86e0-a9b118316c74/kube-rbac-proxy/0.log" Jul 07 16:20:32.738382 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:32.738360 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_99b2647f-9b61-4d56-86e0-a9b118316c74/kube-rbac-proxy-metric/0.log" Jul 07 16:20:32.759869 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:32.759830 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_99b2647f-9b61-4d56-86e0-a9b118316c74/prom-label-proxy/0.log" Jul 07 16:20:32.785369 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:32.785335 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_99b2647f-9b61-4d56-86e0-a9b118316c74/init-config-reloader/0.log" Jul 07 16:20:32.864986 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:32.864904 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-srlgx_f4fdde01-03f7-4685-bded-c19e8031e5c2/kube-state-metrics/0.log" Jul 07 16:20:32.882500 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:32.882464 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-srlgx_f4fdde01-03f7-4685-bded-c19e8031e5c2/kube-rbac-proxy-main/0.log" Jul 07 16:20:32.907389 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:32.907363 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-srlgx_f4fdde01-03f7-4685-bded-c19e8031e5c2/kube-rbac-proxy-self/0.log" Jul 07 16:20:32.949632 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:32.949602 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-86b4d47b78-hzms4_b724ed67-5d65-408e-92f4-6f4a33bde500/metrics-server/0.log" Jul 07 16:20:32.970609 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:32.970581 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-qd58h_21c8673d-9e35-4aca-857c-6698870a4442/monitoring-plugin/0.log" Jul 07 16:20:33.108601 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.108565 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rlph7_106be09e-887b-49c7-86c0-486a4880ae04/node-exporter/0.log" Jul 07 16:20:33.165233 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.165208 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rlph7_106be09e-887b-49c7-86c0-486a4880ae04/kube-rbac-proxy/0.log" Jul 07 16:20:33.220791 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.220765 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rlph7_106be09e-887b-49c7-86c0-486a4880ae04/init-textfile/0.log" Jul 07 16:20:33.395510 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.395470 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-blx67_f62d7fac-1b60-4abf-a6d9-750e39613ce0/kube-rbac-proxy-main/0.log" Jul 07 16:20:33.420317 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.420241 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-blx67_f62d7fac-1b60-4abf-a6d9-750e39613ce0/kube-rbac-proxy-self/0.log" Jul 07 16:20:33.445614 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.445571 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-blx67_f62d7fac-1b60-4abf-a6d9-750e39613ce0/openshift-state-metrics/0.log" Jul 07 16:20:33.486512 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.486489 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b17c484-3dd3-445a-aa4f-79e249f1d301/prometheus/0.log" Jul 07 16:20:33.510275 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.510244 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b17c484-3dd3-445a-aa4f-79e249f1d301/config-reloader/0.log" Jul 07 16:20:33.542382 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.542350 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b17c484-3dd3-445a-aa4f-79e249f1d301/thanos-sidecar/0.log" Jul 07 16:20:33.566017 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.565987 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b17c484-3dd3-445a-aa4f-79e249f1d301/kube-rbac-proxy-web/0.log" Jul 07 16:20:33.589637 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.589609 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b17c484-3dd3-445a-aa4f-79e249f1d301/kube-rbac-proxy/0.log" Jul 07 16:20:33.611769 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.611741 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b17c484-3dd3-445a-aa4f-79e249f1d301/kube-rbac-proxy-thanos/0.log" Jul 07 16:20:33.634152 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.634123 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3b17c484-3dd3-445a-aa4f-79e249f1d301/init-config-reloader/0.log" Jul 07 16:20:33.665809 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.665777 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-78vll_dff34d1d-59de-45db-a8a6-9dc59064c147/prometheus-operator/0.log" Jul 07 16:20:33.686686 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.686604 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-78vll_dff34d1d-59de-45db-a8a6-9dc59064c147/kube-rbac-proxy/0.log" Jul 07 16:20:33.746550 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.746518 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-964bc6c8f-cxr68_e53034a1-4c2f-4d76-a7b3-5e7a31c60a13/telemeter-client/0.log" Jul 07 16:20:33.769407 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.769378 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-964bc6c8f-cxr68_e53034a1-4c2f-4d76-a7b3-5e7a31c60a13/reload/0.log" Jul 07 16:20:33.791981 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.791949 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-964bc6c8f-cxr68_e53034a1-4c2f-4d76-a7b3-5e7a31c60a13/kube-rbac-proxy/0.log" Jul 07 16:20:33.827648 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.827620 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d8b589bfc-ks4lm_e917c281-fa2b-4ec6-8fe9-538390cf2b3b/thanos-query/0.log" Jul 07 16:20:33.849872 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.849823 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d8b589bfc-ks4lm_e917c281-fa2b-4ec6-8fe9-538390cf2b3b/kube-rbac-proxy-web/0.log" Jul 07 16:20:33.878304 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.878279 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d8b589bfc-ks4lm_e917c281-fa2b-4ec6-8fe9-538390cf2b3b/kube-rbac-proxy/0.log" Jul 07 16:20:33.901780 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.901746 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d8b589bfc-ks4lm_e917c281-fa2b-4ec6-8fe9-538390cf2b3b/prom-label-proxy/0.log" Jul 07 16:20:33.924265 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.924234 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d8b589bfc-ks4lm_e917c281-fa2b-4ec6-8fe9-538390cf2b3b/kube-rbac-proxy-rules/0.log" Jul 07 16:20:33.946496 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:33.946414 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d8b589bfc-ks4lm_e917c281-fa2b-4ec6-8fe9-538390cf2b3b/kube-rbac-proxy-metrics/0.log" Jul 07 16:20:34.690112 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.690073 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t"] Jul 07 16:20:34.690493 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.690474 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f05fd49c-5ba5-4b11-b1c1-0f0243af6303" containerName="istio-proxy" Jul 07 16:20:34.690493 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.690485 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f05fd49c-5ba5-4b11-b1c1-0f0243af6303" containerName="istio-proxy" Jul 07 16:20:34.690572 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.690500 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15fe2404-f4ff-4b60-a80f-f49136e63273" containerName="istio-proxy" Jul 07 16:20:34.690572 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.690506 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="15fe2404-f4ff-4b60-a80f-f49136e63273" containerName="istio-proxy" Jul 07 16:20:34.690638 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.690582 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f05fd49c-5ba5-4b11-b1c1-0f0243af6303" containerName="istio-proxy" Jul 07 16:20:34.690638 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.690590 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="15fe2404-f4ff-4b60-a80f-f49136e63273" containerName="istio-proxy" Jul 07 16:20:34.694108 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.694091 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:34.696816 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.696797 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lhshj\"/\"openshift-service-ca.crt\"" Jul 07 16:20:34.697877 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.697840 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lhshj\"/\"kube-root-ca.crt\"" Jul 07 16:20:34.697999 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.697912 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lhshj\"/\"default-dockercfg-wfbq2\"" Jul 07 16:20:34.708223 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.708201 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t"] Jul 07 16:20:34.794888 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.794806 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e0c5b78-f61f-4281-bc55-5ec9378855ba-podres\") pod \"perf-node-gather-daemonset-5gc9t\" (UID: \"5e0c5b78-f61f-4281-bc55-5ec9378855ba\") " pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:34.795079 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.794922 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e0c5b78-f61f-4281-bc55-5ec9378855ba-sys\") pod \"perf-node-gather-daemonset-5gc9t\" (UID: \"5e0c5b78-f61f-4281-bc55-5ec9378855ba\") " pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:34.795079 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.794948 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e0c5b78-f61f-4281-bc55-5ec9378855ba-lib-modules\") pod \"perf-node-gather-daemonset-5gc9t\" (UID: \"5e0c5b78-f61f-4281-bc55-5ec9378855ba\") " pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:34.795079 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.794965 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgzvm\" (UniqueName: \"kubernetes.io/projected/5e0c5b78-f61f-4281-bc55-5ec9378855ba-kube-api-access-vgzvm\") pod \"perf-node-gather-daemonset-5gc9t\" (UID: \"5e0c5b78-f61f-4281-bc55-5ec9378855ba\") " pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:34.795079 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.795068 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e0c5b78-f61f-4281-bc55-5ec9378855ba-proc\") pod \"perf-node-gather-daemonset-5gc9t\" (UID: \"5e0c5b78-f61f-4281-bc55-5ec9378855ba\") " pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:34.895755 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.895701 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e0c5b78-f61f-4281-bc55-5ec9378855ba-lib-modules\") pod \"perf-node-gather-daemonset-5gc9t\" (UID: \"5e0c5b78-f61f-4281-bc55-5ec9378855ba\") " pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:34.895755 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.895752 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgzvm\" (UniqueName: \"kubernetes.io/projected/5e0c5b78-f61f-4281-bc55-5ec9378855ba-kube-api-access-vgzvm\") pod \"perf-node-gather-daemonset-5gc9t\" (UID: \"5e0c5b78-f61f-4281-bc55-5ec9378855ba\") " pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:34.896009 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.895810 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e0c5b78-f61f-4281-bc55-5ec9378855ba-proc\") pod \"perf-node-gather-daemonset-5gc9t\" (UID: \"5e0c5b78-f61f-4281-bc55-5ec9378855ba\") " pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:34.896009 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.895903 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e0c5b78-f61f-4281-bc55-5ec9378855ba-podres\") pod \"perf-node-gather-daemonset-5gc9t\" (UID: \"5e0c5b78-f61f-4281-bc55-5ec9378855ba\") " pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:34.896009 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.895927 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e0c5b78-f61f-4281-bc55-5ec9378855ba-lib-modules\") pod \"perf-node-gather-daemonset-5gc9t\" (UID: \"5e0c5b78-f61f-4281-bc55-5ec9378855ba\") " pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:34.896009 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.895948 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e0c5b78-f61f-4281-bc55-5ec9378855ba-sys\") pod \"perf-node-gather-daemonset-5gc9t\" (UID: \"5e0c5b78-f61f-4281-bc55-5ec9378855ba\") " pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:34.896009 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.895987 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e0c5b78-f61f-4281-bc55-5ec9378855ba-proc\") pod \"perf-node-gather-daemonset-5gc9t\" (UID: \"5e0c5b78-f61f-4281-bc55-5ec9378855ba\") " pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:34.896009 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.896007 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e0c5b78-f61f-4281-bc55-5ec9378855ba-sys\") pod \"perf-node-gather-daemonset-5gc9t\" (UID: \"5e0c5b78-f61f-4281-bc55-5ec9378855ba\") " pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:34.896224 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.896038 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e0c5b78-f61f-4281-bc55-5ec9378855ba-podres\") pod \"perf-node-gather-daemonset-5gc9t\" (UID: \"5e0c5b78-f61f-4281-bc55-5ec9378855ba\") " pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:34.903926 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:34.903902 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgzvm\" (UniqueName: \"kubernetes.io/projected/5e0c5b78-f61f-4281-bc55-5ec9378855ba-kube-api-access-vgzvm\") pod \"perf-node-gather-daemonset-5gc9t\" (UID: \"5e0c5b78-f61f-4281-bc55-5ec9378855ba\") " pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:35.004269 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:35.004162 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:35.138044 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:35.138018 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t"] Jul 07 16:20:35.140736 ip-10-0-138-64 kubenswrapper[2572]: W0707 16:20:35.140706 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5e0c5b78_f61f_4281_bc55_5ec9378855ba.slice/crio-dd76282aaa3faf0dacc4f33dde7325c0e7457f0fb635f0c7cdbde9c8e00b1a42 WatchSource:0}: Error finding container dd76282aaa3faf0dacc4f33dde7325c0e7457f0fb635f0c7cdbde9c8e00b1a42: Status 404 returned error can't find the container with id dd76282aaa3faf0dacc4f33dde7325c0e7457f0fb635f0c7cdbde9c8e00b1a42 Jul 07 16:20:35.405932 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:35.405892 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" event={"ID":"5e0c5b78-f61f-4281-bc55-5ec9378855ba","Type":"ContainerStarted","Data":"65962e813b56af5c597d17a44611dab47e001b705e7e5cf1f90df21f21c48985"} Jul 07 16:20:35.406105 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:35.405955 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" event={"ID":"5e0c5b78-f61f-4281-bc55-5ec9378855ba","Type":"ContainerStarted","Data":"dd76282aaa3faf0dacc4f33dde7325c0e7457f0fb635f0c7cdbde9c8e00b1a42"} Jul 07 16:20:35.406105 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:35.405980 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:35.424026 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:35.423974 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" podStartSLOduration=1.423958421 podStartE2EDuration="1.423958421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:20:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:20:35.423259276 +0000 UTC m=+2393.573119786" watchObservedRunningTime="2026-07-07 16:20:35.423958421 +0000 UTC m=+2393.573818926" Jul 07 16:20:37.864930 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:37.864868 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sdr96_d13e7db2-e03e-43a4-98cb-2b5fcc7d7093/dns/0.log" Jul 07 16:20:37.886178 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:37.886113 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sdr96_d13e7db2-e03e-43a4-98cb-2b5fcc7d7093/kube-rbac-proxy/0.log" Jul 07 16:20:38.019950 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:38.019921 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9m9rt_b5904914-177d-4c1f-9be3-a3f3ef40c391/dns-node-resolver/0.log" Jul 07 16:20:38.669941 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:38.669905 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gc7w8_e5253cd9-19e7-49d4-aaa6-5885489984fa/node-ca/0.log" Jul 07 16:20:39.837314 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:39.837280 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-m8h2b_5f5ad39c-5329-49c7-883c-67d1074bf5d4/discovery/0.log" Jul 07 16:20:39.921805 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:39.921773 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9lxm9_e589c1a2-1e65-4826-b0d7-4145df69b5b4/istio-proxy/0.log" Jul 07 16:20:39.978166 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:39.978133 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9lxm9_e589c1a2-1e65-4826-b0d7-4145df69b5b4/istio-proxy/1.log" Jul 07 16:20:40.019563 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:40.019529 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8452z_a8b90c74-2524-44fb-83ba-73cd37ddcf99/payload-pre-processing/0.log" Jul 07 16:20:40.824288 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:40.824253 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jwspw_3b250d6f-7e56-4305-8bf6-f83934a23bfb/serve-healthcheck-canary/0.log" Jul 07 16:20:41.421161 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:41.421129 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lhshj/perf-node-gather-daemonset-5gc9t" Jul 07 16:20:41.464724 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:41.464691 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dp7kf_6ac29432-252b-4c62-b411-6b3553b79e5c/kube-rbac-proxy/0.log" Jul 07 16:20:41.486090 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:41.486059 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dp7kf_6ac29432-252b-4c62-b411-6b3553b79e5c/exporter/0.log" Jul 07 16:20:41.507968 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:41.507932 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dp7kf_6ac29432-252b-4c62-b411-6b3553b79e5c/extractor/0.log" Jul 07 16:20:42.484487 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:42.484460 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 16:20:42.514576 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:42.514552 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bmlhg_adceffcc-f1d1-4820-9c62-80f1d029dc3a/ovn-acl-logging/0.log" Jul 07 16:20:44.809164 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:44.809131 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77db849c7c-vvlzd_72ee07b1-5fc0-4b69-94b0-76f06b763edf/manager/0.log" Jul 07 16:20:44.830216 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:44.830188 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77db849c7c-vvlzd_72ee07b1-5fc0-4b69-94b0-76f06b763edf/copy-manifests/0.log" Jul 07 16:20:44.857921 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:44.857890 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-52l8l_77588649-5830-451e-b810-e0d725b7a2aa/postgres/0.log" Jul 07 16:20:45.848250 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:45.848215 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-m8h2b_5f5ad39c-5329-49c7-883c-67d1074bf5d4/discovery/0.log" Jul 07 16:20:45.908296 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:45.908268 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9lxm9_e589c1a2-1e65-4826-b0d7-4145df69b5b4/istio-proxy/0.log" Jul 07 16:20:45.963057 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:45.963020 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9lxm9_e589c1a2-1e65-4826-b0d7-4145df69b5b4/istio-proxy/1.log" Jul 07 16:20:45.994047 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:45.994019 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8452z_a8b90c74-2524-44fb-83ba-73cd37ddcf99/payload-pre-processing/0.log" Jul 07 16:20:46.122292 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:46.122210 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-778944b866-hr7fh_3704b84a-741b-4c09-8ece-4b0a0598883a/manager/0.log" Jul 07 16:20:47.445727 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:47.445690 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-m8h2b_5f5ad39c-5329-49c7-883c-67d1074bf5d4/discovery/0.log" Jul 07 16:20:47.507110 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:47.507078 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9lxm9_e589c1a2-1e65-4826-b0d7-4145df69b5b4/istio-proxy/0.log" Jul 07 16:20:47.564222 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:47.564185 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9lxm9_e589c1a2-1e65-4826-b0d7-4145df69b5b4/istio-proxy/1.log" Jul 07 16:20:47.598885 ip-10-0-138-64 kubenswrapper[2572]: I0707 16:20:47.598830 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8452z_a8b90c74-2524-44fb-83ba-73cd37ddcf99/payload-pre-processing/0.log"